Documentation
Powerful AI.
Closer to home.
Run open models on the Intel hardware you already own. From your first local request to a multi-machine inference pipeline.
- Open source
- OpenAI-compatible
- Built for Intel
01 / Get started
Your first step starts here. One machine or many, same starting point.
Make your first request
QuickstartDownload Cascadia, serve a ready-made model, and send it a request. No build required.
Run your first model
GuidePut your Intel hardware to work. Export a model and serve it on one machine.
02 / Capabilities
A small footprint. A bigger possibility.
Multi-machine inference
Run models larger than a single machine. Connect your Intel devices into a pipeline.
Visibility at every stage
Track token throughput, latency, and pipeline health with Prometheus metrics.
Inference on your terms
Keep inference on your own network. Understand the deployment security model.
03 / Reference

