Open Saas Directory

LLM Inference Engines

Serve language models with low latency on your own infrastructure. Discover open source LLM inference engines for self-hosted deployments.

Open Source Projects tagged "LLM Inference Engines"

Ollama

Ollama

183,61818,358

Run large language models locally on your own machine

10/17/202618358 contributors