← LLM Runners tool · /LOCALA
LocalAI
Drop-in OpenAI-compatible API for local models.
// github
50.4k stars
last commit · today
heavy CPU only MIT
// readme · what it is
LocalAI exposes an OpenAI-compatible REST API backed by llama.cpp, whisper.cpp, Stable Diffusion and more. If you already have code that calls client.chat.completions.create(...), you can point it at LocalAI and get the same shape back. Useful when you want one endpoint that handles chat, embeddings, transcription and image generation.
// deploy notes
Heavier than Ollama because it bundles multiple backends. Worth it if you want one API for chat + embeddings + image.
[ ALTERNATIVE TO ]
// links
- website https://localai.io
- github github.com/mudler/LocalAI