LocalAI
Open-source AI runtime that runs text, voice, image and agent workloads on your own hardware behind OpenAI-compatible APIs.
Infrastructure by LocalAI
IndexedMIT★ 49,920
Get started
Setup steps are in the repository. Website · Docs · Repository
About
LocalAI is an open-source AI runtime with a small core that speaks the OpenAI and Anthropic APIs, adding inference backends only when a model needs them. It runs text, vision, speech, image, video, embeddings, reranking and autonomous agents on hardware the user controls, and a Docker image is provided for quick start.
Use cases: model-inference
Reviews
Write a reviewNo reviews yet. Installed it? Reviews come from verified installers only. How reviews work
Fact sheet
- Category
- Inference · local
- Self-host
- Yeslocalai.io
- Open source
- Yeslocalai.io
- Protocols
- openai-compatible, webrtc, mcplocalai.io
Facts read from the vendor's own pages by claude-haiku-5-5 on Oct 24, 2026; a fact is shown only with the page it came from.
Signals
- Stars
- 49,920
- Forks
- 4,539
- Open issues
- 101
- Last commit
- Oct 24, 2026 (3 days ago)
- Last release
- Oct 23, 2026 (5 days ago)
From GitHub (fetched Oct 24, 2026).
Details
- License
- MIT
- Repository
- github.com/mudler/LocalAI
- Website
- localai.io
- Docs
- localai.io/docs/
- First seen
- Oct 24, 2026
- Last checked
- Oct 24, 2026
Cite this page
LocalAI. Agent Mart. https://agentmart.dev/infrastructure/localai (last updated 2026-10-24)