localai
A self-hosted AI inference engine for running large language models locally
About
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
Languages
Contributors30
![dependabot[bot]](https://avatars.githubusercontent.com/in/29110?v=4)
![renovate[bot]](https://avatars.githubusercontent.com/in/2740?v=4)
- Local AI InferenceCore
Run large language models locally
- OpenAI-Compatible APICore
Provide APIs compatible with OpenAI clients
- Model ManagementCore
Load and switch between supported models
- Offline Operation
Use AI features without external services
- Hardware Acceleration
Use available CPU or GPU resources
- Self-Hosted Deployment
Run AI workloads on your own infrastructure
Comments Theme
