llama.cpp
LibraryRun language models on your own hardware, in plain C and C++. The engine under many local AI apps.
Good to know
- This repository was renamed on GitHub. It used to be ggerganov/llama.cpp.
Similar open source projects
More in AI chat and search-
Ollama
Download and run large language models on your own computer with one command.
Alternative to LM Studio
-
Open WebUI
A self-hosted chat interface for Ollama and OpenAI-compatible models.
Alternative to ChatGPT
-
RAGFlow
A retrieval-augmented generation engine that reads complex documents to ground an AI's answers.
AI chat and search
-
NextChat
A light, fast AI chat app for web and desktop that works with many model providers.
Alternative to ChatGPT
-
LobeHub
An AI chat framework with agents, plugins and many model providers.
Alternative to ChatGPT
-
AnythingLLM
Chat with your documents using any model, in a private AI workspace.
Alternative to NotebookLM, ChatGPT
About these numbers. Stars, dates and licenses come from GitHub through ecosyste.ms, collected on 10 Nov 2026; they can lag GitHub by a few days. A project is listed only if it has 300 or more stars, was updated in the last 12 months and states a license. A listing is not an endorsement, and we have not tested these tools on Antideploy yet. Logos belong to their projects and companies and are shown only to say which is which.