llama.cpp

FAQ

Alternatives

None listed.

Integrations

None listed.

Built on

None listed.

Good for these tasks

• AI for local LLM inference

Related tools

• OpenAI APIGPT-5.6, embeddings, image, and speech APIs — the default LLM API for most AI apps
• Hugging FaceThe AI community hub — 900K+ models, 200K+ datasets, Inference API, and Spaces for the open-source ML ecosystem
• Vercel AI SDK AgentsAgents on the Vercel AI SDK
• Anthropic APIClaude models API — 200K-token context, tool use, vision, and computer use for building production AI applications
• Arize PhoenixOpen-source AI observability
• BrowserbaseHeadless browsers for AI agents
• ChainlitChat UI for LLM apps
• ComposioTooling layer for AI agents
• DoclingIBM document conversion for AI
• DSPyProgramming—not prompting—LMs