AI for local LLMs
Run models on-device or on your servers.
| # | Tool | Category | Pricing | Visit |
|---|---|---|---|---|
| 1 | Ollama Run LLMs locally — pull and run Llama, Mistral, Gemma, and 100+ models with one command and OpenAI-compatible API | LLM Frameworks | Free | Visit |
| 2 | LM Studio Desktop app for discovering, downloading, and chatting with local LLMs | LLM Frameworks | Free | Visit |
| 3 | LocalAI Free open-source local AI — drop-in OpenAI API replacement for self-hosted models | LLM Frameworks | Free | Visit |
| 4 | GPT4All Free local AI assistant — run open-source LLMs on any computer, fully offline | LLM Frameworks | Free | Visit |
| 5 | vLLM High-throughput LLM inference server with continuous batching and PagedAttention | LLM Frameworks | Free | Visit |
| 6 | Text Generation WebUI Feature-rich local LLM web UI by oobabooga — the power user's choice | LLM Frameworks | Free | Visit |
| 7 | Anthropic Python SDK Official Python library for Claude API — access Claude Sonnet 4.6, Haiku 4.5, and Opus 4.6 | LLM Frameworks | Paid | Visit |
| 8 | AWS Bedrock Fully managed foundation model service on AWS — Claude, Llama, Titan, and more | LLM Frameworks | Paid | Visit |