AI for local LLM inference
Run models on your own hardware without cloud APIs.
| # | Tool | Category | Pricing | Visit |
|---|---|---|---|---|
| 1 | Ollama Run LLMs locally — pull and run Llama, Mistral, Gemma, and 100+ models with one command and OpenAI-compatible API | LLM Frameworks | Free | Visit |
| 2 | LM Studio Desktop app for discovering, downloading, and chatting with local LLMs | LLM Frameworks | Free | Visit |
| 3 | anything-llm Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience | LLM Frameworks | Free | Visit |
| 4 | GPT4All Free local AI assistant — run open-source LLMs on any computer, fully offline | LLM Frameworks | Free | Visit |
| 5 | llama.cpp Run LLMs on CPU/GPU locally | LLM Frameworks | Free | Visit |