Tools for Api
108 tools tagged for this use case.
- OpenAI API
GPT-5.6, embeddings, image, and speech APIs — the default LLM API for most AI apps
Code / DevToolsFreemium - Hugging Face
The AI community hub — 900K+ models, 200K+ datasets, Inference API, and Spaces for the open-source ML ecosystem
LLM FrameworksFree - Vercel AI SDK Agents
Agents on the Vercel AI SDK
LLM FrameworksFree - Anthropic API
Claude models API — 200K-token context, tool use, vision, and computer use for building production AI applications
Code / DevToolsFreemium - Arize Phoenix
Open-source AI observability
LLM FrameworksFree - Browserbase
Headless browsers for AI agents
AgentsFreemium - Chainlit
Chat UI for LLM apps
LLM FrameworksFree - Composio
Tooling layer for AI agents
AgentsFreemium - Docling
IBM document conversion for AI
LLM FrameworksFree - DSPy
Programming—not prompting—LMs
LLM FrameworksFree - E2B
Secure sandboxes for AI agents
LLM FrameworksFreemium - Exa
Neural search for AI apps
ResearchFreemium - Firecrawl
Turn websites into LLM-ready data
LLM FrameworksFreemium - Giskard
Testing for ML and LLM apps
LLM FrameworksFreemium - Gradio
Quick ML demos and UIs
LLM FrameworksFree - Groq
Ultra-fast LLM inference API — run Llama, Mixtral, and Gemma at 500+ tokens/second on custom LPU hardware
LLM FrameworksFreemium - Guardrails AI
Validators for LLM outputs
LLM FrameworksFreemium - Haystack
Open-source LLM framework for RAG and NLP pipelines — production-ready by deepset
LLM FrameworksFree - Helicone
One-line LLM observability proxy — log, monitor, and debug LLM API calls
LLM FrameworksFreemium - Text Embeddings Inference
HF embedding server
LLM FrameworksFree - Text Generation Inference
HF production LLM serving
LLM FrameworksFree - Jina Reader
URL to LLM-friendly text
LLM FrameworksFreemium - LangGraph
Stateful multi-actor LLM apps
LLM FrameworksFree - langchain-openai
OpenAI integrations for LangChain
LLM FrameworksFree - Langfuse
Open-source LLM observability — tracing, evaluation, and prompt management
LLM FrameworksFree - LangSmith
Debug, test, and monitor LLM applications built with LangChain or any framework
LLM FrameworksFreemium - LiteLLM
Python SDK and proxy to call 100+ LLMs with one interface
LLM FrameworksFree - LlamaAgents
LlamaIndex multi-agent workflows
AgentsFree - llama.cpp
Run LLMs on CPU/GPU locally
LLM FrameworksFree - Mastra
TypeScript AI agent framework
LLM FrameworksFree - Model Context Protocol
Open standard for connecting AI to tools and data — the USB-C port for LLM integrations
LLM FrameworksFree - Mirascope
Pythonic LLM building blocks
LLM FrameworksFree - MLC LLM
Universal LLM deployment
LLM FrameworksFree - NeMo Guardrails
NVIDIA programmable guardrails
LLM FrameworksFree - Neo4j GraphRAG
Graph + vector RAG on Neo4j
LLM FrameworksFreemium - ollama-python
Python client for Ollama
LLM FrameworksFree - OpenLIT
Open-source LLM observability
LLM FrameworksFree - OpenRouter
Single API for 100+ LLMs — compare models, route to the best, pay per token
LLM FrameworksFreemium - Opik
LLM evaluation by Comet
LLM FrameworksFreemium - Perplexity API
Answer engine API
ResearchPaid - pgvector
Vector search in Postgres
LLM FrameworksFree - Pinecone
Managed vector database for production AI apps — serverless and low-latency
LLM FrameworksFreemium - Portkey
AI gateway for LLM routing, fallbacks, caching, and observability — production-ready in minutes
LLM FrameworksFreemium - Promptfoo
Open-source LLM testing and red-teaming — test prompts, evaluate outputs, catch regressions
LLM FrameworksFree - PydanticAI
Type-safe agent framework
LLM FrameworksFree - Cog
Package ML models in containers
LLM FrameworksFree - Smithery
Registry for MCP servers
LLM FrameworksFreemium - Streamlit
Data and AI app framework
LLM FrameworksFreemium - Tavily
Search API for AI agents
LLM FrameworksFreemium - Unstructured
ETL for LLMs
LLM FrameworksFreemium - Vapi
Voice AI agent infrastructure
AgentsFreemium - vLLM
High-throughput LLM inference server with continuous batching and PagedAttention
LLM FrameworksFree - Weaviate
Open-source vector database — hybrid search, multi-tenancy, and native LLM module integrations for RAG
LLM FrameworksFree - TruLens
LLM app evaluation and monitoring — measure quality and detect hallucinations in production
LLM FrameworksFree - GPT4All
Free local AI assistant — run open-source LLMs on any computer, fully offline
LLM FrameworksFree - Rivet
Visual IDE for building and debugging LLM applications — node-based workflow editor by Ironclad
LLM FrameworksFree - StarCoder2
Open-source code generation model — 15B parameters trained on 600+ programming languages
LLM FrameworksFree - Axolotl
Open-source LLM fine-tuning framework — LoRA, QLoRA, and full fine-tuning for Llama, Mistral, and more
LLM FrameworksFree - Chroma
Open-source embedding database for LLM apps — start in 3 lines of Python
LLM FrameworksFree - DeepEval
Open-source LLM evaluation framework — 14+ metrics for RAG, agents, and chatbots
LLM FrameworksFree - DeepSeek Coder
Open-source code-specialized LLM with state-of-the-art benchmark performance
Code / DevToolsFree - Guidance
Microsoft's constrained LLM generation — interleave generation, code, and control structures in one template
LLM FrameworksFree - Instructor
Structured LLM outputs with Pydantic — type-safe data extraction from any language model
LLM FrameworksFree - LanceDB
Embedded vector database for AI — serverless, columnar storage with Lance format
LLM FrameworksFree - LlamaParse
Advanced document parser for RAG — extract text, tables, and structure from PDFs with LLM accuracy
LLM FrameworksFreemium - LocalAI
Free open-source local AI — drop-in OpenAI API replacement for self-hosted models
LLM FrameworksFree - Mem0
Persistent memory layer for AI agents and LLM applications
LLM FrameworksFreemium - Milvus
Open-source vector database for billion-scale AI applications
LLM FrameworksFree - Outlines
Structured text generation from LLMs — guarantee JSON, regex, or grammar-constrained output
LLM FrameworksFree - Qdrant
High-performance open-source vector database built in Rust
LLM FrameworksFree - RAGAS
RAG evaluation framework — measure faithfulness, relevance, and recall of RAG pipelines
LLM FrameworksFree - Semantic Kernel
Microsoft's open-source SDK for AI orchestration — plugins, agents, and LLM integration for C#, Python, and Java
LLM FrameworksFree - SGLang
Fast LLM serving framework — efficient serving for LLMs and vision-language models
LLM FrameworksFree - Text Generation WebUI
Feature-rich local LLM web UI by oobabooga — the power user's choice
LLM FrameworksFree - Unsloth
2–5× faster LLM fine-tuning with 70% less memory — free open-source training library
LLM FrameworksFreemium - LoRAX
Multi-LoRA inference server — serve hundreds of fine-tuned adapters on a single GPU
LLM FrameworksFree - Marqo
Tensor search — end-to-end vector search with built-in embedding and retrieval
LLM FrameworksFreemium - Anthropic Python SDK
Official Python library for Claude API — access Claude Sonnet 4.6, Haiku 4.5, and Opus 4.6
LLM FrameworksPaid - AWS Bedrock
Fully managed foundation model service on AWS — Claude, Llama, Titan, and more
LLM FrameworksPaid - Azure OpenAI
OpenAI models with Microsoft Azure security, compliance, and SLAs
LLM FrameworksPaid - Banana
Serverless GPU inference for ML models — deploy any model as a scalable API
LLM FrameworksFreemium - Baseten
ML model deployment platform — deploy any model as a production API in minutes
LLM FrameworksFreemium - Braintrust
Enterprise AI evaluation platform — experiments, datasets, and production monitoring
LLM FrameworksFreemium - Cerebras Chat
Ultra-fast AI inference chat — run Llama and other open models at 2,000+ tokens/second on Cerebras WSE hardware
LLM FrameworksFree - Code Llama
Meta's code-specialized Llama models — open-source code generation, completion, and infill for 500+ languages
LLM FrameworksFree - Cohere Embed
State-of-the-art embedding models for semantic search and RAG — Embed v3 API
LLM FrameworksFreemium - Cohere
Enterprise LLM API — embeddings, RAG, and generation with enterprise security, compliance, and private cloud deployment
LLM FrameworksFreemium - Embedded
Embeddings API for semantic search and RAG — text and image vectors from multiple providers
LLM FrameworksFreemium - fal.ai
Fast serverless AI inference — FLUX, Stable Diffusion, and 100+ models via API
ImageFreemium - Fireworks AI
Ultra-fast serverless inference for open-source LLMs — Llama, Mixtral, and SDXL at speed
LLM FrameworksFreemium - Google AI Studio
Free prototyping tool for Gemini models — prompt engineering, fine-tuning, and API key generation
LLM FrameworksFreemium - Humanloop
LLM evaluation and prompt management — improve and deploy AI features in production
LLM FrameworksPaid - Jina Embeddings
Long-context embeddings API — 8192-token context for documents, code, and multilingual search
LLM FrameworksFreemium - LlamaIndex.TS
TypeScript LlamaIndex for RAG and agents — build data-connected LLM apps in Node.js and Next.js
LLM FrameworksFree - LM Studio
Desktop app for discovering, downloading, and chatting with local LLMs
LLM FrameworksFree - Mendable
AI chat search for developer documentation — train on your docs, deploy a chatbot
Code / DevToolsPaid - Mistral API
European AI API offering open and proprietary frontier models
LLM FrameworksPaid - Modal
Serverless Python and GPU cloud — deploy ML models, batch jobs, and APIs with decorator syntax
LLM FrameworksFreemium - MosaicML (Databricks)
Enterprise ML training platform — train and fine-tune LLMs at scale, now part of Databricks
LLM FrameworksPaid - OpenAI Python SDK
Official Python library for the OpenAI API — GPT-4o, DALL-E, Whisper, and Embeddings
LLM FrameworksPaid - Predibase
Managed fine-tuning and LoRA serving — production-grade custom LLM deployment
LLM FrameworksFreemium - PromptLayer
LLM observability and prompt management — log, version, and analyze every AI call
LLM FrameworksFreemium - Replicate
Run thousands of open-source ML models via API — LLMs, image generation, audio, and video without GPU management
LLM FrameworksFreemium - RunPod
GPU cloud for AI — rent A100/H100 GPUs for training, inference, and fine-tuning
LLM FrameworksFreemium - Together AI
Open-source LLM inference and fine-tuning API — run Llama, Mistral, and 100+ models with competitive pricing
LLM FrameworksFreemium - Vercel AI SDK
TypeScript AI SDK for React and Node — streaming, tool use, and multi-provider LLM integration with 1M+ npm downloads/week
LLM FrameworksFree - Voyage AI
State-of-the-art embedding and reranking models — domain-specific retrieval APIs
LLM FrameworksFreemium - Weights & Biases
ML experiment tracking, model registry, and LLM evaluation platform
LLM FrameworksFreemium