AI for prompt engineering
Prompt management, versioning, and testing.
| # | Tool | Category | Pricing | Visit |
|---|---|---|---|---|
| 1 | PromptLayer LLM observability and prompt management — log, version, and analyze every AI call | LLM Frameworks | Freemium | Visit |
| 2 | Promptfoo Open-source LLM testing and red-teaming — test prompts, evaluate outputs, catch regressions | LLM Frameworks | Free | Visit |
| 3 | Humanloop LLM evaluation and prompt management — improve and deploy AI features in production | LLM Frameworks | Paid | Visit |
| 4 | Langfuse Open-source LLM observability — tracing, evaluation, and prompt management | LLM Frameworks | Free | Visit |
| 5 | Portkey AI gateway for LLM routing, fallbacks, caching, and observability — production-ready in minutes | LLM Frameworks | Freemium | Visit |
| 6 | Helicone One-line LLM observability proxy — log, monitor, and debug LLM API calls | LLM Frameworks | Freemium | Visit |
| 7 | Guidance Microsoft's constrained LLM generation — interleave generation, code, and control structures in one template | LLM Frameworks | Free | Visit |