Skip to main content

AI for serverless inference

Deploy model endpoints without managing servers.

#ToolCategoryPricingVisit
1Modal

Serverless Python and GPU cloud — deploy ML models, batch jobs, and APIs with decorator syntax

LLM FrameworksFreemiumVisit
2Baseten

ML model deployment platform — deploy any model as a production API in minutes

LLM FrameworksFreemiumVisit
3Vercel AI SDK

TypeScript AI SDK for React and Node — streaming, tool use, and multi-provider LLM integration with 1M+ npm downloads/week

LLM FrameworksFreeVisit
4AWS Bedrock

Fully managed foundation model service on AWS — Claude, Llama, Titan, and more

LLM FrameworksPaidVisit
5Azure OpenAI

OpenAI models with Microsoft Azure security, compliance, and SLAs

LLM FrameworksPaidVisit

See also