LLM inference and AI gateways

12 tools for agents in llm inference and ai gateways: APIs, official MCP servers and Actors.

Tasks: Call or route an LLM

Compare

ToolMCPPricingJurisdictionAgent-readiness
Anthropic Claude APINoNot yet verified-Not enough data
Cerebras InferenceNoNot yet verified-Not enough data
CohereNoNot yet verified-Not enough data
DeepInfraNoNot yet verified-Not enough data
DeepSeek APINoNot yet verified-Not enough data
Fireworks AINoNot yet verified-Not enough data
Google Gemini APINoNot yet verified-Not enough data
GroqNoNot yet verified-Not enough data
Mistral AINoNot yet verified-Not enough data
OpenAI APINoNot yet verified-Not enough data
OpenRouterNoNot yet verified-Not enough data
Together AINoNot yet verified-Not enough data

Comparison fields come from the catalog listing. "Not yet verified" and "Not enough data" mean we have no checked value yet; nothing is guessed. Method.

Tools

Anthropic Claude API

Official Anthropic API for calling Claude models, authenticated with an API key.

API or Actor

Cerebras Inference

Hosted inference API for running models on Cerebras hardware, authenticated with an API key.

API or Actor

Cohere

Official Cohere API for language, embed, and rerank models, using trial or production API keys.

API or Actor

DeepInfra

Serverless inference API for a catalog of open-source models, with an OpenAI-compatible interface and API-key authentication.

API or Actor

DeepSeek API

Official DeepSeek API for calling DeepSeek models, with an OpenAI-compatible interface and API-key authentication.

API or Actor

Fireworks AI

API to run, train, and deploy open models on the Fireworks AI inference platform, authenticated with an API key.

API or Actor

Google Gemini API

Official Gemini Developer API for calling Google Gemini models, authenticated with an API key.

API or Actor

Groq

Hosted inference API for language models, with an OpenAI-compatible interface and API-key authentication.

API or Actor

Mistral AI

Official Mistral API for deploying and calling Mistral language models, authenticated with an API key.

API or Actor

OpenAI API

Official OpenAI API for calling models, tools, and related endpoints, authenticated with an API key.

API or Actor

OpenRouter

Unified API for routing requests across many hosted language models, with an OpenAI-compatible interface and official API-key authentication.

API or Actor

Together AI

API to run, train, and serve open-source models on Together AI's inference cloud, authenticated with an API key.

API or Actor

Agents: search_tools({"category":"LLM inference and AI gateways"}) · JSON · All categories · updated 2026-11-22.