Call or route an LLM

Send a prompt to a language model, or route calls across models and providers.

Also asked as: llm api, ai gateway, model routing.

Websites for this task

None in the directory yet.

Agents: find_sites({"task":"call-llm"}).

APIs and MCP servers in the catalog

Cerebras Inference

Hosted inference API for running models on Cerebras hardware, authenticated with an API key.

LLM inference and AI gateways

Cohere

Official Cohere API for language, embed, and rerank models, using trial or production API keys.

LLM inference and AI gateways

DeepInfra

Serverless inference API for a catalog of open-source models, with an OpenAI-compatible interface and API-key authentication.

LLM inference and AI gateways

Fireworks AI

API to run, train, and deploy open models on the Fireworks AI inference platform, authenticated with an API key.

LLM inference and AI gateways

Groq

Hosted inference API for language models, with an OpenAI-compatible interface and API-key authentication.

LLM inference and AI gateways

Mistral AI

Official Mistral API for deploying and calling Mistral language models, authenticated with an API key.

LLM inference and AI gateways

Anthropic Claude API

Official Anthropic API for calling Claude models, authenticated with an API key.

LLM inference and AI gateways

DeepSeek API

Official DeepSeek API for calling DeepSeek models, with an OpenAI-compatible interface and API-key authentication.

LLM inference and AI gateways

Google Gemini API

Official Gemini Developer API for calling Google Gemini models, authenticated with an API key.

LLM inference and AI gateways

OpenAI API

Official OpenAI API for calling models, tools, and related endpoints, authenticated with an API key.

LLM inference and AI gateways

OpenRouter

Unified API for routing requests across many hosted language models, with an OpenAI-compatible interface and official API-key authentication.

LLM inference and AI gateways

Together AI

API to run, train, and serve open-source models on Together AI's inference cloud, authenticated with an API key.

LLM inference and AI gateways

Agents: search_tools({"query":"llm api"}). All tasks · updated 2026-11-22.