# Call or route an LLM

Send a prompt to a language model, or route calls across models and providers.

Also asked as: llm api, ai gateway, model routing.

## Websites for this task

None in the directory yet.

MCP: `find_sites({"task":"call-llm"})`.

## APIs and MCP servers in the catalog

- [Cerebras Inference](https://agentready-tools.com/tools/cerebras-inference): Hosted inference API for running models on Cerebras hardware, authenticated with an API key.
- [Cohere](https://agentready-tools.com/tools/cohere): Official Cohere API for language, embed, and rerank models, using trial or production API keys.
- [DeepInfra](https://agentready-tools.com/tools/deepinfra): Serverless inference API for a catalog of open-source models, with an OpenAI-compatible interface and API-key authentication.
- [Fireworks AI](https://agentready-tools.com/tools/fireworks-ai): API to run, train, and deploy open models on the Fireworks AI inference platform, authenticated with an API key.
- [Groq](https://agentready-tools.com/tools/groq): Hosted inference API for language models, with an OpenAI-compatible interface and API-key authentication.
- [Mistral AI](https://agentready-tools.com/tools/mistral-ai): Official Mistral API for deploying and calling Mistral language models, authenticated with an API key.
- [Anthropic Claude API](https://agentready-tools.com/tools/anthropic-claude-api): Official Anthropic API for calling Claude models, authenticated with an API key.
- [DeepSeek API](https://agentready-tools.com/tools/deepseek-api): Official DeepSeek API for calling DeepSeek models, with an OpenAI-compatible interface and API-key authentication.
- [Google Gemini API](https://agentready-tools.com/tools/google-gemini-api): Official Gemini Developer API for calling Google Gemini models, authenticated with an API key.
- [OpenAI API](https://agentready-tools.com/tools/openai-api): Official OpenAI API for calling models, tools, and related endpoints, authenticated with an API key.
- [OpenRouter](https://agentready-tools.com/tools/openrouter): Unified API for routing requests across many hosted language models, with an OpenAI-compatible interface and official API-key authentication.
- [Together AI](https://agentready-tools.com/tools/together-ai): API to run, train, and serve open-source models on Together AI's inference cloud, authenticated with an API key.

MCP: `search_tools({"query":"llm api"})`. Categories: LLM inference and AI gateways, Observability and evals.

Updated 2026-11-22. All tasks: https://agentready-tools.com/task.md
