Skip to main content
116+
Integrations
7
Categories
1000+
Models & MCPs

Coming soon

Sandbox
Coming soon

Isolated execution environments for running agent-generated code safely.

Generative UI
Coming soon

Stream rich, interactive UI components directly from model responses.

Route IDE and CLI coding agents through the gateway to centralize model access, spend controls, and audit logs across your engineering teams.
Claude
Cline
Cursor
Gemini CLI
GitHub Copilot
Goose
OpenCode
Codex CLI
Qwen CLI
Roo Code
Point any agent framework or LLM app at the gateway by overriding the base URL and API key — no code rewrite needed. Pick your integration below, or expand How to proxy any request for the general pattern.
Agno
CrewAI
DSPy
Instructor
LangChain
Langroid
OpenAI Agents SDK
OpenAI Swarm
Phidata
Pydantic AI
Strands Agents
AnythingLLM
Dify
Flowise
Jan
Langflow
LibreChat
n8n
Open WebUI
Agent frameworks and LLM applications talk to models over an OpenAI-compatible API. To route them through TrueFoundry, you don’t rewrite any logic — you point the client at the gateway by overriding two values:
  • Base URL → your TrueFoundry AI Gateway endpoint
  • API key → your TrueFoundry API key
Grab your base URL, model ID, and API key from the unified code snippet in the gateway playground:
TrueFoundry playground usage code snippet showing the Base URL, Model ID, and API Key
Once traffic flows through the gateway, every framework and app inherits unified model access, rate limiting, budgets, guardrails, logging, and observability.
Any framework or app that lets you set a custom base URL and API key can route through the gateway using this same pattern.
Attach policy checks — PII redaction, moderation, prompt-injection defense, and more — to requests flowing through the gateway.
TrueFoundry Guardrails
OpenAI Moderation
Bedrock Guardrails
Azure PII
Azure Content Safety
Azure Prompt Shield
Enkrypt AI
Palo Alto Prisma AIRS
CrowdStrike logoCrowdStrike AIDR
Patronus AI
Fiddler AI
Google Model Armor
GraySwan Cygnal
Akto
TrojAI
Noma Security
Pillar Security
NVIDIA NeMo
Guardrails AI
CoreWeave Guardrails
Lasso Security
Arthur AI
Verra
HiddenLayer
Custom Guardrails
Ship gateway traces, metrics, and logs to your existing observability and evaluation platforms.
Arize
Axiom
Braintrust
Coralogix
Dash0
ClickStack
Confident AI
CoreWeave
Dynatrace
Elastic
Honeycomb
HoneyHive
Langfuse
LangWatch
Laminar
LangSmith
Last9
Lunary
Middleware
New Relic
OpenLIT
PromptLayer
Pydantic Logfire
SigNoz
Splunk
Traceloop
Register governed MCP servers so your agents can securely call tools and reach data sources through the gateway.
Tavily
Microsoft 365 logoMicrosoft 365
Exa logoExa
Linear logoLinear
Notion logoNotion
Slack
Looker
HubSpot
Databricks
Neo4j
GitHub
Smartsheet
Atlassian Rovo
Google Workspace
CrowdStrike logoCrowdStrike Falcon
Salesforce
Zoom
Honeycomb
dbt
Gong
PagerDuty
Zendesk
QuickBooks
Snowflake
Firebase Crashlytics
Airtable
incident.io
MongoDB
DX
Omni Analytics
NetSuite
Datadog
Ironclad logoIronclad
Ramp
Connect models from every major provider and reach 1000+ models through one OpenAI-compatible API. Switch providers without changing your application code.
OpenAI
Anthropic
Google Vertex
AWS Bedrock
Azure OpenAI
Databricks
Browse all providers

See the full list of supported model and inference providers.

TrueFoundry builds and maintains open-source infrastructure for running AI and Kubernetes workloads efficiently. Each project runs entirely in your own environment — explore the ones below and dive into their docs.

KubeElasti

Kubernetes-native scale-to-zero for HTTP services — cut cost when idle without dropping traffic. A CNCF Sandbox project.

CruiseKube

Kubernetes-native rightsizing that lowers request overhead per workload using the Prometheus metrics you already collect.

aitori

An on-device agent that routes AI (LLM and MCP) traffic through your gateway for logging and policy — no app changes.

Need a specific integration?

Don’t see the tool you’re looking for? We’re always adding new integrations. Reach out and we’ll work with you to get it supported.

Request an integration

Contact us at support@truefoundry.com to request a new integration or discuss custom requirements.