Documentation Index
Fetch the complete documentation index at: /llms.txt
Use this file to discover all available pages before exploring further.

Skip to main content

TrueFoundry Docs home page

Book Demo
Blog
Sign Up
Sign Up

Get Started

AI Gateway Overview
Quick Start

LLM Gateway

AI Gateway Playground
Access Control
Caching (Exact and Semantic)
Cost Tracking

MCP Registry and Gateway

Overview
Getting Started
Authentication and Security
Auth Overrides
Virtual MCP Server
OpenAPI to MCP Server
Hosted Stdio-based MCP Server

Skills Registry

Overview
Create, Manage and Use Skills

Guardrails and Security

Overview
Getting Started
Configuration
Bring your own Guardrail / Plugin

Prompt Management

Create, Manage and Use Prompts

Observability

Metrics Dashboard
Request Logging
Configure Data Access
Configure Data Routing
API Access to MCP Metrics

Deployment

Architecture
Deployment Options
Globally Distributed SAAS
Connect Private Endpoints
Install AI Gateway

Admin Guide

Setup AI Gateway in Org
Setup Multiple Environments
Use Secret Manager

Chat

POST
Chat Completions

Agent

POST
Agent Responses
POST
Agent Chat Completions
POST
Agent App

Messages

POST
Messages
POST
Count Tokens

Embeddings

POST
Generate Embeddings

Rerank

POST
Rerank Documents

Responses

GET
List Model Response Input Items
GET
Get Model Response
DEL
Delete Model Response
POST
Model Responses
POST
Model Responses Compact

Image

POST
Generate Images
POST
Edit Images
POST
Create Image Variation

Audio

POST
Transcribe Audio
POST
Translate Audio
POST
Generate Speech

Batch

GET
List Batches
POST
Create Batch
GET
Get Batch
GET
Get Batch Output
POST
Cancel Batch

Files

GET
List Files
POST
Upload File
GET
Get File
DEL
Delete File
GET
Get File Content

Fine-tuning

GET
List Fine-tuning Jobs
POST
Create Fine-tuning Job
GET
Retrieve Fine-tuning Job
POST
Cancel Fine-tuning Job

Moderations

POST
Create Moderation

Models

GET
List available models

Deployment

Gateway Architecture

Learn how to use gateway architecture with TrueFoundry AI Gateway, including setup steps, use cases, and production-ready examples.

Please refer to Gateway Plane Architecture page.

Was this page helpful?

Span Attributes Deployment Options

⌘I

Powered byThis documentation is built and hosted on Mintlify, a developer documentation platform

Assistant

Responses are generated using AI and may contain mistakes.

Contact support