Pydantic AI - TrueFoundry Docs

This guide provides instructions for integrating Pydantic AI with the Truefoundry AI Gateway.

What is Pydantic AI?

Pydantic AI is a Python agent framework designed to make it less painful to build production-grade applications with Generative AI.

Key Features of Pydantic AI

Type Safe and Production Ready: Pydantic AI is built to be type safe and ready for production-grade applications. It uses Pydantic models to ensure your AI agents work reliably in real business environments, with proper validation and error handling built-in from the start.
Model Agnostic Support: Works with all popular LLM providers including OpenAI, Anthropic, Google, and more. You can easily switch between different AI models without changing your code, giving you flexibility to choose the best model for each task.
Built-in OpenTelemetry Integration: Includes comprehensive observability and monitoring through OpenTelemetry integration. Track performance, debug issues, and monitor your AI agents in production with detailed traces, logs, and metrics automatically collected and structured for analysis.

Prerequisites

Before integrating Pydantic AI with TrueFoundry, ensure you have:

TrueFoundry Account: Create a TrueFoundry account and follow the instructions in our Gateway Quick Start Guide
Pydantic AI Installation: Install Pydantic AI in your Python environment:
pip install pydantic-ai

You will get your base URL and model name directly from the unified code snippet:

TrueFoundry playground showing unified code snippet with base URL and model name

Integration Guide

Step 1: Initialize Pydantic AI with TrueFoundry

Create an OpenAI model instance configured to use TrueFoundry’s gateway:

from pydantic_ai import Agent
from pydantic_ai.models.openai import OpenAIModel
from pydantic_ai.providers.openai import OpenAIProvider

model = OpenAIModel(
    model_name='openai-main/gpt-4o',  # Ensure you pick the correct model name
    provider=OpenAIProvider(
        base_url='{GATEWAY_BASE_URL}',
        api_key='YOUR_TRUEFOUNDRY_PAT'
    )
)

Step 2: Basic Agent Example

Here’s a simple example of creating a Pydantic AI agent with TrueFoundry:

from pydantic_ai import Agent
from pydantic import BaseModel

# Define response structure
class SummaryResponse(BaseModel):
    title: str
    summary: str
    key_points: list[str]

# Create agent with TrueFoundry model
summary_agent = Agent(
    model=model,
    result_type=SummaryResponse,
    system_prompt='You are a helpful assistant that creates structured summaries.'
)

# Use the agent
async def summarize_text(text: str):
    result = await summary_agent.run(
        f"Summarize this text: {text}"
    )
    return result.data

By integrating Pydantic AI with TrueFoundry’s AI Gateway, you can build type-safe, production-ready AI applications with comprehensive monitoring and cost control.

​What is Pydantic AI?

​Key Features of Pydantic AI

​Prerequisites

​Integration Guide

​Step 1: Initialize Pydantic AI with TrueFoundry

​Step 2: Basic Agent Example