Skip to main content

Adding Models

This section explains the steps to add OpenAI models and configure the required access controls.
1

Navigate to OpenAI Models in AI Gateway

From the TrueFoundry dashboard, navigate to AI Gateway > Models and select OpenAI.
Navigating to OpenAI Provider Account in AI Gateway
2

Add OpenAI Account Details

Click Add OpenAI Account. Give a unique name to your OpenAI account and complete the form with your OpenAI authentication details (API Key). Add collaborators to your account, this will give access to the account to other users/teams. Learn more about access control here.
OpenAI account configuration form with fields for API key and collaborators
3

Add Models

Select the model from the list. If you see the model you want to add in the list of checkboxes, we support public model cost for these models.
(Optional) If the model you are looking for is not present in the options, you can add it using + Add Model at the end of list (scroll down to see the option) by filling the form.
TrueFoundry AI Gateway supports all text and image models in OpenAI.The complete list of models supported by OpenAI can be found here.

Inference

After adding the models, you can perform inference using an OpenAI-compatible API via the Playground or by integrating with your own application. Code Snippet and Try in Playgroud Buttons for each model

Regional Endpoints

OpenAI offers data residency controls that let you configure the region where your data is stored and, in some regions, processed. When data residency is enabled on your OpenAI account, you must use a region-specific domain prefix for API requests instead of the default api.openai.com. When adding an OpenAI account in TrueFoundry AI Gateway, set the Base URL to the appropriate regional endpoint for your OpenAI project.
RegionDomain PrefixBase URL
USus.api.openai.com (required)https://us.api.openai.com/v1
Europe (EEA + Switzerland)eu.api.openai.com (required)https://eu.api.openai.com/v1
Australiaau.api.openai.com (optional)https://au.api.openai.com/v1
Canadaca.api.openai.com (optional)https://ca.api.openai.com/v1
Japanjp.api.openai.com (optional)https://jp.api.openai.com/v1
Indiain.api.openai.com (optional)https://in.api.openai.com/v1
Singaporesg.api.openai.com (optional)https://sg.api.openai.com/v1
South Koreakr.api.openai.com (optional)https://kr.api.openai.com/v1
United Kingdomgb.api.openai.com (required)https://gb.api.openai.com/v1
United Arab Emiratesae.api.openai.com (required)https://ae.api.openai.com/v1
Regions marked as (required) must use the regional domain prefix for all requests. Regions marked as (optional) can use the prefix to improve latency, but it is not mandatory.
Non-US regions require approval for Modified Abuse Monitoring or Zero Data Retention on your OpenAI account. For full details on data residency, supported models, and endpoint limitations, refer to the OpenAI data controls documentation.