> ## Documentation Index
> Fetch the complete documentation index at: https://www.truefoundry.com/llms.txt
> Use this file to discover all available pages before exploring further.

# SigNoz

> Learn how to export LLM Gateway traces and metrics to SigNoz Cloud using OpenTelemetry integration.

This guide provides instructions for integrating [SigNoz](https://signoz.io/) with the TrueFoundry AI Gateway to export OpenTelemetry traces and metrics.

## What is SigNoz?

SigNoz is an open-source, OpenTelemetry-native observability platform that provides distributed tracing, metrics monitoring, and log management for cloud-native applications. SigNoz Cloud is the fully managed version that requires no infrastructure setup.

### Key Features of SigNoz

* **[Distributed Tracing](https://signoz.io/docs/instrumentation/)**: Capture end-to-end traces of all LLM requests with detailed span-level visibility into latency and errors
* **[Metrics Monitoring](https://signoz.io/docs/userguide/metrics/)**: Track aggregated usage, token counts, and latency trends across your LLM gateway with PromQL-compatible queries
* **[Alerts & Dashboards](https://signoz.io/docs/alerts-management/notification-channel/)**: Build custom dashboards and set up alerts on gateway performance metrics

## Prerequisites

Before integrating SigNoz with TrueFoundry, ensure you have:

1. **TrueFoundry Account**: Create a [TrueFoundry account](https://www.truefoundry.com/register) and follow the instructions in our [Gateway Quick Start Guide](https://docs.truefoundry.com/gateway/quick-start)
2. **SigNoz Cloud Account**: Sign up for a [SigNoz Cloud account](https://signoz.io/teams/) to get your ingestion endpoint and API key

## Understanding the SigNoz Ingestion Endpoint

SigNoz Cloud organizes ingestion by region. Your ingestion URL follows this pattern:

```
https://ingest.<region>.signoz.cloud:443
```

The region is visible in your SigNoz Cloud URL after login. Common regions are `in` for India and `us` for the United States. For example if your ingestion URL is `https://ingest.in2.signoz.cloud` then your region is `in2`.

## Integration Steps

<Steps>
  <Step title="Get Your Ingestion Key from SigNoz">
    1. Log into your [SigNoz Cloud dashboard](https://signoz.io/teams/).
    2. Navigate to **Settings** → **Ingestion Settings**.
    3. Copy your **Ingestion Key** and note your **ingestion URL**.

    <Tip>
      Your ingestion URL contains your region. For example `https://ingest.in2.signoz.cloud` means your region is `in2` and your traces endpoint will be `https://ingest.in2.signoz.cloud:443/v1/traces`.
    </Tip>
  </Step>

  <Step title="Configure OTEL Export in TrueFoundry">
    1. Go to **AI Gateway** → **Controls** → **Settings** in the TrueFoundry dashboard.
    2. Scroll down to the **OTEL Config** section and click the edit (✏️) button.

    <Frame>
      <img src="https://mintcdn.com/truefoundry/0QJep_0-RF6wltko/images/signoz-otel-config-section.png?fit=max&auto=format&n=0QJep_0-RF6wltko&q=85&s=dc549a320d3f9d828b11ab52c498e081" alt="TrueFoundry AI Gateway Settings page showing the OTEL Config section with edit button" width="2880" height="1616" data-path="images/signoz-otel-config-section.png" />
    </Frame>

    3. Enable the **Otel Traces Exporter Configuration** toggle and fill in:

    | Field            | Value                                                |
    | ---------------- | ---------------------------------------------------- |
    | **Toggle**       | Enabled                                              |
    | **Protocol**     | HTTP Configuration                                   |
    | **Endpoint**     | `https://ingest.<region>.signoz.cloud:443/v1/traces` |
    | **Encoding**     | Proto                                                |
    | **Header Key**   | `signoz-ingestion-key`                               |
    | **Header Value** | `<your-ingestion-key>`                               |

    <Frame>
      <img src="https://mintcdn.com/truefoundry/0QJep_0-RF6wltko/images/signoz-traces-exporter-config.png?fit=max&auto=format&n=0QJep_0-RF6wltko&q=85&s=a72ef11001f8270d65d5aac3e6f34d05" alt="TrueFoundry OTEL Traces Exporter Configuration showing HTTP endpoint pointing to SigNoz Cloud with signoz-ingestion-key header" width="1470" height="920" data-path="images/signoz-traces-exporter-config.png" />
    </Frame>

    4. Scroll down to enable the **Otel Metrics Exporter Configuration** toggle and fill in:

    | Field            | Value                                                 |
    | ---------------- | ----------------------------------------------------- |
    | **Toggle**       | Enabled                                               |
    | **Protocol**     | HTTP Configuration                                    |
    | **Endpoint**     | `https://ingest.<region>.signoz.cloud:443/v1/metrics` |
    | **Encoding**     | Proto                                                 |
    | **Header Key**   | `signoz-ingestion-key`                                |
    | **Header Value** | `<your-ingestion-key>`                                |

    5. Click **Save** to apply the configuration.

    <Note>
      Replace `<region>` with your actual SigNoz region (e.g. `in2`) and `<your-ingestion-key>` with the key copied from SigNoz Ingestion Settings.
    </Note>
  </Step>

  <Step title="Verify the Integration">
    1. Make a request through the TrueFoundry AI Gateway.
    2. Log into your SigNoz Cloud dashboard and navigate to the **Traces** section.
    3. Confirm traces from `tfy-llm-gateway` are appearing.

    <Frame>
      <img src="https://mintcdn.com/truefoundry/0QJep_0-RF6wltko/images/signoz-traces-page.png?fit=max&auto=format&n=0QJep_0-RF6wltko&q=85&s=d0a472441fbadfbece0c6b86c1871828" alt="SigNoz Traces page showing LLM call traces exported from TrueFoundry AI Gateway" width="2772" height="1548" data-path="images/signoz-traces-page.png" />
    </Frame>

    4. Navigate to the **Metrics** section and run a query to confirm gateway metrics are flowing in.

    <Frame>
      <img src="https://mintcdn.com/truefoundry/0QJep_0-RF6wltko/images/signoz-metrics-page.png?fit=max&auto=format&n=0QJep_0-RF6wltko&q=85&s=c6636e9d4407c442baf65f2f1b3dd4e5" alt="SigNoz Metrics page showing gateway metrics query results from TrueFoundry AI Gateway" width="2780" height="1556" data-path="images/signoz-metrics-page.png" />
    </Frame>
  </Step>
</Steps>

## Configuration Reference

| Configuration         | Value                                                 |
| --------------------- | ----------------------------------------------------- |
| **Traces Endpoint**   | `https://ingest.<region>.signoz.cloud:443/v1/traces`  |
| **Metrics Endpoint**  | `https://ingest.<region>.signoz.cloud:443/v1/metrics` |
| **Protocol**          | HTTP                                                  |
| **Encoding**          | Proto                                                 |
| **Auth Header Key**   | `signoz-ingestion-key`                                |
| **Auth Header Value** | Your SigNoz ingestion key                             |