Fiddler Integration

​

What is Fiddler?

​

Key Features of Fiddler

1. Ultra-Low Latency: Delivers moderation in under 100 ms for seamless real-time user experiences
2. Built for Scale: Reliably processes over 5 million requests per day with enterprise-grade performance.
3. Optimized Efficiency: Task-specific Trust Models ensure high accuracy while minimizing compute costs.

​

Adding Fiddler Integration

• Name: Enter a name for your guardrails group.
• Collaborators: Add collaborators who will have access to this group.
• Fiddler Config:
  • Name: Enter a name for the Fiddler configuration.
  • Threshold (Optional): Enter a threshold value.
  • Guard Type: Select the type of guard from the available options:
    • Fiddler-Safety: Identifies harmful, sensitive, or jailbreaking content in the inputs of your generative application.
    • Fiddler-Response-Faithfulness: Detects hallucination by evaluating responses of your generative application for their factual consistency with source context.
• Auth Data
  • API Key: Enter your Fiddler API key in this field. You can get one from here.

​

Response Structure

  {
         "data": {
                "fdl_jailbreaking": 0.002,
                "fdl_illegal": 0.003,
                "fdl_hateful": 0.001,
                "fdl_harassing": 0.001,
                "fdl_racist": 0.001,
                "fdl_sexist": 0.001,
                "fdl_violent": 0.001,
                "fdl_sexual": 0.002,
                "fdl_harmful": 0.004,
                "fdl_unethical": 0.004
            }
  }

  {
     "data": {
                "fdl_faithful_score:": 0.002,
            }
  }

​

Validation Logic

• For Fiddler-Safety if any category scores is above threshold it means content violates the configured guardrails and request will be rejected.
• Category scores are evaluated against configured thresholds, with scores of 1 indicating policy violations in Fiddler-Safety.
• For Fiddler-Response-Faithfulness 1 means the response is faithful according to the context provided.
• Default threshold for "Fiddler-Safety" is 0.7 and "Fiddler-Response-Faithfulness" is 0.5.