Arize AI

Arize AX is an evaluation and observability platform developed by Arize AI; it offers tools for agent tracing, evals, prompt optimization, and more.

Step 1: Get your Arize credentials

In Arize, navigate to your space settings to find your API key and space key:

1. Log in to your Arize account
2. Go to Space Settings to find your Space Key
3. Go to API Keys to create or copy your API key
4. Note the Model ID you want to use for organizing traces

Step 2: Enable Broadcast in OpenRouter

Go to Settings > Observability and toggle Enable Broadcast.

Step 3: Configure Arize AI

Click the edit icon next to Arize AI and enter:

• Api Key: Your Arize API key
• Space Key: Your Arize space key
• Model Id: The model identifier for organizing your traces in Arize
• Base Url (optional): Default is https://otlp.arize.com

Step 4: Test and save

Click Test Connection to verify the setup. The configuration only saves if the test passes.

Step 5: Send a test trace

Make an API request through OpenRouter and view the trace in your Arize dashboard under the specified model.

Custom Metadata

Arize uses the OpenInference semantic convention for tracing. Custom metadata from the trace field is sent as span attributes in the OTLP payload.

Supported Metadata Keys

Example

1
{
2
  "model": "openai/gpt-4o",
3
  "messages": [{ "role": "user", "content": "Classify this text..." }],
4
  "user": "user_12345",
5
  "session_id": "session_abc",
6
  "trace": {
7
    "trace_id": "classification_pipeline_001",
8
    "trace_name": "Text Classification",
9
    "generation_name": "Classify Sentiment",
10
    "dataset": "customer_feedback",
11
    "experiment_id": "exp_v3"
12
  }
13
}

Additional Context

• Custom metadata keys from trace are included as span attributes under the metadata.* namespace
• The user field maps to user identification in span attributes
• The session_id field maps to session tracking in span attributes
• Token usage, costs, and model parameters are automatically included as OpenInference-compatible attributes

Privacy Mode

When Privacy Mode is enabled for this destination, prompt and completion content is excluded from traces. All other trace data — token usage, costs, timing, model information, and custom metadata — is still sent normally. See Privacy Mode for details.