Describe what Arize Phoenix is and where it diverges from Arize AX
Phoenix is the OSS, self-hostable, OTel-native (OpenInference) tracing and eval tool with strong RAG focus. AX is the hosted enterprise platform with production-scale storage, ML monitoring, SLAs, and team features.
Imagine a bicycle shop that sells two things from the same showroom. The first is a fully assembled bike you take home for free, tune in your garage, and ride wherever you like. The second is a premium membership. The shop stores your bike, services it on a schedule, and lets your whole family share it. It also gives your business a contract with a phone number to call. Phoenix is the free bike. You download it, run it on your laptop or in a small container at work, and use all the core features without paying. Arize AX is the membership. It is the same bike, but the company keeps and looks after it at scale, with longer history, more riders, support guarantees, and extra perks for bigger teams. Phoenix is what you start with. AX is where you go when the family gets larger.
Concept explanation~2 min read
Everything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example. Click to expand.
Concept explanation~2 min read
Everything you need to truly understand this topic: intuition, mechanics, step by step explanation, code, formulas, and worked example. Click to expand.
Arize is one of three companies that defined the LLM-observability category between 2023 and 2025 (alongside Langfuse and the LangChain-LangSmith pair). Its two-product structure reflects a deliberate go to market choice that affects how teams adopt the platform.
Phoenix: the open-source starting point
Phoenix is an Elastic License 2.0 (ELv2) Python package and Docker image that runs locally or in your infrastructure. It is OTel-native (accepts OTLP/HTTP spans) and supports two semantic conventions: OpenInference (Arize-led) and OTel gen_ai semconv (OTel-blessed).
Core capabilities
- LLM tracing. Visualize the call tree of any LLM application: agent steps, tool calls, model calls, retrieval calls. Drill into spans to see attributes, inputs, outputs.
- RAG-specific views. A per-query retrieval panel shows the top-k chunks, their similarity scores, content previews, and corpus version. This is the view Phoenix is best-known for.
- LLM-as-judge evals. Built-in evaluators (hallucination, retrieval relevance, toxicity) plus a framework for custom judges, runnable against datasets defined in Phoenix.
- Datasets and experiments. Define labeled test sets in Phoenix, run them through different prompts or models, compare results.
How teams typically run it
Local development: pip install, launch_app in a notebook. Self-hosted staging: Docker container with a Postgres backend, accessible to the dev team. Production self-hosting: container in Kubernetes, OTel Collector routing spans to it. Phoenix can comfortably handle tens of millions of traces per month on modest hardware.
Situations where this technique stops working.
2–4 min · Everything important, quickly.
| Capability | Phoenix (OSS) | Arize AX (hosted) |
|---|---|---|
| License and deployment | ELv2, self-host | Commercial, hosted |
| LLM tracing and RAG views | Yes (full) | Yes (full) |
| OpenInference and OTLP ingest | Yes | Yes |
| LLM-as-judge evals | Yes | Yes |
| Non-LLM ML monitoring | No | Yes |
| Retention | Limited by your storage | Months to years |
| Team RBAC and audit logs | Minimal | Yes |
| SLA and enterprise support | No | Yes |
Real products, models, and research that use this idea.
- Arize Phoenix is distributed via pip (arize-phoenix) and a Docker image. Teams run it on laptops, in dev clusters, and in production for medium volumes.
- OpenInference, originally Arize-led, is now broadly supported across Phoenix, AX, Langfuse, Datadog LLM Observability, and OTel itself.
What an interviewer would ask next. Try answering before peeking at the approach.
QWhen does a team outgrow Phoenix and need AX?
Three triggers: trace volume above what self-hosting comfortably handles (rough threshold: tens of millions per month, depending on hardware); retention requirements exceeding a few months; compliance or team requirements (SOC 2, RBAC, audit logs).
Red flags & common mistakes
The phrases that signal junior thinking. Click to expand.
Red flags & common mistakes
The phrases that signal junior thinking. Click to expand.
Treating Phoenix and Arize AX as competitors. They are tiers in the same product family with the same data model and different deployment and scale targets.
60 second bullets to scan on the way to the call.
How would you describe Phoenix's licensing and deployment model in one line?
Which RAG-specific features make Phoenix differentiated?
Primary sources. Browse if you want the original framing.
Same topic, related formats. Practice these next.