Glossary
AI observability
Tracing, logging and scoring LLM and agent runs so you can see what happened and whether the answer was good.
AI observability is the practice of recording and analyzing what an LLM application or AI agent does on every run: the prompt, retrieved context, tool calls, model output, latency, cost and quality scores. It lets a team find why an answer was wrong, not only that a request failed. It extends general software observability with traces of model steps and evaluation of outputs.
Classic [observability](/glossary/observability) answers whether a service is up and fast. AI observability adds the question of whether the output was correct, grounded and safe. A request can return a 200 status and still be a wrong answer, so quality has to be measured, not just uptime.
In practice that means a trace for each run, with a span for each model call, retrieval step and tool call, plus automated checks and human review on samples. The traces then become the source of new test cases.
Start in 60 seconds
Put this to work on your project.
Get an AI-assisted, architect-reviewed scope, cost range, and timeline. Free, no login.