Experiments

This product is not supported for your selected Datadog site. ().
Join the Preview!

LLM Observability Experiments is in Preview.

Request Access

LLM Observability Experiments supports the entire lifecycle of building LLM applications and agents. It helps you understand how changes to prompts, models, providers, or system architecture affect performance. With this feature, you can:

  • Create and version datasets
  • Run and manage experiments
  • Compare results to evaluate impact
The Experiment view in LLM Observability comparing 12 experiments across 9 fields. The line graph visualization charts the accuracy, correctness, duration, estimated cost, and other metrics of various experiments.