llm-obs-eval-bootstrap
by datadog-labs
Bootstrap evaluators from production traces — by default propose online LLM-judge evaluators and, after you confirm, create them in Datadog as disabled drafts…
npx skills add https://github.com/datadog-labs/agent-skills --skill llm-obs-eval-bootstrapMore skills from datadog-labs
dd-audit
datadog-labs
Audit Trail investigations - who changed what, key compromise, cost spike root cause, compliance evidence (SOC 2/PCI), and AI activity auditing.
official
dd-apm
datadog-labs
APM - traces, services, dependencies, performance analysis.
official
agent-observability-eval-bootstrap
datadog-labs
Bootstrap evaluators from production traces — by default propose online LLM-judge evaluators and, after you confirm, create them in Datadog as disabled drafts…
official
onboarding-summary
datadog-labs
Generate a live Single Step Instrumentation (SSI) onboarding confirmation report — verifies APM instrumentation is working end-to-end with deep links into the…
official
experiment-analyzer
datadog-labs
Analyze LLM experiment results. Handles single or comparative experiments, exploratory or Q&A modes. Use when user says "analyze experiment", "compare…
official
agent-install
datadog-labs
agent-install — an installable skill for AI agents, published by datadog-labs/agent-skills.
official
enable-ssi
datadog-labs
Enable Single Step Instrumentation (SSI) on Kubernetes — automatically instruments applications for APM without code changes. Only use if the Datadog Agent is…
official
agent-observability-eval-pipeline
datadog-labs
End-to-end Agent Observability pipeline for an instrumented ml_app — classify production traces, root-cause failures, bootstrap evaluators, then (optionally)…
official