nemo-relay-export-atif-trajectories

द्वारा nvidia

Export NeMo Relay activity as ATIF trajectories for replay, analysis, or interchange

npx skills add https://github.com/nvidia/nemo-relay --skill nemo-relay-export-atif-trajectories

Export ATIF Trajectories

Use this skill when the user wants execution traces as ATIF documents rather than live OTLP spans.

Default Path

  • Create an AtifExporter with session and agent metadata
  • Register it before the instrumented work
  • Run scoped tool and LLM activity
  • Call export() or export_json()
  • Clear between runs and deregister when done

Embedded ATIF Semantics

  • ATIF export translates NeMo Relay events into ATIF v1.7 trajectory data.
  • LLM start events become user steps; message content is extracted from the LLMRequest.content payload when possible.
  • LLM end events become agent steps with response content, model metadata, token metrics, reasoning fields, and promoted tool_calls when the response uses a supported tool-call shape.
  • Tool start events are skipped in the trajectory because tool calls are promoted from the preceding LLM end response.
  • Tool end events become system observations. Observations are correlated to promoted tool calls by function name and source call ID when available.
  • Mark events with data become system steps. Scope start/end events are structural and are not emitted as trajectory steps.
  • Scope nesting becomes ancestry metadata on exported steps.
  • Nested agent scopes become embedded subagent_trajectories with subagent_trajectory_ref observations in the parent trajectory.
  • Event payloads become step input, step output, tool-call content, or observation content.
  • The exporter preserves collected event order and uses lifecycle pairing to reconstruct the trajectory.
  • Exporting does not clear the buffer. Use one exporter per run or call clear() between runs when concurrent agents share a process.
  • Before using a trajectory in evaluation, confirm schema_version is ATIF-v1.7, agent metadata is correct, expected LLM/tool steps are present, tool observations follow tool calls, and sensitive fields are absent.

Important Semantics

  • ATIF exports the full event buffer collected so far.
  • Consecutive tool observations can be merged into one system observation step.
  • Trajectories reflect sanitized event payloads, not raw secrets that sanitize guardrails removed before event emission.
  • Response codecs can improve LLM end annotations, but they do not change the caller-visible LLM response.

Checklist

  • Session and agent metadata chosen
  • Exporter registered before the relevant run
  • Scope boundaries are correct so ancestry is meaningful
  • Export timing is clear: whole buffer vs clear-between-runs
  • LLM responses include tool_calls if ATIF tool-call entries are expected

Related Skills

  • nemo-relay-setup-observability
  • nemo-relay-instrument-calls
  • nemo-relay-debug-runtime-integration

nvidia की और Skills

compileiq-debug
nvidia
Use when something is wrong: Search() hangs, all evaluations return INVALID_SCORE, scores aren't improving, every config returns the same number, ptxas errors…
official
create-github-pr
nvidia
Create GitHub pull requests using the gh CLI. Use when the user wants to create a new PR, submit code for review, or open a pull request. Trigger keywords -…
official
diagnose-perf
nvidia
First-responder performance triage for Isaac Sim and Isaac Lab. Identifies bottleneck category (GPU-bound, CPU-bound, VRAM, loading) using nvidia-smi and…
official
eagle3-review-logs
nvidia
Review EAGLE3 pipeline experiment logs from the launcher's experiments/ directory. Summarizes pass/fail status for all 4 tasks, diagnoses failures with root…
official
nemoclaw-maintainer-cross-issue-sweep
nvidia
Scans other open issues to find ones a given PR may also fix or accidentally break. Outputs adjacent-fix opportunities and contradiction risks with file:line…
official
karpathy-guidelines
nvidia
सामान्य LLM कोडिंग गलतियों को कम करने के लिए व्यवहार संबंधी दिशानिर्देश। कोड लिखते, समीक्षा करते या रिफैक्टर करते समय उपयोग करें ताकि अत्यधिक जटिलता से बचा जा सके, सर्जिकल बदलाव किए जा सकें,…
official
fhir-basics
nvidia
Teaches agents how FHIR R4 APIs work, what resources are available, how to query them with search parameters, and how to correctly parse all response formats…
official
underdeclared-agent
nvidia
A helpful assistant agent
official