traceroot.ai (yc s25) (@TracerootAI) header
traceroot.ai (yc s25) (@TracerootAI) profile picture

traceroot: the open-source platform that continuously improves your ai agents.

San Francisco
Joined July 2025
Photo by traceroot.ai (yc s25) (@TracerootAI)Photo by traceroot.ai (yc s25) (@TracerootAI)Photo by traceroot.ai (yc s25) (@TracerootAI)Photo by traceroot.ai (yc s25) (@TracerootAI)Photo by traceroot.ai (yc s25) (@TracerootAI)Photo by traceroot.ai (yc s25) (@TracerootAI)Photo by traceroot.ai (yc s25) (@TracerootAI)Photo by traceroot.ai (yc s25) (@TracerootAI)Photo by traceroot.ai (yc s25) (@TracerootAI)
The prompt in the first image is the part worth saving.
A few things from our post on catching a wrong revenue explanation with detectors. A detector can only judge what's in the trace. So after the agent answered, we recorded an audit span comparing each customer's plan in both months. The agent never sees it, and the prompt points the judge straight at it.
13
The code you're reading is rarely the code that ran.
I think the slow part of agent debugging starts once you know which run is wrong. The why lives in the code around the call, at a commit main has already moved past.
19
A wrong answer doesn't move a single metric.
I think most agent stacks can catch a slow run and can't catch a wrong one. A threshold knows when latency is over the limit. It has no idea when an explanation is wrong.
4
107
Worth saving: what a wrong answer looks like when every number adds up.
A few things from our post on tracing a silent failure in a LangGraph SQL agent. This is the report the agent read: four churned at -$796, four new at +$596, 61 unchanged, -$200 net. Every row checks out against the total.
1
57
traceroot.ai (yc s25) retweeted
Spent last Friday at @ycombinator's "accelerate your company with AI" day. Best room I've been in this year. Big takeaway: agents shouldn't be a tool you open. They should be teammates that keep working after you close the laptop. Great to meet @RagavSachdeva (Teaflask), @simulated_land (Asteroid), @itsmarinos (Prized), @rak3sh_m (Zarna), @jwonged (Hypotenuse AI) + Edward Tiong (Readily). Thanks @garrytan @koomen @t_blom for the talk on AI-maxxing your team! 🧵
2
2
16
488
How to follow an agent's answer back to the query and rows it came from.
58
A completed run and a correct answer are two separate checks.
I think the agent failures that cost the most finish with every span green. Nothing alerts, so the first person to notice is whoever acted on the wrong answer.
1
1
60
traceroot.ai (yc s25) retweeted
Great night at Kaiyō Rooftop tonight, thanks to @rhobusiness for hosting. Met so many great founders, including @desno365, @Khaliqgant, Tamish from @cocreate_so, and Alex from Gradient (accounting for startups). Sorry if I missed anyone! SF skyline views didn't hurt either.
1
1
10
376
The checkout incident span tree in this post is the quickest way to see what a traced pi run looks like!
We run @TracerootAI 's in-app agent and our detector investigations on pi. Those investigations used to land as one paragraph, so a wrong conclusion couldn't be retraced. Now each one is a trace you can open. Full write-up 👉 traceroot.ai/blog/tracing-pi…
2
80
A conclusion you can't retrace is hard to trust, whoever wrote it.
I think an agent that debugs other agents needs tracing more than most. If its investigation comes back as one paragraph and the conclusion is wrong, you can't see which step led it there.
66
traceroot.ai (yc s25) retweeted
Jev instrumentation in @TracerootAI , as promised 👀 `TraceRoot.initialize({ instrumentModules: { typeSafe } });` Each Jev call shows up as a decision span, with tokens, cost and probabilities. traceroot.ai/changelog/2026-…
2
1
3
205
How to set-up Jev as a judge in TraceRoot detectors? First, you'll need a project receiving agent traces. If you haven't set that up, follow the tracing quickstart or try an example agent. Quickstart 👉 traceroot.ai/docs/tracing/ge… Example agent 👉 github.com/traceroot-ai/trac…
5
2
6
169
Then, go to Detectors → + New Detector and choose a template, such as failures or hallucinations. Review its prompt, trigger conditions, and sampling setting, then select jev-1.13.0 under Detector Model. Click Create Detector and send new matching traces. You can also switch an existing detector to Jev in its settings.
1
32
Finally, open the runs table to see flagged traces tagged as tool errors, silent failures or ungrounded claims. → Open the Jev call to see its input questions, timing and the probabilities behind the decision. → Jump to the original trace and compare that call with what the model and tools did.
25
We went through 1,085 Reddit comments on debugging agents: 👉 313 comments discussed tracing and instrumentation; 👉 295 discussed evals and regression testing. The frustration lived in the gap between them. → finding the one bad run among thousands that look fine → tracing it back to the step that caused it, often upstream of where the error showed up Here's the full research 👇 traceroot.ai/blog/2026-10-06…
1
1
2
245
Your dashboard shows latency went up, but it can't tell you which step got slower or why. You can ask the TraceRoot agent in plain English, something like "look at the traces from the past three hours and suggest code changes to reduce latency." It reads those traces next to your code at the commit that ran them. Then it tells you which step is slow and what to change, along with the trace IDs and file paths it checked. Full walkthrough on a Vercel AI SDK example 👇 traceroot.ai/blog/2026-10-01…
2
1
68
Jev from TypeSafe AI is now a judge option on TraceRoot detectors. It tells you how likely a trace is to have a problem and which kind, with the probabilities behind each call. Setup walkthrough 👇 traceroot.ai/blog/2026-09-25…
1
1
2
127
Your agent reaches models through OpenRouter. Tracing it doesn't need a separate setup. Point the OpenAI-compatible client at OpenRouter's base URL, and TraceRoot's existing OpenAI instrumentation traces the calls. → no separate OpenRouter instrumentor to configure → Python or TypeScript, with working examples in the guide See more below 👇
1
3
121