Skip to content

@Sumanth_077 on JevAgentHarness: Jev gates tool/arg/done calls; AgentDecision-4B cuts cost 81–89% in-loop.

Agents

Sumanth @Sumanth_077

EN

  • 4.7k views
  • 89 likes
  • 94 bookmarks
  • 15 reposts
Poster from Sumanth (@Sumanth_077)

About this case

Agent write-up with diagram. LLM agents make many small decisions between reasoning steps; JevAgentHarness routes them to a smaller decision model when confidence clears a trajectory-learned threshold, else falls back to the LLM. Standalone decision accuracy was not enough (best isolated model only 69.5% full-task success; naive delegation −19 pts). Training AgentDecision-4B on states after mistakes cut cost 81.1–89% and sped runs up to 2.5× without losing ≥3 pts success; on shifted tasks it beat Jev (91.5% vs 82%). Harness, benchmark, data, and models are open source. For agent builders putting decision models inside the loop.

Original posthttps://x.com/Sumanth_077/status/2114309785407652201

Related cases