Skip to content

@ValsAI says they independently tested TypeSafe's Jev against 11 other models. On 400 claim-verification questions it matched GPT-6 Astra's 97.5% accuracy at about 1/500th the cost.

Benchmarks

Vals AI @ValsAI

EN

  • 23.1k views
  • 248 likes
  • 78 bookmarks
  • 18 reposts
Poster from Vals AI (@ValsAI)

About this case

Benchmark. The post asks whether a model that does not generate text can compete with frontier LLMs. It says Vals independently tested TypeSafe's Jev against 11 other models, and that on 400 claim-verification questions it matched GPT-6 Astra's 97.5% accuracy at about 1/500th the cost. It includes a photo. The text does not name a separate audience or include a report link. Verified via fxtwitter.

Original posthttps://x.com/ValsAI/status/2107559370208997711

Related cases