Skip to content

@sardine says Jev caught 27 of 29 fraudulent transactions in a September fraud ring, the most of any approach they tested, and that Jev is now a node in Sardine Flow.

Benchmarks

Sardine @sardine

EN

  • 297 views
  • 6 likes
  • 1 bookmarks
  • 1 reposts
We ran Jev, TypeSafe AI's new System One model, on a fraud ring that hit one of our customers in September. Jev caught 27 of the ring's 29 fraudulent transactio…

About this case

Benchmark post. Sardine says they ran Jev, TypeSafe AI's System One model, on a fraud ring that hit a customer in September. Jev caught 27 of 29 fraudulent transactions, the most of any approach tested. Their Data Analyst Agent's rules, built from the ring's behavior such as four cards per account, would have caught 26 of 29. Jev needed one broad question about each transaction's fraud-ring risk. Every method used the same account links and velocity counts, which their code computed first. They say Jev turned that evidence into a decision faster, cheaper, and more consistently, answering in about 100 milliseconds for a fraction of a cent. On consistency it beat Claude Sonnet 5: for one account's 12 transactions in about 100 minutes, Jev scored all 12 high risk, while Sonnet mixed medium and high. They also added Jev as a node in Sardine Flow. The post links a Sardine blog and a November 4 fireside registration, and attaches one photo.

Original posthttps://x.com/sardine/status/2117722757584568805

Related cases