Skip to content

@h_nilforoshan benchmarked the OpenAI Decisions API against Jev for HiringCafe.com: relevance of a query or resume to a job, scored 1-10. The post says OpenAI costs 2x more and is 5-10% worse.

Benchmarks

Hamed Nilforoshan @h_nilforoshan

EN

  • 64.2k views
  • 202 likes
  • 139 bookmarks
  • 12 reposts
I benchmarked "Jev-killer" OpenAI Decisions API against Jev for https://HiringCafe.com, serving 2.5 million users. The task is to predict how relevant a user qu…

About this case

Benchmark. The post says they benchmarked the "Jev-killer" OpenAI Decisions API against Jev for https://HiringCafe.com, serving 2.5 million users. The task is to predict how relevant a user query or resume is to a job description, on a scale of 1-10. It says OpenAI is 2x more expensive and 5-10% worse, and it marks the post as a thread. It quotes an OpenAI Developers post that the Decisions API is in public beta and makes decisions up to 10x faster than GPT-6 Luna through the Responses API. No attached photo or video. Verified via fxtwitter. This entry uses only that post, not later replies in the thread.

Original posthttps://x.com/h_nilforoshan/status/2107643820150308932

Related cases