@h_nilforoshan benchmarked the OpenAI Decisions API against Jev for HiringCafe.com: relevance of a query or resume to a job, scored 1-10. The post says OpenAI costs 2x more and is 5-10% worse.
- 64.2k views
- 202 likes
- 139 bookmarks
- 12 reposts
I benchmarked "Jev-killer" OpenAI Decisions API against Jev for https://HiringCafe.com, serving 2.5 million users. The task is to predict how relevant a user qu…
About this case
Benchmark. The post says they benchmarked the "Jev-killer" OpenAI Decisions API against Jev for https://HiringCafe.com, serving 2.5 million users. The task is to predict how relevant a user query or resume is to a job description, on a scale of 1-10. It says OpenAI is 2x more expensive and 5-10% worse, and it marks the post as a thread. It quotes an OpenAI Developers post that the Decisions API is in public beta and makes decisions up to 10x faster than GPT-6 Luna through the Responses API. No attached photo or video. Verified via fxtwitter. This entry uses only that post, not later replies in the thread.
Original posthttps://x.com/h_nilforoshan/status/2107643820150308932