@skalskip92 says he started building a benchmark for vision decision models, expecting to trade accuracy for speed. On his numbers, GPT-6.1 Terra (high) was 96/100 correct at 7.98 s average per image, and TypeSafe AI Jev 1.14 was 89/100 correct at 9.64 s average per image. He asks why decision models are so slow.
- 9.9k views
- 141 likes
- 51 bookmarks
- 1 reposts
started building a benchmark for vision decision models was expecting to trade accuracy for speed... meanwhile... - GPT-6.1 Terra (high): 96/100 correct, 7.98s…
About this case
Benchmark. SkalskiP (@skalskip92) posts text only. No link.
Original posthttps://x.com/skalskip92/status/2122735955593617590