JevBench by Benchmark Heaven: Jev-class decision model leaderboard

[AINews] Jev: a System One Model that only decides/classifies/routes/scores

AI News daily roundup leading with the Jev launch, summarising RLCD and TypeSafe's 20-200x speed and 40-400x cost claims. Its recap of reactions notes posters using Jev as a structured classifier, judge and routing policy where text generation is unnecessary.

Jev means structured output is interesting again

Argues Jev's speed comes mainly from constrained single-token generation and aggressive prefill, techniques reproducible with existing LLMs, rather than a new architecture. Still treats very fast structured output as a new primitive, while doubting Jev matches frontier models on raw intelligence.

Zaious/jev-capability-atlas

An independent, evidence-based map of where Jev's calibrated-decision claim holds up and where it breaks down, built from real API-call receipts rather than a leaderboard.

Zaious26 starsOpenZaious/jev-capability-atlas on github.com

willkelly/jev-evaluation

An adversarial evaluation of Jev with nine experiments and 28 predictions fixed before any data was collected. One run covered 123,805 requests over 138 minutes for $12.69, with five failures, plus a 13-rule prompting guide.

willkellyOpenwillkelly/jev-evaluation on github.com

WindTunnel: the WebMCP benchmark

A 49-task, 8-site browser-agent benchmark. Jev paired with a small model for argument generation solved 100% of tasks at far lower cost than screenshot-based computer use, and adding WebMCP tool exposure roughly doubled Jev's own solve rate from 25 to 49 tasks.

idan levin (@0xidanlevin)OpenWindTunnel: the WebMCP benchmark on webmcp.com

239k viewsSolve rate 25/49 to 49/49Cost vs Astra 112x lower

lurk by AnyAPI

Find Reddit buyer intent and see what every lead's data cost.

Kevin Wang (@mxfp4)Openlurk by AnyAPI on lurk.so

84k viewsThreads scanned 4,000