AI Elo Ranker

opaielsheikh/ai-elo-ranker on GitHub

Stars: 5
Forks: 2
Language: Python
Last push: 17 Sep 2026

Read from GitHub on 24 Sep 2026. Counts change daily.

How it uses Jev

for attempt in range(retries):
    try:
        response = await self.client.system_one(
            state=state_prompt,
            questions=questions,
            model=self.model,
            timeout=15.0
        )
        latency_ms = (time.perf_counter() - start_time) * 1000.0

        winner_ans = response.choices.get("winner")
        reason_ans = response.choices.get("reason")

        raw_choice = winner_ans.choice if winner_ans else "A"
        confidence = float(winner_ans.confidence) if winner_ans else 0.5

View in elo_ranker/judge.py

Open on GitHub

PrimitivesChoice Score

Use casesSemantic reranking Composite scoring

jev-trader

Makes one AI trade decision every Monad block on the Kuru MON-USDC market using Jev. The public deployment runs in dry-run mode with a mock model.

jarrodwattsOpen

2.2k starsLoop, mock model p50 100 msDecision window ~300 ms/block

ProjectConfidence-gated actions+1

[AINews] Jev: a System One Model that only decides/classifies/routes/scores

AI News daily roundup leading with the Jev launch, summarising RLCD and TypeSafe's 20-200x speed and 40-400x cost claims. Its recap of reactions notes posters using Jev as a structured classifier, judge and routing policy where text generation is unnecessary.

Latent.Space (AI News)Open

ArticleIntent and model routing+1

Introducing System One Models and Jev (Hacker News launch thread)

The 1,978-point, 513-comment launch thread. The top comment calls the speed comparison misleading, since Jev only returns structured output, and disputes the cannot-hallucinate claim because a valid type can still hold a wrong value. Others note ordinary LLMs can already be forced into structured output.

albelfioOpen

DiscussionIntent and model routing+3

DSPy: programming, not prompting, language models

Declares typed input/output Signatures for LLM modules and optimizes the underlying prompts and weights against a metric. Its Signature abstraction is the closest widely-used open equivalent of Jev's typed-question interface. Star count is GitHub's rounded display figure.

stanfordnlp38k starsOpen

AlternativeStructured extraction+3

ModernBERT

Modernized BERT encoder used as the backbone for fast fine-tuned classifiers and rerankers. The non-generative baseline Jev's cost and latency claims are usually measured against. Star count is GitHub's rounded display figure.

AnswerDotAI1.7k starsOpen

AlternativeSupport inbox triage+3

newsjack

Open source skills that read a morning's news feed with Jev and tell a list of brands which stories to act on. In a demo run it read 384 headlines and matched them to 15 brands in 24.9 seconds for $0.19, against 4 of 384 for $0.77 on Claude Opus 5 over the same feed.

Elvis (@elvissun)Open

851 starsCost $0.19vs Opus/headline ~390x cheaper

ProjectComposite scoring

Menu