maybern-tripp-smith/fedjev-bench

maybern-tripp-smith/fedjev-bench on GitHub

Stars: 0
Forks: 1
Language: Python
Last push: 21 Sep 2026

Read from GitHub on 24 Sep 2026. Counts change daily.

How it uses Jev

from typesafe_sdk import Choice

t0 = time.perf_counter()
response = client.system_one(
    model=model,
    state={"Text A": text_a, "Text B": text_b},
    questions={
        "winner": Choice(
            instructions=CHOICE_INSTRUCTIONS,
            criteria={"A": "Text A", "B": "Text B"},
        ),
    },
)
latency_ms = int((time.perf_counter() - t0) * 1000)
ans = response.answers["winner"]

View in score.py

Open on GitHub

PrimitivesChoice

Jev Ultrafast (Browser Use)

Browser Use's fast browser agent where Jev picks the operation and the DOM element in a single request; a small LLM is only invoked to write text when typing is required. Demoed on a Google Flights search.

browser-useOpen

19k starsFlight search 7.1 s

ProjectTyped tool dispatch+2

openjev

Attempt to run a Jev-style System One decision model locally on a single RTX 3090. Companion site at openjev.com. The repository was renamed to TheoLeeCJ/SemIf on GitHub, and the old openjev URL now redirects to it.

TheoLeeCJOpen

4.1k starsJSON vs direct 5.21x slowerPeak throughput 20.03 dec/s

Project

jev-trader

Makes one AI trade decision every Monad block on the Kuru MON-USDC market using Jev. The public deployment runs in dry-run mode with a mock model.

jarrodwattsOpen

2.2k starsLoop, mock model p50 100 msDecision window ~300 ms/block

ProjectConfidence-gated actions+1

jevlike

Open reimplementation that trains a small model to choose among a changing list of text options, emitting one probability per option in a single forward pass. Ships Doom, chess and Wikispeedia demos.

vinnylarouge1.3k starsOpen

Project

Ran Jev against an existing classifier eval that previously used Gemini 2.5 Flash Lite

Vercel CTO reports Jev saturated an existing classifier eval that had used Gemini 2.5 Flash Lite and ran about 6x faster. Original post; TypeSafe's quote-tweet is a separate item.

Malte Ubl (@cramforce)Open

220k viewsSpeed vs Gemini 6x faster

ProjectHierarchical classification+1

Agent Desktop

Rust desktop automation that reads apps through the OS accessibility tree instead of pixels. Its jev-desktop skill takes a plain-language goal and has Jev pick one operation and one target element per turn, so the 150-element tree never enters the agent's context.

lahfirOpen

1.6k starsToken reduction 78-96%

ProjectTyped tool dispatch+1

Menu

maybern-tripp-smith/fedjev-bench