jourdanlabs/assay-001

Pre-registered independent check of Jev's calibration and type-safety claims, with the protocol frozen and hashed before the first call. On CLINC150 the chosen-option probabilities were calibrated (ECE 0.0204), on Banking77 they were not (ECE 0.0936, systematically overconfident), and across 8,576 responses there were zero type errors.

jourdanlabs/assay-001 on GitHub

Stars: 0
Forks: 0
Language: Python
Last push: 21 Sep 2026

Read from GitHub on 24 Sep 2026. Counts change daily.

How it uses Jev

import pandas as pd

ROOT = Path(__file__).resolve().parent.parent
API = "https://api.typesafe.ai/v1/systemone"
MODEL = "jev-latest"

INSTRUCTIONS = {
    "banking77": "Which banking intent does this customer message express? Choose exactly one.",
    "clinc150": "Which intent does this user request express? Choose exactly one. Choose oos if it matches none of the others.",
}

def load_key():
    k = os.environ.get("TYPESAFE_API_KEY")
    p = Path.home() / ".config" / "typesafe" / "api_key"
    if not k and p.exists():

View in harness/run.py

Open on GitHub

PrimitivesChoice

Jev Ultrafast (Browser Use)

Browser Use's fast browser agent where Jev picks the operation and the DOM element in a single request; a small LLM is only invoked to write text when typing is required. Demoed on a Google Flights search.

browser-useOpen

19k starsFlight search 7.1 s

ProjectTyped tool dispatch+2

openjev

Attempt to run a Jev-style System One decision model locally on a single RTX 3090. Companion site at openjev.com. The repository was renamed to TheoLeeCJ/SemIf on GitHub, and the old openjev URL now redirects to it.

TheoLeeCJOpen

4.1k starsJSON vs direct 5.21x slowerPeak throughput 20.03 dec/s

Project

jev-trader

Makes one AI trade decision every Monad block on the Kuru MON-USDC market using Jev. The public deployment runs in dry-run mode with a mock model.

jarrodwattsOpen

2.2k starsLoop, mock model p50 100 msDecision window ~300 ms/block

ProjectConfidence-gated actions+1

jevlike

Open reimplementation that trains a small model to choose among a changing list of text options, emitting one probability per option in a single forward pass. Ships Doom, chess and Wikispeedia demos.

vinnylarouge1.3k starsOpen

Project

Ran Jev against an existing classifier eval that previously used Gemini 2.5 Flash Lite

Vercel CTO reports Jev saturated an existing classifier eval that had used Gemini 2.5 Flash Lite and ran about 6x faster. Original post; TypeSafe's quote-tweet is a separate item.

Malte Ubl (@cramforce)Open

220k viewsSpeed vs Gemini 6x faster

ProjectHierarchical classification+1

Agent Desktop

Rust desktop automation that reads apps through the OS accessibility tree instead of pixels. Its jev-desktop skill takes a plain-language goal and has Jev pick one operation and one target element per turn, so the 150-element tree never enters the agent's context.

lahfirOpen

1.6k starsToken reduction 78-96%

ProjectTyped tool dispatch+1

Menu

jourdanlabs/assay-001