sysone-bench

instax-dutta/sysone-bench on GitHub

Stars: 4
Forks: 1
Language: Python
License: MIT
Last push: 22 Sep 2026

Post on X

Views: 31
Likes: 0
Reposts: 0

Read from GitHub and X on 24 Sep 2026. Counts change daily.

How it uses Jev

"""Jev adapter: TypeSafe Decisions API. Needs TYPESAFE_API_KEY in env.

Endpoint shape per TypeSafe docs + OpenRouter decisions API:
  POST {base}/v1/systemone  (direct)  or  POST .../api/alpha/decisions (OpenRouter)
  body: {"model": <pinned id>, "state": {...}, "questions": {...}}
Jev answers already match the laya shape (choice/noul/score); this adapter only
normalizes field names. Pin a versioned id, never jev-latest, and record it.
"""
import copy
import os
import requests
from .base import BaseRunner

DIRECT_URL = "https://api.typesafe.ai/v1/systemone"

View in runners/jev_runner.py

Open on GitHub

View the post on X

PrimitivesChoice Score

Jev Ultrafast (Browser Use)

Browser Use's fast browser agent where Jev picks the operation and the DOM element in a single request; a small LLM is only invoked to write text when typing is required. Demoed on a Google Flights search.

browser-useOpen

19k starsFlight search 7.1 s

ProjectTyped tool dispatch+2

openjev

Attempt to run a Jev-style System One decision model locally on a single RTX 3090. Companion site at openjev.com. The repository was renamed to TheoLeeCJ/SemIf on GitHub, and the old openjev URL now redirects to it.

TheoLeeCJOpen

4.1k starsJSON vs direct 5.21x slowerPeak throughput 20.03 dec/s

Project

jev-trader

Makes one AI trade decision every Monad block on the Kuru MON-USDC market using Jev. The public deployment runs in dry-run mode with a mock model.

jarrodwattsOpen

2.2k starsLoop, mock model p50 100 msDecision window ~300 ms/block

ProjectConfidence-gated actions+1

jevlike

Open reimplementation that trains a small model to choose among a changing list of text options, emitting one probability per option in a single forward pass. Ships Doom, chess and Wikispeedia demos.

vinnylarouge1.3k starsOpen

Project

Ran Jev against an existing classifier eval that previously used Gemini 2.5 Flash Lite

Vercel CTO reports Jev saturated an existing classifier eval that had used Gemini 2.5 Flash Lite and ran about 6x faster. Original post; TypeSafe's quote-tweet is a separate item.

Malte Ubl (@cramforce)Open

220k viewsSpeed vs Gemini 6x faster

ProjectHierarchical classification+1

Agent Desktop

Rust desktop automation that reads apps through the OS accessibility tree instead of pixels. Its jev-desktop skill takes a plain-language goal and has Jev pick one operation and one target element per turn, so the 150-element tree never enters the agent's context.

lahfirOpen

1.6k starsToken reduction 78-96%

ProjectTyped tool dispatch+1

Menu