Measures what a Jev classifier's confidence score is actually worth against real outcomes, and sets the threshold for handing a decision to a human based on what a mistake costs.
Read from GitHub on . Counts change daily.
ENV_FLAG = "JEVAL_COLLECT"
ENV_ROOT = "JEVAL_ROOT"
ENV_MODEL = "JEVAL_MODEL"
_OFF = frozenset({"0", "off", "false", "no"})
_ON = frozenset({"1", "on", "true", "yes"})
_TRACKED_ATTR = "_jeval_tracked"Makes one AI trade decision every Monad block on the Kuru MON-USDC market using Jev. The public deployment runs in dry-run mode with a mock model.
jarrodwattsOpenjev-trader on github.com2.2k starsLoop, mock model p50 100 msDecision window ~300 ms/block
MCP server that gives Claude Code, Codex, Amp, OpenCode and other agents ten Jev judgment tools, each returning typed probabilities they can branch on. The author calls it early software.
320 starsPer call 150-500 ms
Python library from Nokia researchers that reads typed Choice, Noul and Score answers with probabilities from an open LLM's logits or hidden states, without fine-tuning. Its zero-label level reduces option-order bias, and a head fit on 100 to 300 labels can run behind vLLM.
Places Jev as a fast supervisor above slower Codex coding agents. Codex workers do the engineering while Foreman independently assesses whether the work is complete, requirements are met, tests suffice, or human input is needed.
A TypeScript classifier that sends each PDF page's text to Jev as a choice over 261 IRS forms and 7 page kinds, with a second call only for five corporate forms and their schedules. Its eval reports 0 wrong pages on 314 filled TaxCalcBench forms at about $0.001 per page, 34x cheaper and 6x faster than the Sonnet pipeline it replaced.
Nakshatra Saxena (@nedwize)Openkyotofin/tax-doc-classifier on github.com419 starsCost per page $0.001vs prior setup 34x cheaper
Open reproduction of the System One model class, fine-tuned from Qwen3.5-2B-Base, returning a probability distribution per typed question in a single forward pass. Serves TypeSafe's POST /v1/systemone wire format so TypeSafe SDKs work unchanged by repointing TYPESAFE_BASE_URL.
