Reproducible calibration and selective-risk benchmarks for Jev decisions inside DSPy workflows. Runs offline for confidence gating, latency and cost modelling without live API calls.
Read from GitHub on . Counts change daily.
for case in cases:
request = case["request"]
questions = {name: builder(question) for name, question in request["questions"].items()}
recorder.system_one(
request["document"],
questions,
model=case["model"],
)
return recorderView in src/jev_dspy_lab/live.py
Makes one AI trade decision every Monad block on the Kuru MON-USDC market using Jev. The public deployment runs in dry-run mode with a mock model.
jarrodwattsOpenjev-trader on github.com2.2k starsLoop, mock model p50 100 msDecision window ~300 ms/block
MCP server that gives Claude Code, Codex, Amp, OpenCode and other agents ten Jev judgment tools, each returning typed probabilities they can branch on. The author calls it early software.
320 starsPer call 150-500 ms
Declares typed input/output Signatures for LLM modules and optimizes the underlying prompts and weights against a metric. Its Signature abstraction is the closest widely-used open equivalent of Jev's typed-question interface. Star count is GitHub's rounded display figure.
Python library from Nokia researchers that reads typed Choice, Noul and Score answers with probabilities from an open LLM's logits or hidden states, without fine-tuning. Its zero-label level reduces option-order bias, and a head fit on 100 to 300 labels can run behind vLLM.
Places Jev as a fast supervisor above slower Codex coding agents. Codex workers do the engineering while Foreman independently assesses whether the work is complete, requirements are met, tests suffice, or human input is needed.
A TypeScript classifier that sends each PDF page's text to Jev as a choice over 261 IRS forms and 7 page kinds, with a second call only for five corporate forms and their schedules. Its eval reports 0 wrong pages on 314 filled TaxCalcBench forms at about $0.001 per page, 34x cheaper and 6x faster than the Sonnet pipeline it replaced.
Nakshatra Saxena (@nedwize)Openkyotofin/tax-doc-classifier on github.com419 starsCost per page $0.001vs prior setup 34x cheaper
