Gaurav-Gosain/jev-sec-bench on GitHub
- Stars
- 2
- Forks
- 0
- Language
- Go
- License
- MIT
- Last push
- 16 Sep 2026
Read from GitHub on . Counts change daily.
Use casesLLM guardrails
Gaurav-Gosain/jev-sec-bench
Two blind security benchmarks for Jev on public corpora: 662 labelled prompt-injection messages and 200 matched vulnerable-code pairs, run through jev-go with raw per-sample output committed. At a plain 0.50 cut the injection run reached 96.5% accuracy, ROC-AUC 0.9927 and p50 325 ms.
More like this
Introducing System One Models and Jev (Hacker News launch thread)
The 1,978-point, 513-comment launch thread. The top comment calls the speed comparison misleading, since Jev only returns structured output, and disputes the cannot-hallucinate claim because a valid type can still hold a wrong value. Others note ordinary LLMs can already be forced into structured output.
Outlines: structured outputs for LLMs
Guarantees valid structured output during generation by constraining decoding to a grammar or schema. The mechanism HN commenters repeatedly cited as already covering Jev's cannot-produce-a-type-error guarantee on ordinary LLMs. Star count is GitHub's rounded display figure.
jev-review
Staged code-review workflow with a local dashboard, where Jev judges code changes or a whole codebase.
Foreman
Places Jev as a fast supervisor above slower Codex coding agents. Codex workers do the engineering while Foreman independently assesses whether the work is complete, requirements are met, tests suffice, or human input is needed.
y0usaf/pi-jev
Extension making Jev the decision layer for the Pi coding agent: a measured tool-call gate plus a jev_ask tool. Judges whether an action is destructive, exfiltrates data or exceeds scope, then blocks or warns on calibrated thresholds.
144 starsGate latency ~300ms
pi-warden
Guardrails for the Pi agent built on pi-typesafe. Jev judges irreversible and off-task tool calls, detects stuck loops, checks unverified completion claims and flags low-quality output, steering the agent rather than interrupting the user.
DevMortimerOpenpi-warden on github.com138 starsHolds per 1000 calls 3
