Open-source models and libraries that solve part of the same problem: zero-shot classifiers, structured-output and constrained-decoding libraries, prompt-programming frameworks, and community attempts to reproduce the architecture from the launch post. None of them is a drop-in replacement, and the differences are exactly what the comparison is about.
23 alternatives
Showing 23 of 23
Declares typed input/output Signatures for LLM modules and optimizes the underlying prompts and weights against a metric. Its Signature abstraction is the closest widely-used open equivalent of Jev's typed-question interface. Star count is GitHub's rounded display figure.
Guarantees valid structured output during generation by constraining decoding to a grammar or schema. The mechanism HN commenters repeatedly cited as already covering Jev's cannot-produce-a-type-error guarantee on ordinary LLMs. Star count is GitHub's rounded display figure.
Pydantic-based library that extracts typed, validated structured data from LLMs across providers with automatic retries. The established way teams get Jev-style typed answers today, at LLM latency and cost. Star count is GitHub's rounded display figure.
Compact encoder model that takes the label set as input at inference time and extracts arbitrary entity types zero-shot on CPU. Same classifier-that-takes-its-categories-as-input shape, for extraction rather than decisions. Star count is GitHub's rounded display figure.
Fine-tunes Sentence Transformer embeddings plus a lightweight head for high-accuracy classification from a handful of labeled examples, with no prompting. The standard cheap alternative to an LLM classification call when the label set is fixed. Star count is GitHub's rounded display figure.
Modernized BERT encoder used as the backbone for fast fine-tuned classifiers and rerankers. The non-generative baseline Jev's cost and latency claims are usually measured against. Star count is GitHub's rounded display figure.
NeurIPS 2024 masked discrete diffusion language model that produces outputs in parallel rather than token by token. Cited in Jev coverage as the open non-autoregressive research line closest to Jev's parallel sampler.
A 0.6B replica that takes states and questions and returns complete probability distributions with zero output-token decoding. Ships with model weights, dataset and an end-to-end training pipeline, plus a side-by-side demo running Jev, NanoJev and untuned Qwen through Snake and a 50x50 maze.
Prefill-only server that implements the TypeSafe Jev HTTP API on open models, running Qwen3.6-35B-A3B on SGLang. Deploys to Modal on a B200 with radix caching and breakable prefill CUDA graphs, scaling to zero after five idle minutes.
Educational Jev-like visual inference on Apple Silicon: Qwen3.5-0.8B under MLX answers several questions about one image by reusing shared multimodal context and scoring candidates from logits. Ships a browser UI, CLI, HTTP API and sorting-factory, Breakout and camera-gesture demos.
Jev-style parallel constrained decisions for any MLX model on Apple Silicon. It takes a schema of booleans, enums and multi-selects, scores every allowed answer for every field in one forward pass, and assembles the JSON itself, so the output is valid by construction and every field carries a probability.
Unofficial study reproducing Jev-style parallel constrained decoding on stock 1.5B-8B models on an Apple Silicon laptop. Prefills context once, broadcasts the KV cache across one batch row per schema field and evaluates all fields in a single forward pass.
Independent reimplementation inspired by jevlike that scores pre-written options in one batched forward pass by log-probability over a local Gemma 3 4B, shipping an HTTP server, CLI and a TypeSafe System One API implementation.
Experimental inference harness for typed JSON decisions with DiffusionGemma: denoise freely, then pick the most likely allowed tokens from the final logits, with no training or fine-tuning. Reports results against Jev benchmarks, measured on an H100.
Open reproduction of the System One model class, fine-tuned from Qwen3.5-2B-Base, returning a probability distribution per typed question in a single forward pass. Serves TypeSafe's POST /v1/systemone wire format so TypeSafe SDKs work unchanged by repointing TYPESAFE_BASE_URL.
Jev-inspired parallel decisions for CUDA LLMs: independent typed fields are batched through vLLM over one shared context prefix, single-token labels are scored with the pretrained model's own head, and JSON is assembled in code. No retraining. Includes a browser Super Mario run at 71 ms mean inference per action.
Measures whether an untrained frozen Qwen3-4B can classify against a schema by reading next-token logits for option letters, compared against grammar-constrained JSON generation. Implements analogues of Choice and Noul only; explicitly not a reproduction.
An independent reproduction of Jev's decision layer on Qwen checkpoints, serving the same /v1/systemone request and response schema with choice, score and noul question types, plus an MMLU-Pro benchmark.
Research preview that takes context, questions and candidate answers and returns probability distributions, running on a frozen Qwen3-4B-Instruct-2507. README states it contains none of Jev's weights or RLCD implementation and claims no performance lead.
Typed, calibrated decisions from any open-weights model in one forward pass on your own GPU, through Hugging Face or vLLM, with no text generated. On RACE-H with Qwen3.6-27B, writing the passage once reached 92.9% accuracy at 4.55 questions per second against 2.00 for batching.
Experimental SwiftUI iPhone app that turns a small vision-language model into an on-device multiple-choice decision tool, reading the next-token logits for A, B, C instead of generating an answer. The displayed percentages are relative scores among the supplied choices, not calibrated probabilities.
HuggingFace Space demoing an RLCD-trained Qwen2.5-1B doing parallel constrained decoding, positioned as an open-source alternative to Jev.
MIT-licensed PPO model over BAAI/bge-m3 sequence embeddings that emits turn-by-turn conversion probabilities without generating text (arXiv 2503.23303). Its author claims on Hacker News it is the same non-autoregressive, schema-constrained architecture Jev later shipped, a year earlier.
Nothing matches those filters
Clear a filter to widen the search, or send us the thing you were looking for.