Skip to content
System One

jev-on-a-laptop

Unofficial study reproducing Jev-style parallel constrained decoding on stock 1.5B-8B models on an Apple Silicon laptop. Prefills context once, broadcasts the KV cache across one batch row per schema field and evaluates all fields in a single forward pass.

Open on GitHub

PrimitivesChoice

More like this

Use cases this is tagged with