
TheoLeeCJ/SemIf-OpenJev on GitHub
- Stars
- 4,142
- Forks
- 277
- Language
- Python
- License
- MIT
- Last push
- 23 Sep 2026
Read from GitHub on . Counts change daily.
Reported by the author
- JSON vs direct
- 5.21x slower
completing the array took 5.21× as long as direct readout
github.com - Peak throughput
- 20.03 dec/s
Parallel suffixes | **20.03** | **38.8 s**
github.com
SemIf, formerly called OpenJev, is an independent attempt to reproduce Jev’s interface on hardware anyone can own: a single RTX 3090 running a frozen Qwen3.5-4B model. It is not affiliated with TypeSafe and does not reproduce Jev’s own model or training; it copies the input and output shape, unstructured state plus runtime-defined criteria and typed options in, a probability per option out.
The project reads option probabilities directly from the model in one forward pass, skipping the answer sentence and JSON parsing a chat model would need. Benchmarked against the same model generating a compact JSON array of yes and no answers, direct readout took 1.023 seconds against 5.332 seconds for the generated array on 21 binary criteria, a gap the author frames as a systems comparison rather than a claim that the two readouts are semantically equivalent: the two methods agreed on 18 of 21 decisions. On a 37-state, 21-criterion workload, reusing a prefilled state pushed throughput from 2.33 decisions per second with fresh scoring to 20.03 decisions per second with parallel suffixes.
The repo ships an MLX backend for Apple Silicon, a llama.cpp path for CPU-only runs, and a browser demo that needs no waitlist. Recent commits added PyTorch and MPS scoring and per-workload temperature calibration.


