Skip to content
System One

ekzhang/openjev-sglang

Prefill-only server that implements the TypeSafe Jev HTTP API on open models, running Qwen3.6-35B-A3B on SGLang. Deploys to Modal on a B200 with radix caching and breakable prefill CUDA graphs, scaling to zero after five idle minutes.

Open on GitHub

More like this

Keep browsing