Skip to content
System One

Jev vs GPT: OpenAI against a decision model

Jev returns a Choice, Score or Noul with a probability and generates no text, at $0.042 per million input tokens with output free. OpenAI's GPT-5.6 and GPT-6 models write, call tools and read up to 1.05M tokens, at $0.20 to $10.00 per million input. Jev is cheaper and faster on bounded decisions and cannot do the rest.

Updated

The short answer

OpenAI’s GPT models generate text and call tools. Jev picks one option from a set you define, attaches a probability to it and writes nothing. On a bounded classification call Jev is cheaper and faster by a wide margin. On anything that has to produce language, GPT is the only one of the two that can do the job.

Most GPT calls inside an application are routing decisions or triage labels, and those are the ones that can move.

Jev vs GPT at a glance

Model Input $/M Output $/M Context Output type Confidence Generates text Latency for a short classification
Jev 1.13 $0.042 Free 64k, 32k for state plus longest question Choice, Score or Noul Probability per option plus a confidence value No 70ms to 500ms, TypeSafe’s own figure
GPT-5.6 Luna $0.20 $1.20 1.05M, 128K max output Text, or JSON validated against your schema logprobs and top_logprobs per output token Yes Not published by OpenAI
GPT-5.6 Terra $2.00 $12.00 1.05M, 128K max output Text, or JSON validated against your schema Same Yes Not published by OpenAI
GPT-5.6 Sol $4.00 $20.00 1.05M, 128K max output Text, or JSON validated against your schema Same Yes Not published by OpenAI
GPT-6 Astra $10.00 $50.00 1.05M, 128K max output Text, or JSON validated against your schema Same Yes Not published by OpenAI

OpenAI prices and specs come from developers.openai.com, checked 2026-09-20. The GPT-5.6 line listed there is Luna, Terra and Sol, with no nano or mini tier under those names. Reasoning effort runs from none to max on GPT-5.6, while GPT-6 Astra’s entry lists no “none” option. Jev’s figures come from docs.typesafe.ai/models and the launch post.

What the public benchmarks found

Source Task Result Caveat
TypeSafe launch post Its own four-workflow evaluation, read 2026-09-20 “193.6x faster, 444.6x cheaper” against a reference answer defined as “the average of GPT-6 Astra and Fable 5.1” GPT-6 Astra is the grader here, not a system Jev was measured against. The post admits the choice “biases answers towards OpenAI and Anthropic’s models”
Show HN item 49754516 Pong, one paddle move per model decision, 45 seconds per lane next to the Vercel gateway in iad1 Jev averaged 227ms with a p95 of 400ms, GPT-5.6 Sol 3.5s. 47 Jev decisions against 2 in the first 12 seconds The numbers are in the submitter’s own comment, Matt O’Riordan of Ably. Other commenters reported the live demo itself was buggy
Justine Moore (@venturetwins), 2026-09-19 Predicting which books she would rate five stars, 1,000 Goodreads ratings as data with 100 held out, against GPT-5.6 “Jev was slightly more accurate, 53x cheaper, and 25x faster” One person’s informal test, no raw data published. The post names GPT-5.6 without a tier
Povilas Korop, Laravel Daily, 2026-09-19 The same tweet classification run on GPT-5.6 Terra and on Jev, inside a Tweet Analyzer project Price favours Jev, per the post, which calls price “one of Jev’s stronger points” No multiple appears in the post itself. The linked 17-minute video’s figures are not reproduced here
u/LowNefariousness9966, r/OpenAI, read 2026-09-20 49 tasks, around 8,200 items from public labelled datasets, against gpt-5.6-luna tested once with reasoning off and once on low Jev matched or beat the baseline on 42 of 49 tasks, at around 105ms median server time against 700ms to 800ms, and around $0.04 per 1,000 items against $0.16 to $0.19. Calibration error “roughly half the baseline’s” An independent hobbyist test, not peer reviewed. The reranking section of the post is not quoted here
vclic/smoking-extraction-benchmark 1,000 synthetic outpatient notes, ten typed questions each, against OpenAI structured outputs OpenAI 98.7% fully-correct records against Jev’s 92.4%. Jev around 133x cheaper and around 5.2x lower mean latency The one sourced case where the OpenAI side wins on accuracy. Which OpenAI model ran is not named

Cost per decision

Run the list prices out. Ten thousand classifications at 500 input tokens each is 5 million input tokens. That is $0.21 on Jev, $1.00 on GPT-5.6 Luna, $10.00 on GPT-5.6 Terra, $20.00 on GPT-5.6 Sol and $50.00 on GPT-6 Astra, at prices published on developers.openai.com on 2026-09-20, before a single output token is billed.

Output widens the gap. Jev charges nothing for output, because a Choice answer is an option name with a probability and a confidence number. Every GPT call bills output tokens, from $1.20 per million on Luna to $50.00 on Astra.

The one independent measurement sits close to those list prices. The r/OpenAI benchmark recorded around $0.04 per 1,000 items for Jev against $0.16 to $0.19 for gpt-5.6-luna. The pricing guide works through your own numbers.

Latency

OpenAI publishes no latency figure for a short classification call. Nothing on its pricing, models, Structured Outputs or Chat Completions pages gives one, checked 2026-09-20.

The measurements that do exist come from other people, and each one is narrow. The Pong run recorded Jev at 227ms average against 3.5s for GPT-5.6 Sol, though those numbers come from the person who built the demo and commenters found the live version buggy. The r/OpenAI benchmark recorded around 105ms median server time against 700ms to 800ms for gpt-5.6-luna across 49 tasks, in a single unreviewed run.

The Register’s 0.114s against 8.566s for GPT-5.6 Terra is TypeSafe’s own launch figure repeated in coverage, as is the 70ms to 500ms range in the docs.

Logprobs vs calibrated probabilities

OpenAI does expose token probabilities, the closest thing GPT has to Jev’s number. The Chat Completions reference documents logprobs, returning “log probabilities of each output token returned in the content of message”, and top_logprobs, which returns up to 20 likely tokens per position each with a log probability, checked 2026-09-20. A log probability is the model’s probability for a token written on a logarithmic scale, so that very small values stay readable.

That is a probability over wording. If your label is refund_request, a logprob tells you how likely the model was to write each piece of that string, given what came before. It says nothing directly about the other options you offered. Jev returns a distribution over the option set you passed in, plus a calibrated probability that TypeSafe claims RLCD training makes track real outcome rates. No calibration figure has been published, though the r/OpenAI author measured Jev’s error at roughly half the baseline’s.

Structured outputs handle the typing on the OpenAI side. With strict: true, the guide says the model cannot omit a required key or emit an invalid enum value. What the guide does not address, as of 2026-09-20, is whether logprobs and Structured Outputs can be combined. Test that before designing a confidence gate around it.

Is Jev a ChatGPT alternative?

No. The two do not compete for the same job.

ChatGPT is OpenAI’s chat product, sold by the seat. Its pricing page states that “Paid plans (Plus, Pro, Business, and Enterprise) are priced per user per month”, checked 2026-09-20. Jev has no chat interface and generates no text, and TypeSafe’s docs list a single endpoint, POST https://api.typesafe.ai/v1/systemone. There is no window to type into.

What Jev replaces is the classification and routing calls inside an application, such as the intent label before a handler runs.

TechCrunch’s headline of 18 September 2026 calls Jev the work of “a ChatGPT inventor”. That refers to Diogo Almeida, described in the article as “an OpenAI researcher who helped build the chatbot and then invent reinforcement learning from human feedback (RLHF)” and now a TypeSafe AI co-founder. It is about who built Jev rather than what Jev does.

What GPT does that Jev cannot

Anything that produces language. Code and conversation both sit outside a model that emits an option name. Agent loops go with them, since an agent has to write tool calls. Context is a hard limit too, at 64k per request against 1.05M on every current GPT model.

TypeSafe’s jaggedness page for Jev 1.13 lists the reasoning gaps: arithmetic, counting, date ordering and multi-hop questions. AI/ML API ran Jev V13 at 5+0 blitz chess with one move per API call, and GPT-6 Astra mated it in 18 moves.

Accuracy on rich extraction is the other gap, as the smoking-extraction benchmark above shows. The System One against LLM comparison and the Claude head-to-head go further into the boundary.

Using Jev with OpenAI models: routing and gating

The projects below run both models side by side. Jev makes the cheap judgment and a GPT model does the writing.

Per-turn model selection is the common pattern. A decision model reads the turn, picks which tier handles it, and sends easy work to the cheap model. That is intent and model routing. For coding agents, community routers do this against OpenAI’s tiers, covered on the Codex integration page.

Two community projects route OpenAI-shaped calls without involving Codex. noelzappy/tripwire is a TypeScript proxy and AI SDK middleware that speaks the OpenAI API shape and runs seven Jev guardrail checks, around 100ms, before a response reaches the user. donvito/ai-backends is an abstraction server routing to OpenRouter, OpenAI, Anthropic or Google, with Jev support added. Jev itself answers on an OpenAI-compatible endpoint through OpenRouter.

TechCrunch quotes Pranit Sharma, a software engineer at Vercel, saying that replacing OpenAI’s GPT-5.6 Luna with Jev produced “results five to 18 times more quickly and with greater accuracy”. That is a customer quote in a press piece, with no raw numbers attached.

Which to use

Send the decision to Jev and the work to a GPT model. A step with a fixed set of answers, a probability you want to threshold or a latency budget in the hundreds of milliseconds suits the classification model. A step that has to write, reason across several hops or read more than 64k tokens needs GPT. Test extraction with many fields per record carefully, since that is where the published accuracy went the other way.

FAQ

Is Jev better than GPT?

Not in general. It wins on bounded decisions and loses elsewhere. The r/OpenAI benchmark of 49 tasks found Jev matched or beat gpt-5.6-luna on 42 of them, read 2026-09-20. The vclic extraction benchmark found the reverse, with OpenAI structured outputs at 98.7% fully-correct records against Jev’s 92.4%.

Is Jev a ChatGPT alternative?

No. ChatGPT is a chat product sold per user per month, per its pricing page checked 2026-09-20. Jev has no chat interface, no text output and one documented API endpoint. If you want something to talk to, Jev is not it. It stands in for the classification call buried inside your code.

Is Jev cheaper than GPT-5.6?

Yes, at list prices. Five million input tokens costs $0.21 on Jev against $1.00 on GPT-5.6 Luna, $10.00 on Terra and $20.00 on Sol, from prices checked 2026-09-20. Jev bills nothing for output, while every GPT call bills output tokens at $1.20 to $20.00 per million on top.

Can Jev replace GPT for classification?

Often, when the options are fixed and the input fits in 64k tokens. One r/OpenAI test across roughly 8,200 items put Jev at around $0.04 per 1,000 items against $0.16 to $0.19 for gpt-5.6-luna, at around 105ms against 700ms to 800ms. Run both on your own labelled sample first.

Does GPT give confidence scores like Jev?

Not the same kind. OpenAI’s Chat Completions exposes logprobs and top_logprobs, which give log probabilities for the tokens the model emitted. That is a probability over wording rather than over your option set. Jev returns a probability per option plus a confidence value, which TypeSafe claims RLCD makes calibrated.

Can Jev write text like ChatGPT?

No. Jev generates no text at all. Its answers are a Choice, a Score or a Noul, each carrying a probability over the options you supplied. That constraint is why output tokens are free. Anything that has to produce language or code needs a generative model such as GPT.

Examples

Tool

AIBackends

An AI API server that abstracts multiple models and providers behind one layer, for local use with Ollama or LM Studio or in the cloud via OpenRouter, OpenAI, Anthropic or Google. It now supports Jev.

Melvin Vivas (@melvindvivas)145507OpenAIBackends on github.com
Project

ably-labs/jev-pong

Pong where the ball moves one segment per model decision, so a lane's speed is that model's latency and nothing else. Four lanes replay a recorded run with Jev, Gemini 3.8 Flash, Claude Haiku 4.5 and GPT-5.6 Sol on the right paddle, every player and agent on an Ably channel.

Related guides