Skip to content
System One

instructa/switchloom

A Jev-based model-routing experiment for Codex tasks that the author now recommends against adopting: in a Pokedex benchmark, the Jev-routed team cost almost as much as running the top model alone and missed the time limit, while the single-model run finished and passed all checks. Code and results are public as a negative benchmark.

instructa/switchloom on GitHub

Stars
1
Forks
1
Language
TypeScript
License
MIT
Last push
20 Sep 2026

Read from GitHub on . Counts change daily.

How it uses Jev

use std::{io::Read, time::Duration};

#[cfg(not(target_arch = "wasm32"))]
const ENDPOINT: &str = "https://api.typesafe.ai/v1/systemone";
#[cfg(not(target_arch = "wasm32"))]
const RESPONSE_LIMIT: u64 = 65_536;

#[derive(Debug, Deserialize)]
pub(crate) struct Judgment {
    pub model: String,
    pub answers: Answers,
    pub usage: Usage,
}

#[derive(Debug, Deserialize)]

View in src/typesafe.rs

Open on GitHub

Use casesIntent and model routing

More like this

Use cases this is tagged with