Skip to content
System One

noelzappy/tripwire

AI SDK middleware and OpenAI-compatible proxy that judges every LLM response before the user sees it, running seven Jev checks in one call of about 100 ms. Policy is YAML, a high-confidence check blocks while a low-confidence one downgrades to a flag, and the author notes there are no accuracy numbers against real Jev yet.

noelzappy/tripwire on GitHub

Stars
3
Forks
0
Language
TypeScript
License
MIT
Last push
18 Sep 2026

Read from GitHub on . Counts change daily.

How it uses Jev

No direct call turned up in the code, so this is where it loads the SDK.

import { experimental_evaluate } from "ai";
import { createTypeSafeAi } from "@ai-sdk/typesafe-ai";
import type { Judge, Judgment, Questions } from "./types.ts";

export interface JevJudgeOptions {
  apiKey?: string;
  modelId?: string;
  baseURL?: string;
  /** Retries for transient failures. Default 0: a slow guardrail is a broken guardrail. */
  maxRetries?: number;
}

/** TypeSafe Jev through the AI SDK provider. One request, all questions in parallel. */

View in src/judge/jev.ts

Open on GitHub

More like this

Use cases this is tagged with