Skip to content
System One

Laya Rust Inference (candle)

Pure-Rust inference for Laya built on candle, with CPU, Metal and CUDA backends, no Python, torch or ONNX export step, and weights pulled straight from the Apache-2.0 checkpoint.

aovestdipaperino/laya-rust on GitHub

Stars
7
Forks
0
Language
Rust
License
Apache-2.0
Last push
20 Sep 2026

Read from GitHub on . Counts change daily.

How it uses Jev

let t0 = Instant::now();
let result = st.agent.system_one(&req.state, &questions)?;
Ok(PredictResponse {
    result,
    latency_ms: t0.elapsed().as_secs_f64() * 1000.0,
    prompts,
})

View in src/bin/laya-serve.rs

Open on GitHub

More like this

Keep browsing