Jev in production › Model and agent routing
Pi coding-agent extension uses local or hosted Jev to judge prompt difficulty and pick the LLM tier from a user-defined routing table.
Pi agent extension that shifts to the right LLM for each prompt, the way a bike changes sprocket (pignon): a small decision model judges how hard the prompt is, and pignon looks the answer up in your routing table.
- Decisions come from a local Laya System-1 model (served by laya-serve, ~75 ms on Apple Silicon) or from TypeSafe's hosted Jev (~70–500 ms, needs an API key) - You choose the models and write your own difficulty tiers - Strongly typed TypeScript, config checked against a published JSON Schema
For the project's own README, linking back here: