Jev in production › Evaluation and testing
Python toolkit that sends RAG, response and agent-trace metrics to Jev in one judge request and checks proposed tool calls against policy before they run, with optional threshold calibration against human labels.
Evaluate responses. Guard actions. A Python toolkit for checking LLM answers, evaluating agent runs, and reviewing tool calls before execution
Quickstart · Presets · Tool guards · Calibration · Examples & guides
Give Typed Evals a request, a response, and the evidence used to produce it. Choose what to check, then get a score and pass/fail result for each check. You can also evaluate recorded agent runs and apply policy checks before tools execute.
For the project's own README, linking back here: