iambraun.com · Jev reports

Jev reports

Two measured studies, their labelled data, and two running indexes of what is built on Jev, TypeSafe AI's typed-decision model.

Studies

  1. BenchmarkPublished 17 September 2026, Qwen 3.8 added 3 October 2026

    Worth asking?

    A typed-decision model wired into five places in a Dungeons & Dragons co-DM, measured on four benchmarks (table rules, routing, contradictions, asset kinds) against the code it replaced, a frontier model called as a classifier, Laya, the open-weight model marketed as its replacement, and Qwen 3.8 read as a System 1 sampler.

  2. BenchmarkPublished 17 September 2026, rerun on equal terms 3 October 2026

    Skill Selection, Measured

    8,916 skill-selection decisions per arm (743 skills across 12 job postings), rerun with every arm on equal terms against 720 pairs graded by Claude, GPT and Gemini: Jev, GLM-5.3-flash, Haiku 4.5 and Qwen 3.8 asked 60 skills per call and one per call, Qwen 3.8 read as a System 1 sampler, Laya, embeddings, a substring matcher, and the same postings as page images.

  3. DatasetPublished 3 October 2026 · zip, 198 KB

    The labelled items, both studies

    Every labelled item from both studies, each with the exact state and questions Jev was sent and the answer it is scored against: 720 skill–posting pairs with three graders' votes and every arm's score, and the four co-DM sets (94 table-rule paragraphs, 60 contradictions, 90 routing messages, 177 art-library rows). JSON Lines, with a README.

Indexes

  1. IndexRefreshed twice daily since 19 September 2026

    Jev radar

    Tools, demos and findings from the TypeSafe Discord, GitHub and X, each scored 1 to 5 and tagged; searchable by text, tag, source, score and repository stars.

  2. IndexRefreshed twice daily since 19 September 2026

    Jev in production

    Named products and companies running Jev in production, each with a professional-usefulness score and its source, and a weekly highlight.