Jev in production › SQL and data pipelines
Jevaro batches Jev requests concurrently and returns typed answers as Apache Arrow IPC streams for pandas, Polars and DuckDB pipelines.
A Python batching proxy for Jev that returns Apache Arrow streams, with Python and JavaScript SDKs.
Jevaro is an experiment in bulk inference: ask the same questions about many independent states in one client request. The TypeSafe API evaluates one state per request. Jevaro makes those calls concurrently, or packs many states into each call with rowspercall. It converts the JSON answers into an Arrow IPC stream, in input order.
The schema arrives before the answers. Each state becomes a row and each question a column. Arrow extension types preserve the meaning of Choice, Noul, and Score, with shared labels and legends stored once in the schema. The resulting Arrow data can go into pandas, Polars, DuckDB, and other Arrow tools.
For the project's own README, linking back here: