DOTAFS

Personal learning notes

MODEL RESEARCH NOTE · · 18 MIN READ

Jev and GPT: Generate Language, or Make Decisions Directly?

Jev is TypeSafe AI's System One model. Its native interface reads a state and answers questions with predefined answer spaces. The published GPT lineage is built around token-by-token language generation, although GPT can also produce schema-constrained values. The consequential differences lie in the output contract, dependency graph, training objective, and tasks each system can solve.

Primary source
Diogo Almeida / TypeSafe AI, “Introducing System One Models & Jev,” September 15, 2026; a company technical announcement, not a peer-reviewed paper
Comparison
Brown et al., GPT-3 paper (2020); Ouyang et al., InstructGPT paper (2022); OpenAI's Structured Outputs article (2024)
Input → output
Jev: text or structured text state + typed questions → choices, scores, or binary probabilities. GPT: context → generated tokens, optionally constrained by a schema
Scope
Publicly documented behavior and inference interfaces; no guesses about Jev's network layers, parameter count, or accelerator

Evidence status: No reproducible Jev architecture and training paper is public. Statements about Jev below are limited to its official descriptions and observable API. Original diagrams and labs explain those interfaces; they do not depict private network internals or measured speed.

01 / THE PROBLEM

Why does embedding a language model in software get awkward?

A support workflow may only need “Is a refund requested?”, “Which department?”, and “How severe is the issue?”. A free-form model can answer, but software must extract fields, validate types, handle refusals or truncated output, and decide whether each judgment is safe to automate. Valid syntax is not a correct decision; a persuasive explanation is not a calibrated probability.[1][5]

TypeSafe's Jev makes the answer space part of the request and returns probabilities over finite alternatives. Application code then applies explicit rules. Jev does not write open-ended emails, code, or extended reasoning. OpenAI Structured Outputs can already constrain GPT to schemas, so the comparison cannot be “Jev has types and GPT cannot produce valid JSON.”[2][5]

Problem

Software needs many narrow, composable decisions; general text generation adds sequential output and interpretation.

Proposal

Jev accepts a state and a batch of Choice, Score, or Noul questions, then returns typed probabilities.

Assumption

The answer space can be specified ahead of time; code combines narrow judgments into a workflow.

Outside scope

Long-form writing, open-ended code generation, unknown output categories, and guarantees of semantic truth.

02 / THREE ROUTES

Compare mechanisms, not just product names

DimensionUnconstrained GPTGPT + Structured OutputsJev + typed questions
StateA context of tokens; not every detail of current proprietary models is publicThe language model receives context plus a schemaText, JSON object, or array of text as state; typed questions with allowed options
OutputOne next-token choice conditioned on previous tokensStill token-by-token, but invalid next tokens are masked against the schemaOfficial description: parallel probabilities for independent questions sharing a state
ObjectiveGPT-3: language modeling; InstructGPT: demonstrations and preference-based post-trainingSchema understanding plus a deterministic decoding constraintTypeSafe says RLCD targets calibrated decisions; its loss, data, and training recipe are undisclosed
ProductsWriting, code, explanations, open-ended repliesNested structured objects that can still contain textChoice, Score, Noul; no arbitrary string generation
LimitLong outputs add dependent decoding stepsFormat can be enforced, but values may be wrong; refusals and truncation need handlingWorks for batched narrow judgments, but a missing option or wrong state can still produce a wrong decision

The GPT mathematics here refers to published GPT-3, while the RLHF example refers to InstructGPT. It is not a disclosure of every internal mechanism of GPT-6. Likewise, TypeSafe calls Jev a new architecture with a parallel sampler, but has not disclosed enough to identify its backbone, attention design, kernels, or model size.[1][6][7]

03 / METHOD MAP

Follow the data before inspecting equations

Three dataflows: free GPT generation, schema-constrained GPT, and Jev decisionsA shared input feeds three paths. Free GPT generates sequential tokens, constrained GPT also generates sequentially with a schema mask, and Jev evaluates independent questions against one state in parallel before code applies rules. context / state GPT: p(tₙ | t<ₙ)next token depends on prior GPT + schemamask invalid next tokens Jev: q₁, q₂, … qₙsame state / parallel prose → parse / useopen-ended output valid JSON → inspectvalid type ≠ true value probabilities → codeno free-form reply
Original teaching diagram based on TypeSafe's launch/docs, GPT-3, and OpenAI Structured Outputs. It describes published interfaces and decoding, not Jev's private layer topology or hardware.[1][2][5]

Consider “Order A-104 has two identical charges and the customer requests a refund.” A program can ask in one batch whether a refund was requested (Noul), which department owns it (Choice), and how frustrated the customer sounds (Score). Each question sees the same state, but not another answer. If a later question truly requires a database lookup chosen by an earlier answer, code needs a second request: parallelism cannot erase a real dependency.[2]

04 / MATHEMATICS

Which formulas are public, and which describe only the API?

GPT: a conditional distribution over the next token

Let the input and output form a sequence of tokens t₁,…,tₙ. Autoregressive modeling factors the joint probability into a product of conditionals. At inference, token i depends on the tokens already generated. Training can evaluate losses at many positions in parallel, but sequential output has a dependency chain. This does not mean that the matrix arithmetic inside each decoder step runs serially on a GPU.[6]

BASE MODEL OF THE PUBLISHED GPT LINEAGEp(t₁,…,tₙ) = ∏ᵢ p(tᵢ | t₁,…,tᵢ₋₁)

The product captures dependencies between output steps. Transformer operations within a step still exploit accelerator parallelism.

GPT with types: generation constrained at each step

OpenAI Structured Outputs preprocesses a supported JSON Schema into a context-free grammar (CFG). Given prefix t<ᵢ, the decoder masks tokens outside the currently valid set A(t<ᵢ,S) before sampling. This enforces syntax for supported schemas, while unsafe-request refusals, unfinished output, and incorrect field values still need application-side handling. Jev is not alone in offering typed output.[5]

EXPLANATORY FORM, NOT A SOURCE-CODE TRANSCRIPTIONpS(tᵢ | t<ᵢ) ∝ p(tᵢ | t<ᵢ) · 1[tᵢ ∈ A(t<ᵢ,S)]

S is the schema. The indicator zeros invalid choices; constrained decoding still depends on the previously produced tokens.

Jev: a shared state and bounded answer spaces

TypeSafe documents three primitives. Choice selects from defined options and supplies probabilities; Score returns a distribution across defined levels and a position between them; Noul estimates the probability that a yes/no statement holds, from 0 to 1. Choice/Score confidence summarizes the shape of their probability distributions; Noul has no separate confidence property. Without a “none of the above” option, a Choice may be forced into an incomplete set.[2][3]

API-LEVEL NOTATION, NOT JEV'S HIDDEN LOSS OR CIRCUIT(state, {(qⱼ, Cⱼ)}ⱼ₌₁…ₘ) → {Pⱼ(y | state, qⱼ, Cⱼ)}ⱼ₌₁…ₘ

Cⱼ is question j's options or levels; Pⱼ is its returned distribution. The vendor says questions in the same request are independent and evaluated in parallel. This API says nothing definite about layer count, attention, or FLOPs.

A training acronym is not a disclosed algorithm

GPT-3 documents autoregressive language modeling. InstructGPT first fine-tunes on demonstrations, then uses human preference rankings and reinforcement learning to improve instruction following. TypeSafe also discusses RLVR, reinforcement learning against programmatically verifiable rewards, as background for reasoning tasks; it would be wrong to claim every GPT version uses only RLHF. TypeSafe names its post-training path RLCD (Reinforcement Learning for Calibrated Decisions) and says it targets probabilities that better reflect correctness. Its public materials do not provide enough detail to reproduce the reward, optimization, data mixture, backbone, or compute budget. It would be unwarranted to invent an RLCD loss, or claim GPT probabilities can never be calibrated.[1][4][7]

Hardware

Serial token dependencies do not prevent GPT's matrix operations from running on GPUs or other accelerators. TypeSafe claims a parallel, hardware-aware sampler but does not disclose its complete deployment topology. “Jev runs on CPU; GPT runs on GPU” is unsupported. This page's diagrams are not chip measurements.

05 / INTERACTIVE LABS

Explore dependencies and calibration

LAB 01 / OUTPUT SHAPE

Are longer output and more questions the same cost?

Move either control. Blocks represent output dependencies, not FLOPs or measured milliseconds.

Teaching model only. Real latency depends on input length, model size, batching, queueing, network, hardware, and reasoning settings. Packing a difficult judgment into one request does not make the judgment easy.

Calibration concerns frequencies across many predictions: if a model assigns 80% to a group of comparable events, approximately 80% should occur. One prediction cannot prove its own calibration. An action threshold must also reflect the consequences of being wrong: opening a read-only page and approving a money transfer demand different safeguards.[3][4]

LAB 02 / PROBABILITY

What if a model says 80%, but only 40% happen?

Invent one toy group of binary events; watch the calibration gap and Brier score change.

The sliders invent data, not a Jev or GPT benchmark. Brier = f(1−p)² + (1−f)p². A low group score never guarantees one individual prediction is correct.

06 / EVIDENCE

What do the striking speed figures actually measure?

ReportSetup / metric directionResult and valid readingMissing evidence
TypeSafe side-by-side demo [1]Short, dense text state and readable question keys, compared with GPT-5.6 Terra at default reasoning. Lower end-to-end latency is better.Vendor quotes 70–500 ms for Jev and 40–200× faster for some System One-shaped queries.The deliberately shorter input favors Jev. One demo is not a general capability benchmark.
Four workflows [1][8]Security incidents, agent traces, invoices, customer service. Accuracy is against an averaged GPT-6 Astra/Fable 5.1 consensus; lower time/cost and higher agreement are better.Vendor highlights up to 193.6× faster and 444.6× cheaper on its workflows, explicitly calling these the high end of expected gains.Consensus is not independently labeled truth. The capabilities team built workflows; default reasoning settings and wrappers affect comparison.
Schema adherence [1][5]Jev is restricted to given options. OpenAI evaluated GPT-4o-2024-08-06 with constrained decoding on its own complex JSON schemas; higher validity is better.Jev's type guarantee follows its output contract. OpenAI reports 100% schema adherence in its internal eval, showing GPT can also obey types.Different schema tasks make direct percentage ranking invalid; validity does not establish truth.
Calibration and correctnessA fair study would use the same independently labeled cases, accuracy, Brier, ECE, selective coverage, and out-of-distribution error.This note has no reproducible, independent paired Jev-versus-GPT calibration curve or deployment measurement.Independent labels, ablations, training resources, long-term failure rates, and multilingual stress tests.

The launch claim that Jev “can't hallucinate” should be read narrowly as it cannot return a value outside its allowed output type. Wrong input, an incomplete list of candidates, or an erroneous semantic judgment can still cause an erroneous decision. TypeSafe treats its zero type-error figure as structural, not an observed real-world correctness measurement. OpenAI explicitly says schema-conforming fields can still contain mistakes.[1][5]

Jev's training data, parameter count, backbone detail, and RLCD ablations are not public, so internal causes of its measured performance cannot be isolated. Limited early access and company-built evaluations restrict independent replication. The public System One LLM adapter wraps other LLMs in a compatible API; it is not Jev's weights or training source.[1][9]

07 / FIT AND LIMITS

Choose according to the output you actually need

Jev's promising fit: one known state gives rise to many independent, narrow questions. Code declares the allowed values and routes according to probability and risk. This can save unnecessary generation. The current documented input is text only, and English is its best-performing language; Chinese workloads need separate evaluation.[2][10]

Product limits: the launch says a direct Choice supports at most 255 alternatives; higher-cardinality cases need staged scoring and selection. The quoted launch price is $0.042 per million input tokens, with no separate output-token charge. This is a vendor price, not proof of underlying hardware cost, and cannot be compared with GPT token prices across different tasks without matched workloads.[1][10]

GPT's promising fit: the answer space is unknown, or the task calls for explanations, code, long-form writing, multi-step reasoning, and mixed workflows. Strict schemas solve many type problems, but do not automatically attach independently verified semantic probabilities to every field. More reasoning may improve quality at additional time and cost.[5][7]

Shared hazards: missing evidence, prompt injection within state, ambiguous labels, and distribution shift require independent testing and a refusal or escalation path. Jev's same-batch independence cannot implement true cross-question dependencies; a GPT workflow needs checks on text, schema, and tool results. Neither is an unconditional replacement for the other.

08 / PROJECT MAPPING

A small study you could actually run

For a paper library, package each paper's metadata, abstract, and source links into state. Ask narrow questions such as “Is PBD a primary method?”, “Is reproducible code provided?”, and “Does this citation need human verification?”. Code uses the returned probabilities to route records; GPT writes the human-facing summary only where needed. Check whether a DOI really exists against a trusted resolver, rather than asking either model to guess without evidence.

Label 200–500 fixed examples by hand and use identical inputs and output spaces. Compare Jev, GPT with Structured Outputs, and a basic keyword/rules baseline. Report macro-F1, per-class confusion matrices, Brier score, reliability diagram, end-to-end p50/p95 latency, actual billed cost, and abstention rate. Hold out separate Chinese and new-domain test sets and record the pinned model version and provider region. Compare speed only at an acceptable accuracy level.

AN EXECUTABLE STUDYSources → verified fields and labels → three matched baselines → calibration + error cost → routing → GPT explanation / human review

Start with a small offline evaluation. The open-source LLM adapter can help align interfaces, but testing it does not test the actual Jev model.