•
#AI#Machine Learning#System Design#TypeSafe AI#Architecture#Software Engineering

Meet Jev by TypeSafe AI: Why the Future of Software AI is 'System 1' Decision Models (Not Chatbots)

Why use a 70-billion-parameter conversational model just to pick a category or route a webhook? Inside Jev—the radical new AI model trained with RLCD that is 200x faster, 400x cheaper, and can't generate a single sentence.

"After co-inventing ChatGPT, I kept asking myself: why have superhuman chat models not led to AGI? ... The gains aren’t free: Jev can't generate text."
— Diogo Almeida, Co-inventor of RLHF & ChatGPT, Founder of TypeSafe AI

Imagine you are building a customer support ticketing system. A new user message arrives:

"My payment failed with error code ERR_CARD_DECLINED."

Your application needs to make a simple programmatic decision: Should this ticket go to #billing, #tech-support, or #general?

Today, standard practice looks almost absurd. We take a massive, 70-billion-parameter Large Language Model (LLM)—trained on the collective literature of human civilization, poetry, philosophy, and Python—and ask it:

{
  "role": "user",
  "content": "Classify this ticket into: billing, tech-support, or general. Output strict JSON only without markdown formatting."
}

Then we wait.

We wait 800 milliseconds. We pay for input tokens, system prompt tokens, and output tokens. We pray the model doesn't reply with ```json or hallucinate a fourth category. We write defensive regex parsing, wrap it in try/catch blocks, and cross our fingers.

Why are we using an articulate conversationalist to do the job of a simple router?

On September 15, 2026, TypeSafe AI—founded by former OpenAI researcher Diogo Almeida (co-inventor of RLHF and InstructGPT/ChatGPT) alongside Erik Gafni and Sasha Sheng—unveiled Jev.

Jev is the world’s first frontier "System One Model".

  • It is 20x to 200x faster than traditional LLMs.
  • It is 40x to 400x cheaper ($42 per billion input tokens).
  • Its output tokens are free forever.
  • And it comes with one shocking trade-off: Jev cannot generate a single word of text.

If you are a junior developer, this might sound completely backwards. Aren't AI models supposed to talk? Why would anyone build an AI that can't speak?

Let’s unpack the architectural revolution behind Jev, how RLCD works, and why this represents the biggest shift in AI software design since the Transformer.


1. The Core Mental Model: System 1 vs. System 2 Thinking

To understand Jev, you need to understand a landmark concept in cognitive psychology introduced by Nobel laureate Daniel Kahneman in his book Thinking, Fast and Slow:

┌─────────────────────────────────────────────────────────────────────────┐
│                        HOW INTELLIGENCE OPERATES                        │
├────────────────────────────────────┬────────────────────────────────────┤
│         SYSTEM 1 (Fast)            │         SYSTEM 2 (Slow)            │
├────────────────────────────────────┼────────────────────────────────────┤
│ • Instant, automatic, reflexive    │ • Deliberate, conscious, reasoned  │
│ • Catching a falling coffee mug    │ • Solving 47 × 83 in your head     │
│ • Swerving to avoid an obstacle    │ • Writing a technical essay        │
│ • Recognizing a friend's face      │ • Planning a multi-year strategy   │
│ • Sub-second decisions             │ • Takes seconds or minutes         │
└────────────────────────────────────┴────────────────────────────────────┘

For the last four years, the entire AI industry has obsessed over System 2. Models like GPT-4o, Claude 3.7 Sonnet (Thinking Mode), and OpenAI o1 are built to pause, think in sequential chains of reasoning, and generate paragraphs of natural language.

The problem?
In real software applications, 95% of execution steps are System 1 reflexes:

  • Is this incoming webhook payload spam or legit?
  • Which database partition should this query be dispatched to?
  • Did this user sentiment drop below acceptable thresholds?
  • Which UI component should render based on this telemetry event?
  • In a graph with 500 nodes, which edge should the crawler traverse next?

Using a heavy, conversational LLM to answer these questions is like hiring a brain surgeon to flip a light switch. It works, but it's painfully slow, outrageously expensive, and prone to conversational quirks you never wanted.

Jev was built from the ground up to be pure System 1 intelligence: machine-native, structured, instant, and deterministic.


2. The Great Sacrifice: Why Jev Can't Generate Text

When Diogo Almeida tweeted: "The gains aren't free: Jev can't generate text", many developers asked: Isn't that a fatal downgrade?

To answer that, let’s look at why traditional LLMs are slow in the first place.

How Traditional LLMs Generate Output (Sequential Autoregressive Generation)

Traditional LLMs generate text one token at a time, sequentially:

Prompt -> [Model] -> "Billing" 
                       ↓
                   [Model] -> "department" 
                                ↓
                            [Model] -> "selected."

If a model generates 50 tokens, it must perform 50 sequential forward passes through its neural network. Step 2 cannot start until Step 1 has finished. In computer science terms, autoregressive generation is strictly bounded by sequential latency:

$$\text{Latency} = N_{\text{tokens}} \times \text{ForwardPassDuration}$$

How Jev Works: Parallel Decision Making

Remember how the Transformer leapfrogged older Recurrent Neural Networks (RNNs) in 2017? RNNs processed input sentences sequentially (word by word), while Transformers processed every word in parallel using self-attention.

Jev pulls the exact same trick on the output side:

Input Prompt + Schema Options ──► [ JEV ENCODER ] ──► All Options Scored in 1 Parallel Pass!
                                                      ├── Option A: 0.04
                                                      ├── Option B: 0.94  ◄── Selected!
                                                      └── Option C: 0.02

Instead of looping sequentially to generate "B-i-l-l-i-n-g", Jev evaluates the input against a pre-defined set of valid choices or structured fields in a single forward pass.

Because there is no autoregressive token-by-token loop:

  1. Latency drops by 20x to 200x (frequently sub-50 milliseconds).
  2. Compute costs plummet, because evaluating candidate choices in parallel uses a fraction of the GPU cycles required to generate text.
  3. Output tokens are literally free ($0): TypeSafe AI stated that output tokens are “too cheap to meter with our new architecture.”

3. The Economics: Breaking the Developer Calculator

Let’s look at raw numbers.

When building AI features, junior developers quickly learn that LLM API costs can kill a startup before it even finds product-market fit.

Here is how Jev stacks up against traditional frontier models:

DimensionFrontier Chat LLM (e.g. GPT-4o / Claude 3.5)TypeSafe AI: JevThe Difference
Input Cost~$2.50 to $5.00 per Million Tokens$0.042 per Million Tokens ($42 / Billion!)~60x – 120x Cheaper
Output Cost~$10.00 to $15.00 per Million Tokens$0.00 (FREE FOREVER)Infinite Reduction
P95 Latency800ms – 3,500ms15ms – 80ms20x – 50x Faster
Output TypeUnstructured text string (needs parsing)Strongly typed schema / probabilitiesMachine-Native
Hallucination RiskHigh (can invent values or syntax)Zero (confined to schema choices)Bulletproof

What is the "Jevons Paradox"?

Why did TypeSafe AI name their model Jev?

In 1865, British economist William Stanley Jevons observed that when James Watt made the steam engine dramatically more fuel-efficient, people expected coal consumption to decrease. Instead, coal consumption exploded. Because steam engines became cheap and accessible, industries deployed them everywhere.

This is the Jevons Paradox: When you make a critical resource dramatically more efficient and cheaper, total consumption doesn't decrease—it increases exponentially.

Traditional LLM: $0.01 per call ──► Used only for high-value user queries
Jev: $0.00001 per call          ──► Embedded into every database query, 
                                     every UI interaction, and every micro-router!

When an AI decision costs fractions of a micro-penny and completes in 20 milliseconds, you don't just call it once per user request. You call it 10 times inside an animation frame, inside database triggers, or on streaming sensor feeds.


4. The Secret Sauce: What is RLCD?

Most developers have heard of RLHF (Reinforcement Learning from Human Feedback)—the technique that gave ChatGPT its conversational charm.

Under RLHF, human evaluators score model responses:

  • "Did this response sound polite?"
  • "Was this explanation helpful and comprehensive?"

While RLHF is great for chatbots, it is terrible for software engineering:

  • It encourages models to sound confident even when they are guessing (sycophancy).
  • It produces verbose hedging ("As an AI language model, it depends...").
  • The probabilities are uncalibrated: If an LLM assigns 90% probability to an output token, that doesn't mean it's 90% likely to be factually correct.

Enter RLCD: Reinforcement Learning for Calibrated Decisions

TypeSafe AI trained Jev using a new paradigm called RLCD (Reinforcement Learning for Calibrated Decisions).

                      Traditional RLHF                     RLCD (TypeSafe AI)
                 ─────────────────────────             ─────────────────────────
Optimized for:   Human conversational charm            Empirical statistical accuracy
Primary Metric:  User preference rating               Expected Calibration Error (ECE)
Output Style:    Chatty, polite, verbose               Compact, typed, calibrated probabilities
Confidence:      Subjective & overconfident            Mathematically verified confidence

Why "Calibration" is a Superpower for Junior Developers

In statistics, calibration means:
When the model says it has an 80% confidence level, it should be empirically correct 80 out of 100 times.

Why does this matter in your code? Thresholding.

Consider this real-world automated loan or refund approval pipeline:

// With traditional LLMs, you can never trust the confidence:
// The LLM says: "I am 99% confident this refund is legitimate"
// ...and it still hallucinates.

// With Jev and RLCD:
const decision = await jev.decide({
  context: userRefundRequest,
  schema: RefundActionSchema
});

// Calibrated probabilities mean mathematical trust:
if (decision.confidence >= 0.99) {
  // Safe to run completely autonomously without human eyes
  await processImmediateRefund(decision.data);
} else if (decision.confidence >= 0.80) {
  // Moderate confidence: enqueue for standard queue
  await queueForReview(decision.data);
} else {
  // Low confidence: escalate to senior fraud agent
  await alertFraudTeam(decision.data);
}

Because RLCD guarantees calibrated probabilities, you can build autonomous systems that know when they don't know.


5. The Wikipedia Race Demo: 10 Decisions a Second for $7/Hour

To showcase Jev's real-world power, TypeSafe AI showed off a demo based on the famous Wikipedia Game.

The Rules of the Game

You start on a random Wikipedia page (e.g., "Quantum Computing") and must reach another distant page (e.g., "Napoleon Bonaparte") using only the hyperlinks on the current page.

Why Standard LLMs Choke on This

  1. High Cardinality: A single Wikipedia page can contain 1,200+ hyperlinks. Feeding 1,200 options into a standard LLM blows up the prompt context window and takes 3–5 seconds per hop.
  2. Hallucination Risk: Standard LLMs love to invent links that don't exist on the page (e.g., guessing "Physics" exists when only "Applied Physics" is linked).
  3. Compounding Latency: At 3 seconds per step, traversing 8 hops takes almost half a minute.

How Jev Crushes It

  • Jev ingests the page context and the hundreds of possible link targets.
  • It scores all candidate links in parallel in a single reflex pass.
  • It runs at ~10 decision calls per second.
  • Running at this blistering real-time speed costs roughly ~$7 per HOUR of non-stop, continuous API calls.
  • Zero hallucinations: Because Jev operates over a strongly typed choice set, it is mathematically incapable of picking a link that wasn't in the input array.

6. Code Comparison: The LLM Way vs. The Jev Way

Let's look at what this looks like in production TypeScript code.

The Old Way: Forcing an LLM into a Decision Box

import OpenAI from "openai";
import { z } from "zod";

const openai = new OpenAI();

// 1. You write an elaborate prompt begging the model to behave
const prompt = `
You are a triaging engine. Categorize the user inquiry into exactly one of:
- BILLING
- TECHNICAL
- SALES

Output valid JSON only. Do not wrap in markdown quotes.
`;

const startTime = performance.now();

try {
  const response = await openai.chat.completions.create({
    model: "gpt-4o",
    messages: [
      { role: "system", content: prompt },
      { role: "user", content: "I got double-charged for invoice #4092" }
    ],
    // Hoping JSON mode prevents format breakage
    response_format: { type: "json_object" }
  });

  // 2. High latency: typically 600ms - 1500ms
  console.log(`Latency: ${performance.now() - startTime}ms`);

  // 3. You must parse the string manually
  const rawText = response.choices[0].message.content;
  const parsed = JSON.parse(rawText!);

  // 4. Validate with Zod because LLMs still drift
  const validated = z.enum(["BILLING", "TECHNICAL", "SALES"]).parse(parsed.category);
  
  // Cost: ~$0.01 per call. Latency: ~1000ms. Confidence: Unknown.
} catch (err) {
  // You need fallback logic for when JSON parsing fails
  console.error("Failed to parse LLM decision", err);
}

The New Way: Machine-Native Decision with Jev

import { createJevClient } from "@typesafe-ai/jev";

const jev = createJevClient({ apiKey: process.env.TYPESAFE_API_KEY });

const startTime = performance.now();

// Native, schema-driven decision
const result = await jev.decide({
  input: "I got double-charged for invoice #4092",
  choices: ["BILLING", "TECHNICAL", "SALES"] as const
});

// Latency: 25ms!
console.log(`Latency: ${performance.now() - startTime}ms`);

// Strongly typed out of the box
console.log(result.selection);  // "BILLING"
console.log(result.confidence); // 0.984 (calibrated!)

// Cost: $0.0000042 (virtually free). 
// Output tokens: $0.00. 
// Syntax errors: Impossible.

Notice the difference?

  1. No prompt engineering: You don't have to cajole the model with "You are an expert triage assistant".
  2. No JSON parsing: The response is typed by default.
  3. Calibrated confidence: You get a real statistical confidence score with every call.
  4. Instant turnaround: 25ms fits comfortably inside user-facing interactive SLAs.

7. The Architecture of the Future: The "Centaur" Stack

Does Jev mean Large Language Models are dead? Absolutely not.

Instead of replacing LLMs, Jev exposes the optimal architectural pattern for modern AI applications: The Centaur System (System 1 + System 2 Working Together).

                            Incoming User Request
                                     │
                                     ▼
                     ┌───────────────────────────────┐
                     │          JEV ROUTER           │  ◄── SYSTEM 1 (Fast, Cheap)
                     │    (20ms • $0.042 / BTok)     │      Calibrated Decisions
                     └───────────────┬───────────────┘
                                     │
                 ┌───────────────────┴───────────────────┐
                 │                                       │
      Is it a structured task?               Does it need open-ended
      (Routing, Filter, Triage,               reasoning, prose, or
      Classification, Cache Hit)              creative writing?
                 │                                       │
                 ▼                                       ▼
    ┌─────────────────────────┐             ┌─────────────────────────┐
    │     EXECUTE CODE        │             │      CALL HEAVY LLM     │  ◄── SYSTEM 2 (Slow, Deep)
    │  Direct Database Action │             │   (Claude 3.7 / GPT-4o) │      Creative Generation
    │  or Fast Deterministic  │             │   (1,500ms • $5.00/MTok)│
    │         Handler         │             └─────────────────────────┘
    └─────────────────────────┘

In this architecture:

  • Jev handles the reflexes: 95% of incoming traffic is triaged, categorized, validated, or rejected at machine speed for pennies.
  • LLMs handle the deep thinking: Only the 5% of complex tasks that genuinely require long-form prose or multi-step reasoning are escalated to expensive models like Claude or GPT-4.

This pattern cuts infrastructure costs by up to 80-90% while cutting end-user latency to near-instantaneous speeds.


8. Summary: Key Takeaways for Developers

If you take away three lessons from TypeSafe AI's release of Jev, let them be these:

  1. Stop using chatbots for routers: If your application is parsing LLM markdown to extract a yes/no answer or an enum, you are using the wrong tool.
  2. Parallel computation wins: Just as Transformers beat RNNs by processing inputs in parallel, System 1 models beat autoregressive LLMs by evaluating choices in parallel.
  3. Calibrated probabilities beat overconfident text: In production software, knowing how confident the model is determines whether you can automate a task safely without human supervision.

Want to explore Jev?

The era of bloated, chatty AI wrappers is giving way to fast, lean, machine-native intelligence. Welcome to System One.


Continue Reading