AI decision models compared: run OpenAI, Perplexity, TypeSafe and Cloudflare side by side

A decision model reads text or an image and answers questions you define in advance with probabilities, never prose. Since late September you can call TypeSafe’s Jev, Cloudflare’s Clef and Clef-flash, Perplexity’s Decider, OpenAI’s GPT-6 Luna Decisions, Microsoft-Decision-1, Liquid AI’s d1 family, and Nace.AI’s Drex Max. We ran the first five on the same 196 labelled inputs on 2026-10-07. Clef-flash was the most accurate on fine-grained intents and no model won everything. Perplexity replaced Decider with v1.2 in October; Microsoft-Decision-1 and Liquid’s d1 models followed with their own comparisons. Drex Max joined on JevStation on 2026-11-20: same System One contract, higher on the public Decision Index than Jev 1.14, $0.06 per million on OpenRouter. Try them below with a free account.

Try seven decision models free

Pick Liquid AI d1-ultra or d1, Microsoft-Decision-1, OpenAI Luna Decisions, Perplexity Decider, Jev or Clef-flash and edit the example. Sign up free to run it — 15 credits, no card.

Scenario

Route a ticket to the right team, rate its urgency and flag churn risk.

166 / 2,000

Edit freely — the model answers the scenario's questions about whatever you put here.

Model

Run any two side by side

Same input, same questions, two models at once: Jev, Clef, Clef-flash, Perplexity Decider, OpenAI Luna Decisions, Microsoft-Decision-1, and Liquid AI d1-ultra and d1. You see where the answers agree and what each one cost.

Scenario

166 / 24,000
This comparison costs 2 credits.

What each model costs for your workload

Token counts come from our own calls (2026-10-07 to 2026-10-25), not from the vendors. Liquid AI d1 / d1-ultra read the state once per question, so their cost grows with the number of questions.

  • JevTypeSafe · $0.042 / M input

    Direct, per month
    $2.66
    On JevStation, per month
    $137.10
    Input tokens / call
    634
    Credits / call
    1
  • Clef-flashCloudflare · $0.09 / M input

    Direct, per month
    $5.53
    On JevStation, per month
    $137.10
    Input tokens / call
    614
    Credits / call
    1
  • ClefCloudflare · $0.24 / M input

    Direct, per month
    $14.74
    On JevStation, per month
    $270.30
    Input tokens / call
    614
    Credits / call
    2
  • DeciderPerplexity · $0.02 / M input

    Direct, per month
    $0.83cheapest
    On JevStation, per month
    $137.10
    Input tokens / call
    413
    Credits / call
    1
  • Luna DecisionsOpenAI · $0.10 / M input

    Direct, per month
    $6.84
    On JevStation, per month
    $137.10
    Input tokens / call
    684
    Credits / call
    1
  • Decision-1Microsoft · $0.042 / M input

    Direct, per month
    $1.47
    On JevStation, per month
    $137.10
    Input tokens / call
    350
    Credits / call
    1
  • d1-ultraLiquid AI · $0.042 / M input

    Direct, per month
    $3.66
    On JevStation, per month
    $270.30
    Input tokens / call
    872
    Credits / call
    2
  • d1Liquid AI · $0.02 / M input

    Direct, per month
    $1.74
    On JevStation, per month
    $137.10
    Input tokens / call
    872
    Credits / call
    1
  • Drex MaxNace.AI · $0.06 / M input

    Direct, per month
    $3.20
    On JevStation, per month
    $137.10
    Input tokens / call
    533
    Credits / call
    1

Estimates from token models fitted to our measured calls. Output tokens are free on all nine. Direct prices exclude any gateway fee; the JevStation column is the cheapest mix of one-time credit packs after the 15 sign-up credits.

New to the category? What is a System One model? explains how these models are trained, how they differ from a language model and where they fall short.

The five models at a glance

Every row says where its numbers come from: (vendor) is the company selling the model, (ours) is a call we made on 2026-10-07. The Decider column is v1.2, which replaced the v1 we first tested; its measured rows are from 2026-10-25.

JevClef-flashClefPerplexity Decider v1.2OpenAI Luna Decisions
Made byTypeSafeCloudflareCloudflarePerplexityOpenAI
LaunchedFirst of the five2026-10-012026-10-01v1 2026-10-02; v1.2 2026-10-16Previewed 2026-09-29
WeightsClosedOpen, Apache 2.0Open, Apache 2.0v1 open; v1.2 not listedClosed
Base modelNot disclosedQwen3.5-9BQwen3.8-27B27B; v1 on Qwen3.8 (vendor)GPT-6 Luna
List price, input$0.042 / M$0.09 / M$0.24 / M$0.02 / M$0.10 / M (OpenRouter)
Output tokensFreeFreeFreeFreeFree
Context~32k shared (vendor); 262k opt-in65k (vendor)65k (vendor)262k (vendor)1.05M (vendor)
ImagesOpt-in preview (vendor), not on JevStationYesYesYesYes
How the state is billedOnceOnceOnceOnce (v1: per question) (ours)Once
Median latency412 ms (ours)594 ms (ours)649 ms (ours)525 ms (ours)486 ms (ours)
Direct accessWaitlistSelf-serveSelf-serveSelf-serveLimited preview; OpenRouter
Credits on JevStation1 / 31 / 32 / 61 / 31 / 3
Try here, free creditsYesYesYesYesYes

Credits are standard / large: an evaluation is large above 8,000 characters of state or five questions. Our latencies are round trips from one machine to OpenRouter, so compare them with each other, not with vendor figures.

These are not the only decision models. OpenRouter has since added more System One endpoints, including Liquid d1 (on JevStation) and Nace.AI Drex Max (on JevStation from 2026-11-20). Others on the wider board — Upstage Solar Decide, Inception Mercury Decide, Bespoke Nimble — are covered in comparisons or notes where the licence and API allow.

What we measured

Same inputs, same questions, same endpoint (OpenRouter’s /api/v1/systemone), five models, two full runs that agreed with each other. Every question was zero-shot: one line of plain description per option, nothing tuned.

  • Banking77, card intents. 96 messages from the Banking77 test set across 12 intents that are easy to confuse: card arrival vs delivery estimate, lost vs compromised, declined vs not recognised. One 12-option Choice question.
  • AG News. 100 headlines and leads from the AG News test set, 25 per topic. One four-option Choice question.
  • Long state. One sentence asking to cancel a subscription, hidden at the start, 6,000 characters in, 12,000 characters in, or at the very end of 20,000 characters of neutral text, plus a control with no such sentence. One Noul question.
ModelBanking77 cards (96)AG News (100)Banking77 answers at ≥ 0.9 confidenceWrong at ≥ 0.99 confidence (of 196)
Jev86.5%91%81% of inputs, 94.9% right4
Clef-flash97.9%92%73% of inputs, 100% right0
Clef94.8%93%60% of inputs, 100% right0
Perplexity Decider v186.5%93%77% of inputs, 98.6% right1
Decider v1.2 ¹89.6%91%73% of inputs, 100% right1
OpenAI Luna Decisions90.5%89%69% of inputs, 98.5% right6

¹ Run on 2026-10-25 on the same inputs, after OpenRouter retired v1.

What stands out:

  • Clef-flash, the smallest model, was the most accurate on fine-grained intents. That matches Cloudflare’s own Banking77 claim, which until now nobody outside Cloudflare had checked.
  • The Clef models are the most cautious. They rarely go above 0.99 and were never wrong when they did. Luna Decisions and Jev often answer with a confidence of 1.00, and that is where their mistakes cluster: six of Luna’s errors and four of Jev’s came at 0.99 or above. If you plan to auto-act above a threshold, set it on your own labelled data per model.
  • OpenAI refused one input. The plain banking question “How do I freeze my account?” came back as an error, “OpenAI refused to answer”, in both runs. Plan for refusals as a failure mode; on JevStation the credit is refunded.
  • All five read the whole 20,000-character state. Every model found the cancel request even at the very end. On 2026-10-04 we had measured Clef on Cloudflare Workers AI reading only about the first 2,048 tokens. On 2026-10-07 it read everything, both through OpenRouter and when we retested Workers AI directly, so that cap is gone.

With about 100 examples per task, a difference smaller than roughly six points could be noise. Only Clef-flash’s lead on Banking77 is clearly outside it. This is a small sample, not a leaderboard.

The cost catch: some models bill the state once per question

The first Decider, v1, had the lowest list price on 2026-10-07 ($0.04 per million) but read the whole state again for every question. On 8,000 characters of text, one question used 1,392 input tokens, three used 4,192 and five used 6,985. Luna Decisions, for comparison, used about 2,000 for five questions on the same text.

Decider v1.2, which replaced it, reads the state once and costs $0.02 per million: the same five-question request is about 1,550 tokens, and it came to $0.0035 per thousand AG News calls on 2026-10-25, the cheapest of the multi-question options we have measured. Liquid AI’s d1 and d1-ultra, added on 2026-10-16, still bill per question (about 6,964 tokens for that five-question request). JevStation charges d1-ultra 2 credits for that reason; d1, at half its list price, Decider v1.2 and the one-pass models cost 1.

So the cheapest model depends on the shape of the request. Use the calculator above with your own numbers.

How to choose

  • Fixed intent lists, many similar labels: start with Clef-flash. It led our Banking77 run and costs 1 credit here.
  • One question per call at high volume: Liquid AI d1 or Perplexity Decider v1.2, the two cheapest per call in that shape.
  • Several questions on long text: Perplexity Decider v1.2, which reads the state once at $0.02 per million; Jev, Luna Decisions and Microsoft-Decision-1 also read it once.
  • You want the OpenAI model without waiting for preview access: Luna Decisions through OpenRouter or here. Expect occasional refusals.
  • The data cannot leave your machines: Clef or Clef-flash, open-weight under Apache 2.0. Decider v1 weights are open too; OpenRouter lists none for v1.2.
  • Cheapest per call at the Jev price, with strong confidence: Microsoft-Decision-1, added on 2026-10-10. It matched Jev on accuracy, used fewer tokens and was better calibrated; see Jev vs Microsoft-Decision-1. Azure rate-limits it more tightly.
  • The strictest confidence threshold: Liquid AI d1-ultra, added on 2026-10-16. Level with Jev on accuracy, never wrong in 41 answers at 0.99 or above, but it reads the state once per question; see Jev vs Liquid AI d1-ultra. Liquid’s claim that it ranks first on the Artificial Analysis Decision Index is its own.
  • Highest accuracy on our Banking77 / AG News panel among models we host: Nace.AI Drex Max, added on 2026-11-20 (91.7% / 94% against Jev 86.5% / 90% on 2026-11-20). Same one-pass contract at $0.06 per million, slower latency; see Jev vs Drex Max.
  • You need a confidence you can threshold safely: test calibration on your own data; in our run the Clef models were the most conservative.

The deciding test is still your data. Paste twenty real inputs into the side-by-side runner above, run two models at once and compare the answers with what you know is right.

More comparisons

Sources

JevStation is independent. Jev, Clef, Decider and GPT-6 Luna are names of their respective owners, TypeSafe, Cloudflare, Perplexity and OpenAI; we are not affiliated with any of them.

Frequently asked questions

What is a decision model?
A model that returns a typed answer instead of text: a choice from options you list, a level on a rubric you define, or the probability that a statement is true. You send the content as a state and the questions as a schema, and you get back probabilities your code can threshold. TypeSafe calls the category System One; OpenAI calls its version the Decisions API.
Which decision model is the most accurate?
It depends on the task. In our run on 2026-10-07, Clef-flash scored 97.9% on 12 confusable Banking77 card intents, ahead of Clef (94.8%), OpenAI Luna Decisions (90.5%), Jev and Perplexity Decider v1 (86.5% each). On four-way AG News topics all five were within 89–93%. Decider v1.2, rerun on 2026-10-25, scored 89.6% and 91%. With about 100 examples per task, differences under roughly 6 points are within noise.
Can I use the OpenAI Decisions API without the waitlist?
OpenAI’s own Decisions API was still in limited preview when we checked. OpenRouter has served the same model as openai/gpt-6-luna-decisions since 2026-10-06, and JevStation runs it through OpenRouter: 1 credit per standard evaluation, and the 50 free sign-up credits cover it.
Which decision model is the cheapest?
For a single question per call, Liquid AI d1 in our tests: $0.02 per million input tokens, about $0.002 per thousand AG News calls. With several questions, Perplexity Decider v1.2: the same $0.02 per million, but it reads the state once, so a five-question call on an 8,000-character text used about 1,550 tokens, against about 7,000 for d1, which reads the state again for every question. Microsoft-Decision-1 ($0.042 per million, also one pass) is next. The earlier Decider v1, retired in October, cost $0.04 per million and billed the state once per question.
Are the request formats compatible?
Yes. All five accept the same state plus Choice, Score and Noul questions and return answers in the same shape when called through OpenRouter’s System One endpoint or JevStation. Switching models is a change to one model field.
Do decision models replace LLMs?
No. They cannot write, summarise or reason in prose. They replace the LLM call you use as a classifier, router, judge or guardrail, where the possible answers can be listed in advance.

Related

Make it part of your pipeline

Sign up for 15 free credits, save your own question sets and call the same evaluation from the API.