Jev vs Drex Max: a higher-accuracy System One model at $0.06 per million

Nace.AI’s Drex Max is on OpenRouter as nace-ai/drex-max. It takes the same System One request as Jev — a state plus typed Choice, Score and Noul questions — and returns calibrated probabilities without generating text. In our run on 2026-11-20 it beat Jev on accuracy (91.7% against 86.5% on Banking77 card intents, 94% against 90% on AG News), used fewer tokens despite a higher list price ($0.06 against $0.042 per million), and was slower. On JevStation both cost 1 credit standard and 3 large.

自分のテキストで試す

例を編集し、無料登録すると実行できます。15 クレジット付き、カード不要です。

シナリオ

チケットを適切なチームに振り分け、緊急度を評価し、解約リスクを検知します。

166 / 2,000

自由に編集できます。ここに入力した内容について、選んだモデルがシナリオの質問に回答します。

モデル

Jev の実際の出力

上の例に対する未編集の出力で、本番 API から取得したものです。

Hi, I've been trying to connect my Stripe account for 3 days and it keeps failing with 'invalid redirect'. I'm losing sales every hour this is down. Please help ASAP.

category

choice

Which team should handle this support ticket?

integrations

  • integrations99%
  • billing1%
  • bug0%
  • account0%

信頼度 99%

urgency

score

How urgent is this ticket?

3.73/4Critical
  • 4 · Critical73%
  • 3 · Urgent27%
  • 0 · Can wait0%
  • 1 · Normal0%
  • 2 · Soon0%

信頼度 77%

churn risk

noul

Is the customer at risk of churning?

はい80%
はい 80%いいえ 20%

2026-10-09 取得 · 0.89 秒 · jev-1.13.0

At a glance

(vendor) is the company selling the model; (ours) is a call we made through OpenRouter on 2026-11-20.

JevDrex Max
Made byTypeSafeNace.AI
Model id~typesafe/jev-latestnace-ai/drex-max
WeightsClosedOpen RAIL-style for some releases (vendor)
List price, input$0.042 / M tokens (vendor)$0.06 / M tokens (vendor)
Output tokensFreeFree
Context~32k shared; 262k opt-in (vendor)262k (vendor)
ImagesOpt-in preview (vendor), not on JevStationYes on the API; text only on JevStation
How the state is billedOnceOnce (ours)
Input tokens, our fit≈ 260 + 0.163 × characters + 43 × questions≈ 0.163 × characters + 96 × questions
Median latency (Banking77)367 ms (ours)703 ms (ours)
Banking77 card intents86.5% (ours)91.7% (ours)
AG News topics90% (ours)94% (ours)
Credits on JevStation1 / 31 / 3

Credits are standard / large; an evaluation is large above 8,000 characters of state or five questions.

Accuracy and calibration

We sent both models the same labelled inputs, zero-shot, with one line of description per option. The method is on Decision models compared.

TaskJevDrex Max
Banking77, 12 card intents (96)86.5%91.7%
AG News, 4 topics (100)90%94%
Banking77: answers at ≥ 0.9 confidence78% of inputs, 96% right82% of inputs, 100% right
Expected calibration error, Banking770.0580.078
Expected calibration error, AG News0.0650.045

Drex Max leads on both accuracy tasks. On Banking77 its high-confidence band was cleaner: every answer at 0.9 or above was correct. ECE is mixed — worse on Banking77, better on AG News — so set thresholds on your own labels.

Both models found a single cancel request hidden anywhere in about 20,000 characters of neutral text (Drex Max 0.998 at the very end, control 0.0003).

Tokens, latency and cost

The list price favours Jev ($0.042 against $0.06), but the bill follows the token count. Drex Max counts fewer tokens for the same request and, like Jev, reads the state once. We fitted it on nine requests (state of 100, 2,000 and 8,000 characters, with one, three and five questions):

RequestJev tokensDrex Max tokensCheaper at list price
1 question, short ticket (~300 chars)~350~140Drex Max
3 questions, 1,500 characters~640~530close
5 questions, 8,000 characters~1,780~1,780Jev (lower $/M)
12 rich questions, 24,000 characters—8,927 (ours)—

On the AG News sample, mean input tokens were 176 for Drex Max against 412 for Jev, so per thousand calls at list price Drex was about $0.011 against Jev’s $0.017.

Latency favours Jev: Banking77 p50 367 ms against 703 ms for Drex Max, p90 395 ms against 1,033 ms.

When to pick which

  • Highest accuracy on our Banking77 / AG News panel among models we host: Drex Max.
  • Lowest latency: Jev.
  • Lowest list price among one-pass models we host: Perplexity Decider v1.2 at $0.02 / M, then Jev / Decision-1 at $0.042.
  • TypeSafe tooling and the original System One product: Jev.
  • Open weights under Apache for self-hosting: Clef / Clef-flash.
  • Commercial use of a top Nimble checkpoint: not Nimble v4.1 Max (CC BY-NC); use Drex Max or another commercial model instead.

Try both

Run Drex Max above with a free account (50 credits, no card), or use the side-by-side runner to send the same text and questions to Jev and Drex Max at once. The pricing calculator shows the cost of each for your own numbers.

Sources

  • Drex Max model, price and context. OpenRouter model page (vendor)
  • Nimble licence (non-commercial). Hugging Face Nimble-v4-max (vendor)
  • Jev price and context. TypeSafe model docs (vendor)
  • Accuracy, calibration, latency and token counts. Our runs through OpenRouter on 2026-11-20 (ours)

JevStation is independent. Jev and Drex Max are names of their respective owners, TypeSafe and Nace.AI; we are not affiliated with either.

よくある質問

Is Drex Max a drop-in replacement for Jev?
For the request format, yes. Through OpenRouter’s Decisions / System One endpoint or JevStation it accepts the same state and the same Choice, Score and Noul questions and returns answers in the same shape. Switch models by changing one model field to drex-max.
Is Drex Max more accurate than Jev?
In our test on 2026-11-20, yes. Drex Max scored 91.7% on 96 Banking77 card-intent messages against Jev’s 86.5%, and 94% against 90% on 100 AG News articles. Gaps of about five points on samples this size are outside typical noise. Confirm on your own labelled data.
Is Drex Max better calibrated than Jev?
On Banking77 every answer at 0.9 confidence or above was right (79 of 79), against 96% for Jev. Expected calibration error was a little worse for Drex (0.078 against 0.058). Treat confidence as a sign, not a guarantee, and check on your own data.
How does Drex Max compare to Bespoke Nimble?
Nimble v4.1 Max has posted higher Decision Index scores in some editions, but it is CC BY-NC 4.0 and cannot be used commercially. Drex Max is the commercial path we wire into JevStation. See [Bespoke Nimble vs Drex](/blog/bespoke-nimble-vs-drex).
What does Drex Max cost on JevStation?
1 credit for a standard evaluation and 3 for a large one, the same as Jev. List price on OpenRouter is $0.06 per million input tokens. Because it counts fewer tokens than Jev on the same requests, per-call cost at list price was lower in our AG News sample ($0.011 against $0.017 per thousand).

関連

パイプラインに組み込む

新規登録で 15 クレジットを無料進呈。独自の質問セットを保存し、同じ評価を API から呼び出せます。