Sort the easy feedback with a small model and escalate only the hard cases overnight
The small model labels the feedback it's sure about; only sarcasm, backhanded praise and minor-language items go to the large model overnight.
- How it works
- Every review, ticket and survey answer goes first to the small model, which labels the ones it is confident about — the clear majority — and hands them straight to your spreadsheet. What it is unsure about, it sets aside instead of guessing: sarcasm, backhanded praise, a complaint in a minor EU language. That residue is queued and read overnight by the large model on ml2, the machine with the bigger card — the model is far too big to sit on a graphics card, so its bulk rests in slower system memory and only a small part of it works on any one word, which is why it runs as an overnight batch and not while anyone waits. The whole point of the two tiers is cost: the expensive model only ever sees the hard residue, which is what makes running it affordable at all.
- Data you need
- The same feedback exports as the rest of this group — reviews, tickets, survey answers as text — plus your label codebook and a rule for what counts as "unsure", usually the small model's own low-confidence items with whole categories like a named minor language added by hand. It fails when there is more residue than a night can hold: a vague codebook, or a pile of feedback that is mostly in a language the small model reads poorly, sends most of the pile to the overnight queue until it no longer finishes by morning and the saving disappears. Feedback that arrives only as screenshots or scanned cards has no text to read and is skipped by both tiers.
- What to expect
- Where the small model is genuinely confident its labels are as good as running it alone, and the overnight pass lifts quality on exactly the items a lone small model would have quietly mislabelled. The routing is the weak point: the small model does not always know when it is wrong, so a sarcastic review it misreads with confidence gets a firm wrong label and never reaches the large model at all. A flat "well, it eventually turned up" is filed as praise by the first tier, the large model never sees it, and no one queries it — the error is invisible precisely because the small model was sure. And because the hard items wait for the overnight run, nothing here happens while you wait: an urgent safety complaint hiding in the ambiguous pile is not seen until the next morning, so this must never be your safety or legal routing path, which stays live and separate.
- Where people stay involved
- A person owns the codebook and the confidence threshold that decides what escalates — set it too tight and the large model drowns, too loose and the hard items sail through mislabelled. Spot-check both piles, not only the escalated one, because the failures that cost you are the items the small model was wrongly sure about. Never let this pattern carry safety, legal or money decisions: its whole design holds the hard cases back to overnight, which is the opposite of what those need.
Which model, and what it costs to run
Qwen3-235B-A22B-Instruct-2507
No public benchmark ranks this job on our roster — reading a whole document and reasoning across it is exactly what the current long-context tests fail to predict. A job this hard starts from a large model, and we prove it on your own material before anything ships.
- Licence
- Apache-2.0
- Weights at 4-bit
- 132 GB
- Context
- 256K tokens
- Publisher
- Alibaba (Qwen Team)
What the hardware costs
One 141 GB card holds it
- Rent in the EU
- $4.50/hrNebius, Finland (eu-north1)
- Buy the card
- $29,500new, one-off
- Or rent it by the token
- $0.1 / $0.3per M in / out · Nebius AI Studio · EU
Hardware only, third-party prices from 2026-07. The figure excludes the KV cache, which grows with context length and how many people use it at once — sized properly in a conversation, not guessed here. Renting by the token is cheaper up front; why our customers still self-host is below.
Sticking to the document
Measured on public documents, by a model acting as judge. Read it beside the answer rate: the lowest hallucination rates on this board belong to models that simply decline more often.
Independent measurement · Vectara · board updated May 11, 2026
The API is cheaper per token. Here is why our customers don't use it.
We will not pretend otherwise: renting a model by the token from a serverless API costs less per million tokens than a card we run for you. We show that price on every use-case page. What it does not include is the part a shop with a customer database actually pays for.
- 01
Your data never leaves hardware you can point at
A serverless "we don't retain your data" is a clause in a contract. Running the model on a card in Amsterdam is a fact of architecture: your catalogue, tickets and customer records are never sent to a third party at all. For a GDPR audit, that is the difference between a promise and a floor plan.
- 02
The price cannot move without your say-so
A serverless rate card is somebody else's lever. The provider can raise the price, retire the model, or change the terms, and your cost moves with it. The same model on the same card costs the same next year — you own the number.
- 03
The model cannot be taken away
Hosted APIs deprecate models on their own schedule; the one you built on can be gone in a quarter. An open-weight model on your own hardware runs for as long as you keep the lights on. No vendor can end-of-life it out from under you.
And the price gap closes with volume: past a card you keep busy — very roughly four billion tokens a month — owning is cheaper outright, even before the three reasons above.
Getting a case like this one from a conversation to production takes about two months, and you can stop at the end of any phase.
Also in voice of customer
All 15 →Turn a quarter's worth of product reviews into a short themes report
Turns exported product reviews into a short plain-language themes report, with every claim linked back to actual review text.
Tag every review and ticket with your own fixed label list, so you can finally count things
Applies your own fixed label list to every review, ticket or survey answer, turning free text into a column you can pivot and chart.
Summarise what your NPS promoters and detractors actually wrote
Summarises the free-text answers behind your NPS score, band by band — what promoters praise and detractors cite, backed by direct quotes.
A Monday-morning digest of what customers complained about last week
A one-page weekly digest of support tickets — top issues, movement against last week, anything unusual — in the inbox before Monday stand-up.
Next
Tell us what your team does by hand
Describe the process that takes the most time. We will say plainly whether a model is the right tool for it.