EDITION № 6 · EVENING ← FRONT PAGE

The INDIE PRESS

News · 2026-09-04

Cerebras' fast Qwen model burns cash before it finishes

Cerebras is running Qwen 3.8 27B at 1500 tokens per second, but a rate limit and no prompt caching mean testers hit their spending cap before the model finishes a task.

Synthesized from 5 sources · Confidence: Medium · Written by machines, edited by one human

Cerebras has put Qwen 3.8 27B on its inference service at 1,500 tokens per second, according to the company's own model documentation. Commenter gpugreg tried it on a coding task and hit the platform's token limit in about 90 seconds, spending $1.10 in the process. Running the same task on DeepSeek-V4-Flash finished in 172 seconds for $0.024, with a final context window of 55,217 tokens. Qwen 3.8 27B, by contrast, was still not done at a 64,178 token context window when gpugreg's run ended.

Part of the problem is what counts against the limit. gpugreg says cached tokens count toward the per-minute cap, which is what burns through it so fast. Commenter nostrebored gives a different number for the same cap, 150,000 tokens per minute on the public endpoint, and says that's too low for many coding tasks. Cerebras did not explain the discrepancy in the source material.

On quality, the comments split. gardnr, who used Cerebras' coding plan for months, calls Qwen 3.8 27B "likely one of the strongest models they've hosted so far" and says the speed changes how it feels to use. ecshafer, running the same model self-hosted, says the opposite: used agentically, it "will spin around in circles on even small tasks talking to itself until it loses context and starts again," and at one point told the user it had forgotten their original question.

gardnr also asks whether Cerebras has added prompt caching yet, saying its absence made agentic coding expensive in past use. Nobody in the thread answers. Separately, nostrebored says their account was switched to an enterprise tier that blocks self-serve billing, with the message "Self-serve billing is not available on Enterprise accounts. Please contact your team for further questions," despite having no team on the account after being removed from Cerebras' Slack channel.

Whether prompt caching arrives, and at what price, is the question gardnr's comment leaves open. Until it does, the fastest model on the board may also be the one that costs the most to actually finish a job.

HN, 608 pts, 202 comments ↗ HN comment · nostrebored ↗ HN comment · gardnr ↗ HN comment · gpugreg ↗ HN comment · ecshafer ↗
The Discourse - what the threads are actually arguing
There is a limit of 450,000 tokens per minute. I hit this limit in about 90 seconds and burned through $1.10... This is a very efficient way to burn your money, but I would not recommend it
- gpugreg · 5 REPLIES · AGAINST - COST/RATE LIMITS · THREAD ↗
It is genuinely difficult to keep up with the models. The output is so fast. Qwen 3.8 27B is likely one of the strongest models they've hosted so far.
- gardnr · 5 REPLIES · FOR - SPEED/QUALITY · THREAD ↗
I have a self hosted Qwen 3.8 27B and I find it to be unusably bad. Using it agentically, it will spin around in circles on even small tasks talking to itself until it loses context and starts again.
- ecshafer · 5 REPLIES · AGAINST - MODEL QUALITY · THREAD ↗
150k TPM limit on public endpoint means that it's likely unusable for many coding tasks... it seems like our account has gotten moved to some limbo where we can no longer add billing information.
- nostrebored · 7 REPLIES · AGAINST - ACCOUNT/ACCESS ISSUES · THREAD ↗
Why do they only host small models rather than the 2.4T version? Is the I/O and interconnect between the wafers bad due to the limited beachfront relative to the massive size of the chip?
- porphyra · 3 REPLIES · ASKS THE REAL QUESTION · THREAD ↗