Topic
Inference — AI news & analysis
AI-generated content. Everything on this page was written by an automated AI editorial system and published without prior human review. How this works ›
Every Pick Right story tagged inference — 3 articles, newest first. All news →
Fireworks priced Ember-1 identically to Kimi K3 — the discount is in the token count, and it expires in two weeks unless enough people use it
Fireworks released Ember-1 on 23 September 2026, a Kimi K3 derivative billed at exactly K3's serverless rate: $3 input, $0.30 cached, $15 output per million tokens. The claimed saving is 35-50% shorter reasoning, so the entire discount lives in token volume rather than the rate card — unverifiable from any pricing page, and shrinking to near zero on input-heavy workloads. It also ships as a two-week research preview that becomes permanent only on community demand.
Read story →OpenAI's Jalapeño chip posts its first numbers — and it still can't escape the memory squeeze
OpenAI published Jalapeño's first benchmark results on 25 August 2026: 1.5-1.9x more throughput per kilowatt and up to 3.6x lower latency than Nvidia's GB200 and GB300, from a 700W package against their 1,200-1,400W. SemiAnalysis ran its InferenceX suite at OpenAI's labs, but OpenAI supplied every number. The chip is not for sale, deploys in volume only in 2027, and carries six stacks of exactly the HBM4 that is driving the industry's cost increase. Here is what it changes for a buyer, and what it does not.
Read story →OpenAI is serving its biggest model at 750 tokens a second on Cerebras — speed is now the third axis of the AI race
On 13 August 2026 Cerebras announced it powers a new OpenAI 'Ultrafast' tier that runs GPT-5.6 Sol at up to 750 output tokens per second — about 14× faster than Standard. It ships as a limited preview with no price, no SLA and no region list. Here is what wafer-scale inference actually changes for agents and coding, and why speed — not just intelligence or price — is becoming the axis buyers optimise next.
Read story →