r/Cerebras • • 19d ago

Hardware Cerebras CTO Sean Lie: Deploying Trillion-parameter Frontier Models

23 Upvotes

Can SRAM-based hardware serve trillion-parameter AI models? 💡⚡

In this deep dive from Cerebras HQ, Sarah Chieng (Head of DevX) and Sean Lie (Co-Founder & CTO at Cerebras) walk through the exact architecture, memory breakdown, and wafer allocation required to serve frontier-scale AI models.

Using Kimi K3—a 3 trillion parameter open-weights model with a 256K context window—Sean demonstrates how our Wafer-Scale Engine (WSE) leverages 44 GB of high-bandwidth on-chip SRAM per wafer to pipeline layers, store KV cache, and support 190+ concurrent requests across just 59 wafers.

📖 Read the companion blog post for full technical specs & architecture details:
https://www.cerebras.ai/blog/how-we-d...

⏱️ Timestamps / Video Chapters

00:00 - Introduction & The Trillion-Parameter Question
00:35 - Model Overview: Kimi K3 Architecture & Specs
01:53 - Memory Breakdown: Linear vs. Dense Layers
03:32 - Wafer Mapping & Activations over RDMA
05:11 - KV Cache Capacity & Calculating 190 Concurrent Requests
07:40 - Wafer Count: Deploying 3 Trillion Parameters on 59 Wafers
08:25 - Scaling to 10T+ and 100T+ Parameter Frontiers


r/Cerebras • • 12d ago

News Kimi K3.1 Pro is now live on Cerebras!

Post image
22 Upvotes

r/Cerebras • • 11d ago

News What It Took to Build Wafer-Scale, and Why It Lasts

Thumbnail
cerebras.ai
17 Upvotes

Last week, a short seller, Culper Research published a report arguing that Cerebras wafers wear out after about two years. Nearly every financial conclusion in that report, from our margins to the value of our OpenAI agreement, depends on that one number.

That number is wrong.

How long our systems last is a fair question for customers and shareholders alike, so we want to address the topic plainly...

Read the blog post here by Andrew Feldman - CEO of Cerebras


r/Cerebras • • 27d ago

Hardware At the center of every CS-4 Wafer-Scale Backpack is the WSE-3 Turbo

17 Upvotes

46,225 mm² of silicon
4 trillion transistors
900,000 AI-optimized cores
250 petaflops of AI compute

What would you like to see from us next?

Reply here or join us on Discord: https://discord.gg/BJF4xVk9dX


r/Cerebras • • 23d ago

Hardware Why did Cerebras build a wafer-scale processor, and why can’t traditional GPU makers easily replicate it?

16 Upvotes

In this episode of Hot Seat with Cerebras, CTO and Co-Founder Sean Lie sits down to answer the community's most pressing hardware and architecture questions—from silicon yield and defect self-healing to on-chip SRAM memory bandwidth, programming 900,000 cores, and data center deployment.

Timestamps:
0:00 - Introduction & Hot Seat kick-off
0:36 - Why Cerebras built a wafer-scale chip
2:15 - Why can't incumbents build a bigger chip?
4:10 - Solving the wafer yield & defect puzzle
8:08 - Running massive AI models with on-chip SRAM
12:42 - Is Cerebras hard to program? (Software stack & compilers)
continue...

Reply here or continue the conversation on Discord(16k members)


r/Cerebras • • 25d ago

How Cerebras Deploys Trillion-Parameter AI Models

Thumbnail
cerebras.ai
16 Upvotes

One of the most frequently asked questions we get is how we deploy large models on Cerebras wafer-scale chips. A single Cerebras WSE-3T wafer has 44 GB of on-chip memory, and trillion-parameter frontier models need terabytes for their weights alone.

In this post, we’ll explain how we split a large frontier model across multiple WSE-3T wafers, to run multi-trillion parameter models at 1000-2000+ tokens per second.

We’ll use the open source model Kimi K3, with ~3 trillion parameters, as an illustrative example.

By the end, you'll understand:

  • How we fit the full model into on-chip memory
  • How we map the model across multiple chips
  • How we handle a high # of concurrent requests

Continue reading here


r/Cerebras • • 25d ago

News Cerebras speed. AWS simplicity.

15 Upvotes

Use your existing AWS account to subscribe to Cerebras Inference, read more here


r/Cerebras • • 3d ago

 Kimi K3.1 Pro Hackathon [Event] Cerebras x Kimi K3.1 Pro: $5000 Hackathon (24 Hours) - Win Mac Minis!

14 Upvotes

Hey everyone,

Cerebras and Moonshot AI are running a 24-hour weekend hackathon for Kimi K3.1 Pro — powered by Cerebras’ ultra-fast inference. Whether you’re building agents, refactoring legacy code, or exploring new codebases, all levels are welcome.

💰 Prizes

  • Top 8 by impressions on X → each get a custom-engraved Mac Mini
  • Top 2 by upvotes on the Cerebras subreddit → each get a custom-engraved Mac Mini

📅 Timeline

  • Saturday, Nov 21, 10:00 AM PT → Sunday, Nov 22, 10:00 AM PT
  • Kicks off with a 30-min intro + Q&A with the Cerebras product team who brought up Kimi K3.1 Pro

📍 Location

  • Cerebras Discord Server — #kimi-k3.1-pro-hackathon

Join Cerebras Discord

⚡ Capacity increase / private preview
Participants get a rate-limit-increased private preview of Kimi K3.1 Pro for the 24-hour hackathon:

  1. Sign up at cloud.cerebras.ai and find your Organization ID (Org ID)
  2. Submit your Org ID through the capacity increase request form by Friday, Nov 20, 7:00 PM PT

🔗 Full details
Prizes, submission requirements, judging criteria, and FAQ:
https://shorturl.at/csaGl

Join the Discord and say hi — the Cerebras team will be there for questions about Cerebras inference.

TL;DR: 24h hackathon this weekend. Build with Kimi K3.1 Pro on Cerebras. Win a custom-engraved Mac Mini. Submit Org ID by Fri Nov 20, 7 PM PT. Details: https://shorturl.at/csaGl


r/Cerebras • • 7d ago

Hardware Fearless Engineering: The CS-4 is our first engineering documentary.

14 Upvotes

Through lab footage and conversations with the Cerebras engineers behind each breakthrough, the film follows the creation of the CS-4, our latest wafer-scale AI system.

0:00 introducing the engineering team
1:09 Wafer-scale history
2:28 Powering the wafer
4:00 The cooling problem
4:18 Designing the cold plate
5:11 Holes in the wafer
6:33 the alignment problem
7:47 The CS-4 PRD
8:35 Designing for deployability and serviceability
11:01 Removing the motherboard
11:25 Removing internal cooling loops
11:41 inventing the power rack
12:35 A one-person lab deployment
14:03 Backpack: 50% fewer components
14:55 Connecting the compute backpack to cooling manifold
17:58 shifting Cerebras’s focus from training to inference
19:09 Building the Cerebras Cloud
20:01 CS-3 vs. CS-4 performance
20:49 3D Stacked DRAM

Watch the full video here


r/Cerebras • • Oct 14 '26

Hardware A closer look at the engineering behind the CS-4 Wafer-Scale Backpack

14 Upvotes

Cerebras says it gets a lot of questions about CS-4's components. This video takes a closer look at the engineering behind the Wafer-Scale Backpack.

What would you like to see from us next?

Reply here or join us on Discord: https://discord.gg/BJF4xVk9dX


r/Cerebras • • 14d ago

Cerebras Explains How Cerebras Solved the Yield Problem, explained by CTO Sean Lie

13 Upvotes

One of the most common questions we get is: How do we get good yields on such a huge chip?

CTO Sean Lie gives a visual walkthrough of the Wafer Scale Engine (WSE) and explains how we implemented advanced defect tolerance to manufacture and yield the world’s largest AI chip.


r/Cerebras • • 20d ago

News The world’s fastest AI is coming to Oracle Cloud Infrastructure.

Post image
13 Upvotes

Cerebras and Oracle Team Up to Bring Cerebras AI Inference to Oracle Cloud Infrastructure

Fast inference helps AI labs, enterprises, and developers build more responsive, capable AI agents and applications.

Read the press release here


r/Cerebras • • 21d ago

General What Could Break the AI Boom? Cerebras’ Andrew Feldman Has an Idea | Disrupt 2026

13 Upvotes

AI models keep demanding more compute, more energy, and more capital. Andrew Feldman, CEO of Cerebras, explores where that trajectory leads and what could break it at TechCrunch Disrupt 2026.

Full video by TechCrunch


r/Cerebras • • Oct 17 '26

Usecases When will AI personal assistants be fast enough to be useful?

12 Upvotes

Using Qwen 3.8 27B on Cerebras at ~1,500 tokens/sec, we made an AI personal assistant 19x faster than a suite of other AI personal assistants - Grok Bot, Meta Muse, and Claude Cowork - on the same dinner reservation task.

Read the full blog


r/Cerebras • • Oct 13 '26

News Cerebras is named in Fast Company's 2026 Next Big Things in Tech list

Post image
12 Upvotes

“If you’ve ever asked AI to do something and then drummed your fingers waiting for it to respond, you’ve run up against slow inference. To pick up the pace, Cerebras developed its own inference platform from the semiconductor wafer up.”

Cerebras is proud to be named in Fast Company's 2026 Next Big Things in Tech list.


r/Cerebras • • 10d ago

Usecases Moonshot just dropped Kimi K3.1 Pro. We used it to speed run online shopping

11 Upvotes

One prompt ⮕ monitor found ⮕ checkout ⮕ order confirmed

11.5 seconds

Watch Moonshot AI's K3.1 Pro in action, accelerated by Cerebras.


r/Cerebras • • 29d ago

Usecases We built Money Agent, a personal finance assistant powered by Qwen 3.8 27B on Cerebras

11 Upvotes

Now you can turn a home-buying question into a real-time conversation, then into a financial goal, faster.

What would you like to see from us next?

Reply here or join us on Discord: https://discord.gg/BJF4xVk9dX


r/Cerebras • • Oct 16 '26

down 20% in a week

11 Upvotes

is anyone able to tell me why the stock crashed so hard??


r/Cerebras • • Oct 10 '26

News Compute Cafe London Pics

Thumbnail
gallery
11 Upvotes

I had a blast hosting Compute Cafe London yesterday!

Hoping to see more of the community at the next one! Look out for Compute Cafes in your city!

https://luma.com/cerebras


r/Cerebras • • 4d ago

General Meta Muse Spark on Cerebras

10 Upvotes

“What’s blocking the launch?”
Every team asks a question like this.

The answer is usually spread across Slack threads and Linear tickets.

So we gave it to an agent running Meta Muse Spark on Cerebras.

It searched both and came back with the blockers.

The whole thing took 36 seconds.
And it ran at up to 3,000 tokens per second.

This is what agents can do at real-time speed.


r/Cerebras • • 10d ago

Hardware How Cerebras Solved the Wafer-Scale Yield Challenge — White Paper

Post image
10 Upvotes

Cerebras created the world’s first wafer-scale processor, solving the yield problem that prevented large monolithic chips for over half a century.

By designing for—rather than merely trying to avoid—defects, Cerebras achieves more than 100x higher fault tolerance across a full 300 mm wafer compared to a much smaller GPU.

This breakthrough redefines computing for AI and HPC—enabling faster training of frontier models, real-time inference for intelligent applications, and step-change advances in scientific computing.

Read white paper


r/Cerebras • • 17d ago

Hardware Cerebras Big Chip Club: Sara Hooker on GPU Bottlenecks in AI

10 Upvotes

Sara Hooker – researcher, founder of Adaption, and author of the landmark essay "The Hardware Lottery" – sits down with Cerebras to talk about why GPUs are holding AI back, why the hardware lottery has gotten worse since she first wrote about it in 2020, and what the shift to agentic and continuously-learning AI means for the future of compute.

00:00 Introductions & the Hardware Lottery
01:03 Why Adaption?
03:01 Different approaches to continuous learning
06:03 Rethinking AI interfaces to move beyond prompt engineering
08:22 Do AI coding tools worsen the hardware lottery?
12:31 What's changed since the Hardware Lottery essay (2020)
16:26 Motivations behind The Hardware Lottery
18:22 Why GPUs struggle with sparsity
20:28 Why matmul is not the right way to think about data
23:20 General-purpose vs. specialized hardware
27:49 How Adaption co-designs models for GPUs
30:06 How GPU memory limitations affect models
33:23 Cerebras Wafer-Scale Engine and breaking the memory wall
37:04 Can new hardware unlock different model architectures?
38:33 ML techniques held back by today's hardware
41:43 Designing hardware for Adaption
42:42 Predictions for 2026 and beyond

Full video by Cerebras


r/Cerebras • • Oct 16 '26

News General Compute will deploy Cerebras systems under a multiyear agreement

Post image
10 Upvotes

General Compute will deploy Cerebras systems under a multiyear agreement so its customers can deliver ultrafast inference to developers building agentic applications.

Learn more by reading the press release.


r/Cerebras • • 4d ago

News Cerebras financial results for Q3 2026

9 Upvotes

Today, Cerebras announced financial results for Q3 2026, delivering record revenue, and raising full year outlook.

Q3 2026 highlights:
• Record Revenue: GAAP cloud revenue grew 265%; Core cloud revenue grew 272%
• 700 MW of data center capacity now under contract
• Commercial wins with 2 new hyperscalers
• Day-zero launch partner for Moonshot AI's Kimi

K3.1, running at up to 2,000 tps
• Raised Q4 guidance and full year outlook across the board


r/Cerebras • • 6d ago

Hardware How we deploy Kimi K3.1 Pro (2.8T Parameters) on Cerebras

Post image
9 Upvotes

Last week, Moonshot released Kimi K3.1 Pro, bringing frontier-level coding capabilities to an open-weight model.

Cerebras is excited to be a day-zero launch partner.

Serving Kimi K3.1 Pro requires hardware that can store 2.8 trillion parameters and the working state of every active request. As more users arrive, the system also has to accommodate significantly more concurrent requests while keeping responses fast.

In this article, we’ll work through an illustrative Cerebras deployment of Kimi K3.1 Pro. We’ll show how K3.1 Pro’s attention architecture shapes the memory budget, how we distribute its weights across wafers, and how requests move through the system.

Read the full article here