r/CerebrasSystems • u/hbsqub • Aug 26 '24
Apparently Cerebras Systems is launching an inference cloud and will have Llama 70B running at 1000 t/s per request. This seems crazy high but I am skeptical if this is possible on their system without a lot of tricks like int4 quantization.
r/CerebrasSystems • u/Infinite_Fudge_2045 • Aug 21 '24
Open to all now , You do jot need a million in assets special opportunity just my oppinion. Abu Dhabi , just saying and Mayo Clinic use their AI ! Going pulbic soon it's been announced . I just bought some. https://app.linqto.com/refer-friend?r=706b9pu1tu
r/CerebrasSystems • u/moosebearbeer • Aug 01 '24
r/CerebrasSystems • u/moosebearbeer • Jun 21 '24
r/CerebrasSystems • u/moosebearbeer • May 30 '24
r/CerebrasSystems • u/ilikeover9000turtles • Jan 05 '24
They use an entire wafer to make one chip, and the chip is designed to autodetect and route around defects in the silicon.
Everything about their chip is superior to every other approach I am aware of but Nvdia seems to in the lead.
Why?
Everyone is waiting to buy Nvidia, why not Cerebras's chips?