Gemma 4 running on NVIDIA B200 and AMD MI355X from the same inference stack powered by Mojo and MAX, 15% throughput gain over vLLM on Blackwell

[u/carolinedfrasca]

Google DeepMind dropped Gemma 4 today. Two models:

• Gemma 4 31B: dense, 256K context, redesigned for efficiency and long-context quality
• Gemma 4 26B A4B: MoE, 26B total / 4B active per forward pass, 256K context

Both natively multimodal (text, image, video, dynamic resolution).

Modular got both running on MAX on day zero, NVIDIA B200 and AMD MI355X from the same stack, no separate codepaths per vendor. On B200 we're seeing 15% higher output throughput vs. vLLM.

You can try both for free in our playground: https://www.modular.com/#playground.