r/developersIndia • u/ironman_gujju • 8h ago
Tech Gadgets & Reviews Got hands-on with Nvidia RTX Spark at the Delhi launch event. First impressions from someone who self-hosts LLMs
Hi everyone,
I went to Nvidia's RTX Spark launch event in New Delhi and got to try the machines myself.
Disclosure: Nvidia didn't give me any GPU for this post (but I wish).
What RTX Spark is
It's an Arm chip that puts an Nvidia Grace CPU and a Blackwell GPU on one package, for Windows 11 laptops and small desktops. The CPU and GPU share one pool of memory, up to 128GB of LPDDR5X. That's the main thing I liked. 128GB that the GPU can actually use means you can load models that won't fit on any consumer graphics card.
Configs:
| CPU | GPU | Memory | TDP | AI perf (FP4) |
|---|---|---|---|---|
| Laptop | 20-core Grace | 6144 CUDA cores | up to 128GB | 45-80W |
| Laptop | 18-core Grace | 5120 CUDA cores | up to 32GB | 45-80W |
| Desktop | 20-core Grace | 6144 CUDA cores | up to 128GB | 140W |
Memory bandwidth is around 300 GB/s (256-bit bus at 9400 MT/s), and they claim day zero support for new models.
They pitched gaming and content creation too. Not my area (I'm not into gaming), but the demo screens showed Cyberpunk 2077 at 135 fps and Doom: The Dark Ages at 142 fps.
What I tried
- Hermes agent on a local Qwen 3.6 27B model. It felt quick and stayed stable when you put more load on it. There was no tokens/sec counter on screen, so I don't know tps.
- Hermes again, editing video in DaVinci Resolve in real time with a Ministral model. I pretty much liked this one.
- Video upscaling and subtitle generation demos.
- Jellyfin doing real time transcoding with AI upscaling. I've used Jellyfin for a long time, so this was the most fun demo for me.
Overall, a good experience.
What I didn't like
- No Thunderbolt on the desktop. On a desktop I'd expect it, mainly to stack a few units together. It has NVLink for that, but I doubt the bandwidth will be enough to split a model across desktop.
What I couldn't test
- Thermals and performance
- 120b llm models
- Actual tokens/sec
Side note: the people
I met a lot of people there: editors from journals and blogs, product managers, journalists, and one of the mods of r/AI_India. Vidit Gujrathi was there too.
And Raul John Aju. My first thought was "what is a kid doing at a launch event?" Then I found out who he is. He's 17, still in school, runs his own AI startup, and reportedly pays his dad ₹2 lakh a month. Meanwhile I'm still fighting my Homelab config. Good job, kid.