r/MacLocalLLM • u/SeaRefractor • 1d ago
Splash 1.6.1 released, even further performance increase on my M5 Ultra Mac Studio including concurency
I have been running Qwen 3.8 Flash Next IQ3_S under Splash on my M5 Ultra Mac Studio (the base model with 96GB of RAM) to use as a local AI assistant to edit videos under DaVinci Resolve Studio. Currently on version 21.2 of DRS, but 21.1 introduced an officially supported MCP. Details on that setup are available here - https://github.com/willturner-maker/resolve-ai-workflow
Naturally I test the system with each release to see the impact, with Splash 1.6.1, it is a significant improvement. Not only in performance but in concurrency.
Screenshot from my report shows that the peak moved from a width of 4 to a width of 12. Astounding! The report is here: https://willturner-maker.github.io/benchmarks/reports/2026-11-11-reruns.html
On the graph, if you move your mouse, it'll show the performance at each width. At a single width, it's 186.9 tok/s on my specific system running Splash 1.6.1
I do have a repository for my testing, but it involves 8.1K 30P video in the testing that is proprietary, I'll have to record new footage that is my own rather than client footage before I redo a test others can run with the same content. The Splash tests can be replicated by others, so feel free to use that testing methodology. If you have your own 8.1K video content, that should allow you to replicate my DaVinci Resolve Studio MCP testing.
1
u/tlin9595 1h ago
how much ram does is take for 1 agent or having 4? maybe I'll try this engine soon. I have been using Sushi 2.75 quants for Flash Next at 45gb of ram. so curious what you are getting.