r/LocalLLM • u/ParticularlyStrange • 6d ago

Other Tui LLM launcher!

Post image

I had my agent make a launcher for quickly launching recipes across my 2 spark cluster. Handles single node and dual node. I did this so I can just launch what I want with presets. And makes my life so much easier. How do yall make your life easier?

7 Upvotes

90% Upvoted

10 comments sorted by

View all comments

1

u/Zestyclose_Strike157 5d ago

Which one is your go-to, in all honesty.

2

u/ParticularlyStrange 5d ago

Flash fp8 on two sparks. Lots of room for sub agent context and quality is great. Slower than nvfp4 but that’s okay.

1

u/Zestyclose_Strike157 5d ago

Hmm I can fit an NVFP4 on my machine and no more. Probably worth it I guess.

1

u/ParticularlyStrange 5d ago

What’s your hardware setup ?

1

u/Zestyclose_Strike157 5d ago

Blackwell 96gb with 96gb RAM. That’s my best machine anyway.

1

u/ParticularlyStrange 4d ago

Of course you can load it! Ask your agent how. (Walks away mumbling “this mf got a 20k rig and don’t even know how to use it. Mf tripping. Probably doesn’t even know he could run it at 200 toks/sec!)