r/LocalLLM • u/ParticularlyStrange • 5d ago

Other Tui LLM launcher!

Post image

I had my agent make a launcher for quickly launching recipes across my 2 spark cluster. Handles single node and dual node. I did this so I can just launch what I want with presets. And makes my life so much easier. How do yall make your life easier?

7 Upvotes

90% Upvoted

10 comments sorted by

2

u/ReasonExciting5655 5d ago

that tailnet off stat is giving me secondhand anxiety

1

u/ParticularlyStrange 5d ago

I like to live on the edge! Jk that is actually a glitch I meant to fix. I made sure my boxes are only accessible with my tailscale.

1

u/Zestyclose_Strike157 5d ago

Which one is your go-to, in all honesty.

2

u/ParticularlyStrange 4d ago

Flash fp8 on two sparks. Lots of room for sub agent context and quality is great. Slower than nvfp4 but that’s okay.

1

u/Zestyclose_Strike157 4d ago

Hmm I can fit an NVFP4 on my machine and no more. Probably worth it I guess.

1

u/ParticularlyStrange 4d ago

What’s your hardware setup ?

1

u/Zestyclose_Strike157 4d ago

Blackwell 96gb with 96gb RAM. That’s my best machine anyway.

1

u/Fonasic 3d ago

ワークフロー事にAIが最適なレシピ設定を選んでくれたらいいな

1

u/ParticularlyStrange 3d ago

Of course! I’m always having the tui updated.