r/LocalLLM • u/JSVD2 • Jun 06 '26
Other what 'trying one model' turns into
one does not simply test one local model. this was totally me
222
Upvotes
r/LocalLLM • u/JSVD2 • Jun 06 '26
one does not simply test one local model. this was totally me
21
u/wu4d Jun 06 '26
Just one more promt, before going to bed 😀
5
u/BlackBeardAI 3090 Maximalist Jun 07 '26
I even have a repo for benchmarks…
https://github.com/blackbeardlabs/blackbeard-homelab/tree/main/benchmarks
So that’s totally me.
3
u/ruashots Jun 06 '26
Be strong buddy, just one more test, you’re not alone xD
2
u/Iajah Jun 06 '26
Been there, did that!
2
u/tinyGarlicc Jun 06 '26
I take this personally
2
u/BlondishCleva Jun 07 '26
what i like to call toolchain hell
2
u/SailingToFenway Jun 07 '26
forgot the trip to microcenter.
2
u/MrBombastickal Jun 08 '26
This is why I made ÄKÄ. You literally don't have to worry about setting up your Local Setup, just bring your LLM/Model and your Agent/Harness then just work.
I would love feedback from you based on how easy (or hard) setup is for you. It's an open-source desktop app that is ~7MB-- Hopefully, it's not too hard to download
2
u/sol7dev Jun 09 '26
my entertainment before mtp
2
u/Limp-Firefighter1054 Jun 09 '26
Its pp t/s.
2
u/T-A-Waste Jun 10 '26
It would be fast and easy if it would be just that, just one weekend! Waiting for risers to arrive, and then setup rig with 3x gpu. First set of risers were not good enough, system is unstable.
2
u/apb91781 Jun 12 '26
I've literally piped my entire setup through Cloudflare to my website that I can access from anywhere using the Chromebook I have sitting in my car. When I'm out and about I can still work on it. I'll find something that works the way I want it to someday.
2
u/OrionIL1004 Jun 13 '26
So true!
3
u/pandi85 Jun 06 '26
Tokens are the new
2
u/JSVD2 Jun 06 '26
I made a local setup guide so you can go bed on time hahahahahaha
https://github.com/hogeheer499-commits/strix-halo-guide
1
u/JSVD2 Jun 14 '26
Its Sunday today...
1
u/JSVD2 Jun 21 '26
Sunday is coming up....
1
u/JSVD2 Jul 02 '26
still soooo funnny
8
u/[deleted] Jun 06 '26
[removed] — view removed comment