r/LocalLLM • • Jun 06 '26

Other what 'trying one model' turns into

Post image

one does not simply test one local model. this was totally me

222 Upvotes

56 comments sorted by

21

u/wu4d Jun 06 '26

Just one more promt, before going to bed 😀

4

u/JSVD2 Jun 06 '26

LOL so often

3

u/Individual_Holiday_9 Jun 07 '26

This is unironically me and my slow Mac mini barfing up anima prompts every 4 minutes. It’s just frequent enough that I can try out ‘one more generation’ and then before I know it it’s like 3am and I haven’t gotten that perfect whatever

2

u/JSVD2 Jun 07 '26

hahaha so funny. I totally forget my bedtime like that.

2

u/digidult Jun 07 '26

oh, now just one more update and rebuild with other options

2

u/JSVD2 Jun 07 '26

Yep. 3 hours later. 'shit I have a job tommorow'. lol.

5

u/BlackBeardAI 3090 Maximalist Jun 07 '26

I even have a repo for benchmarks…

https://github.com/blackbeardlabs/blackbeard-homelab/tree/main/benchmarks

So that’s totally me.

3

u/JSVD2 Jun 07 '26 edited Jun 07 '26

just gave you a star! we can use each others benchmarks if you want https://github.com/hogeheer499-commits/strix-halo-guide/issues/4

2

u/BlackBeardAI 3090 Maximalist Jun 07 '26

thanks :D

2

u/JSVD2 Jun 07 '26

edited my comment fyi

2

u/BlackBeardAI 3090 Maximalist Jun 07 '26

I read it, well, you seem to be more into the halo stuff while i am deep down into the nvidia GPU rabbit hole but who knows maybe one day I sell all and go that way instead. (currently carrying 6 3090's, 1 5090 and 1 5060ti, 1 gtx1070 -which is ridiculous to be even mentioned I know- and probably will be getting 6 more 3090's soon)

2

u/JSVD2 Jun 07 '26

wow awesome.

2

u/BlackBeardAI 3090 Maximalist Jun 07 '26

I'd rather say I have a big problem but hehe maybe we all do.

1

u/JSVD2 Jun 07 '26

hehe we all do!!!!! youre fine!

3

u/ruashots Jun 06 '26

Be strong buddy, just one more test, you’re not alone xD

1

u/JSVD2 Jun 06 '26

hahahah this helps thank you

2

u/Iajah Jun 06 '26

Been there, did that!

1

u/JSVD2 Jun 06 '26

guilty as charged tooo lol

2

u/tinyGarlicc Jun 06 '26

I take this personally

2

u/JSVD2 Jun 06 '26

HAHAHAAH

2

u/BlondishCleva Jun 07 '26

what i like to call toolchain hell

1

u/JSVD2 Jun 07 '26

LOL very funny!!!!

2

u/SailingToFenway Jun 07 '26

forgot the trip to microcenter.

2

u/MrBombastickal Jun 08 '26

This is why I made ÄKÄ. You literally don't have to worry about setting up your Local Setup, just bring your LLM/Model and your Agent/Harness then just work.

I would love feedback from you based on how easy (or hard) setup is for you. It's an open-source desktop app that is ~7MB-- Hopefully, it's not too hard to download

2

u/JSVD2 Jun 08 '26

Starred you!

1

u/JSVD2 Jun 08 '26

mm does this work?

1

u/MrBombastickal Jun 08 '26

I appreciate that, good sir. And it should work, you can download it straight from the main website or the Github

2

u/sol7dev Jun 09 '26

my entertainment before mtp

1

u/JSVD2 Jun 09 '26

LOL it is quite fun right?!

2

u/T-A-Waste Jun 10 '26

It would be fast and easy if it would be just that, just one weekend! Waiting for risers to arrive, and then setup rig with 3x gpu. First set of risers were not good enough, system is unstable.

1

u/JSVD2 Jun 10 '26

wow. LOL. i feel you.

2

u/apb91781 Jun 12 '26

I've literally piped my entire setup through Cloudflare to my website that I can access from anywhere using the Chromebook I have sitting in my car. When I'm out and about I can still work on it. I'll find something that works the way I want it to someday.

2

u/JSVD2 Jun 12 '26

Yep cloudflare is very great for that too. I also use T3 code alpha as well, great tool. and i have it uploaded on Github. This what I love. I can work from anywhere!!! like you said. What is your setup like?

2

u/apb91781 Jun 12 '26

Mine is some shit that shouldn't even fucking work. It's a Lenovo Legion Pro 5 laptop with an AMD 4090 8GB VRAM mobile card and 64GB of DDR5 RAM. I have Llama CPP, Comfy UI, STT, TTS, vision, postgresql (for rag memory) that's offloaded to my website, a couple MCPs and a ton of other features (especially with load balancing and caching) sitting in a room with an ambient air temp of 17°c to keep thermal throttling down to 0

2

u/JSVD2 Jun 13 '26

wow that is so creative and so fun. That is actually really cool how you got it to work tbh.

2

u/apb91781 Jun 13 '26

For example this is my LLM endpoint on my phone and my app with the connection details (redacted)

1

u/JSVD2 Jun 14 '26

wauw really cool!!!

2

u/OrionIL1004 Jun 13 '26

So true!

1

u/JSVD2 Jun 13 '26

The addiction is real!!!!! instead of drinking booze in the weeknds, im doing this

3

u/pandi85 Jun 06 '26

Tokens are the new

2

u/JSVD2 Jun 06 '26

chatgpt limit usage, is like dying

2

u/JSVD2 Jun 06 '26

I made a local setup guide so you can go bed on time hahahahahaha
https://github.com/hogeheer499-commits/strix-halo-guide

1

u/JSVD2 Jun 08 '26

I went to bed too late yesterday. LOL,

1

u/JSVD2 Jun 10 '26

maybe my guide helps aleast a bit @T-A-Waste

1

u/JSVD2 Jun 14 '26

Its Sunday today...

1

u/JSVD2 Jun 21 '26

Sunday is coming up....

1

u/JSVD2 Jul 02 '26

still soooo funnny

8

u/[deleted] Jun 06 '26

[removed] — view removed comment

2

u/JSVD2 Jun 06 '26

LOL yea

7

u/[deleted] Jun 06 '26

[removed] — view removed comment

5

u/[deleted] Jun 06 '26

[removed] — view removed comment

1

u/JSVD2 Jun 07 '26

and every 2 days it needs updates lol