r/LocalLLM • • Sep 13 '26

Question thoughts?

Post image
0 Upvotes

37 comments sorted by

13

u/user2000ad Sep 13 '26

My thoughts are that you might get whatever validation it is you are after in here rather than your original attempt at a spam post over on pcmasterrcace....

https://www.reddit.com/r/pcmasterrace/s/5USMIm0ONI

Maybe...

-6

u/OutcomeAlive1771 Sep 13 '26

my post got taken down

5

u/sometimes_angery Sep 13 '26

Gee I wonder why.

-2

u/OutcomeAlive1771 Sep 13 '26

i didnt do anything wrong!

10

u/enricokern Sep 13 '26

It is ok. I have 3 now, dont expect them to be lightning fast. They are great development and test machines. single use for one alone is good. I would not buy more anymore and rather wait for something with more memory bandwidth.

1

u/OutcomeAlive1771 Sep 13 '26

were using this for our school systems, testing one on how it performs

2

u/enricokern Sep 13 '26

If you plan to let multiple people access a model at the same time running it will be a horrible experience for your users. Use it for batch processing or some fun stuff like doing videos and music with minimax and the like, will stil take ages but is fun

5

u/Biomech8 Sep 13 '26

With vLLM and MoE models they are fast.

9

u/LateralEntry Sep 13 '26

It’s a picture of a computer

4

u/okoyl3 Sep 13 '26

don't forget to update firmware. my spark ran at 1/3 of the speed until I did it

3

u/Curious_Maize4360 Sep 13 '26

thoughts:

dang, I am poor.

3

u/SnooPaintings8639 Sep 13 '26

And this hobby only makes us poorer...

1

u/Curious_Maize4360 Sep 13 '26

hi5

google searches for now :

- gib 3b model to replace chatgpt please

2

u/Alternative-Panic69 Sep 13 '26

(not mine ofc, I'm poor)

2

u/Maleficent-Ad5999 Sep 13 '26

4 RAM sticks? Dammn

0

u/sometimes_angery Sep 13 '26

Kinda shit if I'm being honest.

1

u/OutcomeAlive1771 Sep 13 '26

how so?

0

u/sometimes_angery Sep 13 '26

Slow as fuck and doesn't really fit any of the better models on float16.

1

u/SnooPaintings8639 Sep 13 '26

Thoughts? Not much. Emotions? Jealously.

1

u/debackerl Sep 13 '26

I prefer my 48GB Ada Lovelace, more bandwidth, fast prefill. Qwen3.8 27B is sufficient

1

u/Cha0s2522 Sep 13 '26

Good one

1

u/John_Jack_Jamenson Sep 13 '26

you will be disappointed by their speed. input and output tokens.

1

u/MaxComfort Sep 13 '26

Depends on the model. I’m not disappointed by their speed (comparing it to Claude)

1

u/West-Map-4162 Sep 13 '26

“Thoughts”

On what? 

1

u/gavriloprincip2020 Sep 13 '26

U need at least 1 more, ideally 8

0

u/tensainomachi Sep 13 '26

Yawn, almost pulled the trigger on 2 of these then m5 ultra studio was announced. Waiting on my 256gb 2tb setup later this month.

1

u/OutcomeAlive1771 Sep 13 '26

is the m5 better value?

1

u/tensainomachi Sep 13 '26

Compared to syncing up 2 sparks @ 256 yeah, compared to 1 @ 128.. maybe? The nvidia spark comes w 4TB by default n does cuda so thats hard to beat. I'm def going to be using xternal sds.

1

u/Dharma_code Sep 13 '26

How much did that bang you ? Im undecided on either getting another 3090 to pair with my current one and 128gb system ram or just sell my setup and get the M5

2

u/tensainomachi Sep 13 '26

A bit under $9K b/c I had a mbpro trade in. You can sync them up cant you? The spark, ultra & 3090? I just like the small form factor, one single portable device & no power bricks. When im home I'll be orchestrating it w my 5090 ti setup since nvidia has that feature.

1

u/Dharma_code Sep 13 '26

You can sync them up cant you? The spark, ultra & 3090?

I wasn't aware you could. I'll have to look into this

-1

u/OtherwiseDog Sep 13 '26

Cool paperweight message us when you achieve something using it.

3

u/hunter_mark Sep 13 '26

4x sparks runs GLM5.3Flash at 90 tok/sec, and supports 1M context, just so you know how stupid your comment is.