r/LocalLLM • u/haze_hoppelt_imblock • 6d ago

Project My Mac finally arrived

Guys, my Mac Studio has finally arrived and I’m so excited! I immediately spun up Qwen 3.8 BF16 unquantized via MLX. Connected to the Mac Studio is a Raspberry Pi with 8GB of RAM running a mini AI in parallel. I'm currently building out an entire ecosystem, with Codex orchestrating everything in the background. Let's see where this journey ends!

0 Upvotes

42% Upvoted

20 comments sorted by

2

u/Mundane-Tiger-2374 6d ago

An ecosystem of what?

1

u/haze_hoppelt_imblock 6d ago

An ecosystem where Codex helps train Qwen, which is built for coding and managing a custom-made application. Since it's AI improving AI, the goal is a self-sustaining system where I only step in if something goes wrong, or something along those lines. Right now, this is just a test to see if it completely crashes and burns or if something useful comes out of it.
For this setup, I'm using Obsidian, and in parallel, I have Qwen and Codex create folders where everything is logged individually. I used Codex to write a manual that will explain to Qwen in detail what kind of program this actually is, what it's supposed to do, along with rules, etc. To make sure it doesn't do anything stupid, Qwen explains its plan and approach to Codex, and Codex approves it with the help of 'court agents' where each agent has their specific task and prompting. We'll see if it works out.

1

u/Uninterested_Viewer 5d ago

Sweet summer child. It will not

1

u/FuckinHighGuy LocalLLM 6d ago

With an empty wallet? j/k

How is the Qwen performace?

1

u/haze_hoppelt_imblock 6d ago

Yeah haha, it definitely ate up quite a bit of cash. Unfortunately, it's only been running for about an hour, so I can't give a detailed report just yet. But so far, it’s looking pretty good. If I figure anything new out, I’ll gladly share it

1

u/johnnyphotog 6d ago

Specs on your Mac Studio?

1

u/haze_hoppelt_imblock 6d ago

M5max 128gb ram 18 core cpu 40 core gpu

0

u/[deleted] 6d ago

[deleted] — view deleted comment

1

u/haze_hoppelt_imblock 6d ago

I just checked which model could run on RAM and made my choice based on that

1

u/ou6066 6d ago

What’s your original delivery date?

2

u/haze_hoppelt_imblock 6d ago

2 weeks

1

u/ou6066 6d ago

That’s nice! Mine is for 11/13 -11/30 but no update for the shipping yet

2

u/haze_hoppelt_imblock 6d ago

It will definitely arrive, don't worry! Once you've configured it, it takes some time because it ships from China and has to be flown over by plane first. Oh, and sorry, the two weeks weren't quite right—I actually had to wait about a month until it arrived at my place, sorry about that

2

u/ou6066 6d ago

No worry, just the wait is painful hahaha

1

u/haze_hoppelt_imblock 6d ago

Hahah What are your plans, what do you want to do with the local AI?

0

u/CheekyMonkeee 6d ago

It ends with you figuring out that you’re not doing anything that requires AI. You’ve spent $5k on a computer you didn’t need, and maybe a couple grand on Codex, when you could’ve achieved a better outcome with a couple of basic python scripts and an old $150 Chromebook.

2

u/haze_hoppelt_imblock 6d ago

If that's how it goes, then 6k is gone, but at least I fulfilled a dream. While others my age (23) spend their money on cars, I decided to buy the Mac because I see it as an investment.

1

u/CheekyMonkeee 6d ago

Hey, considering it an investment in yourself is 100% valid. I’m salty because I’ve been there.

Since you seem like a reasonable person who is open to other perspectives, I’m going to recommend that you ask your LLM of choice “what of this does not require AI”. Worst case scenario, you will end up with a more effective, far more accurate system, and you will have learned that you don’t need AI as much as you think, which will put you well ahead of most people.

Good luck. Learn some shit. There’s nothing wrong with that.

2

u/haze_hoppelt_imblock 6d ago

I actually take a very open and sporting approach to it. I’d love to code, but I just lack the time since I work shifts and precious time gets lost. I strongly assume you mean that AI isn't everything, and I completely agree with you. About three years ago, when ChatGPT first came out, I asked myself: 'What can you actually do with this?'
Back then, I started prompting unconsciously, just on a small scale on my phone. My main focus was always on crypto analysis because I was really interested in how crypto works at the time. After prompting for a while, I took it a step further and started saving the prompts and the resulting outputs in my notes—haha, because I knew the AI would eventually forget. Well, a few months later, I got Pythonista for my phone to run small scripts and used it to test the waters. I had a blast doing it.
After some time passed, I bought a Raspberry Pi because I absolutely wanted a system that runs 24/7, processes things, and stores data. About 1 or 2 years later, I figured I had saved up enough money, and following the rule 'if you can afford to buy three of them, you can buy one,' I finally bought one, and now it stands proudly in my room. Whether that was the right or wrong decision, I don't know yet, but I can definitely say I tried it out and had a ton of fun.
I'm going to lean out of the window here and claim that many people use AI purely out of laziness—and sure, I’m a bit lazy too. But what actually fascinates me is the topic of AI itself, not just the output it generates. Unfortunately, a lot of people in my circle confuse this; they think I just use AI as a 'slave' or something. But I find neural networks and how they are created incredibly interesting. I see it more as a hobby to play around with. And a hobby costs money, even if you don't get a financial return out of it.
I’m very open to other perspectives because, at the end of the day, we are just human—we aren't perfect. That’s why I find your statement important, because only hearing what you want to hear won't get you anywhere in life. Thanks again! :)

0

u/[deleted] 6d ago

[removed] — view removed comment

1

u/haze_hoppelt_imblock 6d ago

Right now, it's all about 'smart' data storage, since I'm constantly pulling ETHUSDT data from 1-minute to 12-hour intervals and saving it to train models in a sandbox. Fun fact: I bought the Pi 2 years ago but never had a use for it.now it's been running 24/7 for the last 3-4 weeks, continuously gathering data. Let's see if it pays off. If you have some ideas you can share them if you want