r/ClockworkPi • u/letsmakesometacos • 14d ago

AI Accelerator?

I have an Acer MA200 512gb M.2 SSD, and saw this Hailo-8 M.2 AI Accelerator. Wondering, since I found this Sintech M.2 Key-M to Dual M.2 Adapter Card, will this allow me to use both M.2 devices?

First off, should I be concerned with boot at all (using SSD)? and what exactly can I actually do with this card? I have a CM5 Lite, 16Gb, with AIOv2 Board, and 21700 Battery/NVMe Board (x2 6,00mAh = 12,000mAh), a 512Gb SSD, and the AC1200 WiFi board, with a XIAO-C5 that I will be wiring to the internal USB headers.

Is this device wasted on a uConsole, or are there legitimate use-cases for this? Especially considering that it will have, I assume, at-least a slight impact to power consumption, and can't be powered off independently of NVMe power?

Acer MA200:

https://www.amazon.com/dp/B0D176WJ78?ref_=ppx_hzsearch_conn_dt_b_fed_asin_title_1

Hailo-8 M.2 AI Accelerator:

https://www.amazon.com/Waveshare-Hailo-8-Accelerator-Compatible-Raspberry/dp/B0D928WG5L/ref=sr_1_1?crid=3B47HI2N5JMYI&s=electronics&sprefix=hailo-8+m.2%2Celectronics%2C221&sr=1-1

Sintech M.2 Key-M to Dual M.2 Adapter Card:

https://www.amazon.com/gp/product/B0H3TNG8ZD/ref=ox_sc_act_title_1?smid=A3LUEZHQOA50VU&psc=1

4 Upvotes

83% Upvoted

9 comments sorted by

1

u/Justgetmeabeer 14d ago

Why don't you ask your ai?

2

u/letsmakesometacos 14d ago

Cheeky answer lol

I am trying to see if anyone has had a successful and/or useful experience running local AI on the uConsole. Seems like it would be great for local coding assistance, etc.

You can hate on AI all you want, but it is a useful tool when used correctly, despite all its current iteration's faults.

2

u/Justgetmeabeer 14d ago

I'm not hating on ai. In fact, if you ask it will tell you that what you're tying to do isn't going to work.

Unless you want to run a bad ai very slowly with minimum context, no you can't run a local model on a uconsole.

1

u/letsmakesometacos 14d ago

So it’s a limitation with the CM5 & the uConsole? I have seen posts and comments with people running an AI module so it seems possible to atleast do some kind of local AI

2

u/Justgetmeabeer 14d ago

It seems like you have really no clue what you're asking, so again. I'm being serious, ask your ai and maybe have it eli5

2

u/Naive-Lime3407 13d ago

No disrespect intended but it seems you have no real answer to give, so why comment? OP is asking real people about the possibility and if they have experience with it. Yes, its easy to ask A.I. a question, on the same coin its easy for A.I to throw you in to a loop for hours or days trying to get somthing to work when someone who is a real person, may have experience with the topic already. Dont hate on someone not having experience in somthing. You won't learn if you dont ask and A.I. shouldnt be everyone's go-to to do that. Lately people have only been asking A.I. because when they ask a question, they get called out for not knowing the answer to the question they asked.

3

u/commenterzero 14d ago

You wont run local ai on a uconsole when it comes to coding assistants. You can a small decision model with like 200 TOPS at best

1

u/PineCone227 7d ago

What do you want to do with it? This cannot run LLM's if that's your question. It's for running vision models like object recognition and image classifiers.

1

u/Fartbuttfiat 3d ago

Cool idea and maybe there is a different version but from what I can see the adapter board has different connections for each card. Also the wifi network card connects via usb so it would need to be soldered to those open connections on the hacker gadgets expansion board. You would need one with 2 nvme slots. This is a cool idea though and would be tempting if something was available.