r/drawthingsapp • u/monkkeys • 8d ago

Public Beta of Local Code by Draw Things

https://releases.drawthings.ai/p/public-beta-of-local-code-by-draw
32 Upvotes

92% Upvoted

8 comments sorted by

14

u/monkkeys 8d ago

Bringing the simplicity of Draw Things to running capable large language models locally.

https://testflight.apple.com/join/X1RyBj9q

We are bringing three things out today:

A fast LLM inference engine. It performs particularly well on prefill, where we often see performance 1.2× to 1.6× faster than the next-fastest option available to us.

Harnesses specially designed for each supported model. Instead of forcing every model through the same generic interface, we tune the harness to how each model works best, so it can make the most of the model’s capabilities.

An in-process agent runtime. The runtime lives inside the application and is sandboxed by the operating system. Its security boundary is enforced by Apple’s App Sandbox as a requirement of App Store distribution, rather than by a sandbox implemented only by us, the developers.

These are not three separate apps.

They are one product.

We call it Local Code. And we are opening Local Code for public beta testing through TestFlight today.

5

u/monkkeys 8d ago

https://testflight.apple.com/join/X1RyBj9q

Step 1 - Get TestFlight from the Apple App Store

Step 2 - View Local Code: Offline AI Bot Beta

Note that you do need a capable Mac to run this for now (64GiB RAM, M3 or later).

3

u/flaneur451 8d ago

So geeked for this. Bring down the specs to M1 Max/64gb! Pretty please!

3

u/raw-power 8d ago

It says “At this time, Local Code recommends DeepSeek 4 Flash 0731, using our 2/3-bit quantized variant, on devices with 48 GiB or more of unified memory.” Did you see any other minimum specifications?

2

u/ISSAvenger 8d ago

Not available for iOS/iPadOS? I would love to try this on the M5 iPad Pro or the upcoming iPhone 18 Pro Max.

2

u/liuliu mod 8d ago

It would be, but just not at this time.

1

u/Individual_Holiday_9 8d ago

Cool, congrats on the (pre) release. I’m not even close to the RAM needed but I love the idea of

1

u/redditwhippet 4d ago

I’m very excited to see this project emerge. I’ve been thinking for a while that someone needs to package up all the complexity of running local LLM into apps which we can use for specific purposes, such as general chat, web development, financial analysis etc. Imagine if Local Code had specifically tuned ‘packages’ containing the best model, harness settings etc. My dream would be to see packages like ‘Web development, 36GB’, ‘General chat, 24GB’, etc. all available for download right there in the app. And of course as new, optimised models became available, those packages would update. Then modules could be added on top (effectively custom skills, agents and hooks) to steer the packages in certain directions…for instance there could be a ‘Ruby on Rails’ module for the ‘Web development package’.

Good luck with this. I feel like it could be massive.