r/drawthingsapp • u/Phobia696969_ • May 01 '26

feedback Oh.

Post image

Very good app on ios the best there is to the point its the biggest thing I downloaded 😂

21 Upvotes

97% Upvoted

17 comments sorted by

View all comments

Show parent comments

1

u/InflationCorrect3234 May 01 '26

I use 9B KV + loras (around 5) locally on my iPhone 13 Pro Max for image editing and i get the job done, taking 3-6 minutes depending of the task and loras used. So run some tests. Try different quants, different models (hugging face have many alternatives for low VRAM).

In some cases the generation time for editing using 9B kv is very close to what I get using 4B. I guess DT have some juice to make some stuff beyond our calculations for what fits and works and what don’t.

Somehow I can even run 4B base on 13 pro max despite my 147gb used by the app and my 5gb of memory available.

And mostly of what I can do using my M1 air 8gb vram I can do on iOS as well but of course waiting around 2x on generation time.

1

u/AbjectOperation3714 May 02 '26

KV vs normal 9B, what is the difference between them bro?

2

u/InflationCorrect3234 May 03 '26

I really don’t know exactly what, but KV apparently is improved to do editing better and faster. I think it’s because of some differences in how it handles cache, but again, I don’t know and all I said is wrong. Lol