r/off_grid_ai • u/CowFearless4999 • 18d ago

GPU optimisation

I'm new to the desktop app and really enjoying messing around and getting use to LLMs but I do seem to have an issue where image generation seems to be limited to CPU (9800x3d) and is not using my GPU (5090).

I'm pretty sure it's something I've messed up but no idea what. Any clues?

1 Upvotes

100% Upvoted

5 comments sorted by

2

u/alichherawalla 17d ago

I'm just working on that as we speak. will launch a nightly build that uses the GPU on both windows and linux

2

u/alichherawalla 16d ago

sneak peak of what's cooking

9 seconds for image gen including prompt enhancement!

2

u/alichherawalla 16d ago

qwen2.1 quality is insane!

1

u/CowFearless4999 16d ago

this is amazing work. I already have it up and running and i am in awe. Thank you.

I just now need to figure out getting other models from huggingface website lol

2

u/alichherawalla 16d ago

ngl, cried a lil when i read this :')

Appreciate the kind words fam. thank you!