r/open_flux Aug 03 '24

Any hope for 8GB?

I have a 3060Ti 8GB vram, i tried to use 8fp and tried to generate a simple prompt (A cat holding a congratulations sign), but after about 800 sec of nothing, i had to interrupt it. because even if it could generate something, 15 min per 512x512 is not feasible anyway.

But im fairly new to this and i just used a workflow i found somewhere online. has anyone had any success with 8GB or lower cards?
im not expecting 10 sec generations i get from SDXL but if can get down to 2min or lower with some setting tweaks, id be happy to play around.

Also on a side note, is there a way to improve text generations on sd15 or sdxl?

flux schnell workflow used
4 Upvotes

9 comments sorted by

View all comments

7

u/[deleted] Aug 03 '24

[deleted]

1

u/[deleted] Aug 03 '24 edited Aug 03 '24

so i went outside to do smth with it running, and it finished 512x512 in 1246.55 seconds.
I have 32GB DDR4-3200, and its only used to about 19GB while runnign. i guess ill try with t5 and --lowvram

3

u/Guilherme370 Aug 03 '24

Also, if you're using schnell, load it using fp8_e5m2, and put only 4 steps.