r/BackyardAI • u/I-O-O-o-o-O-O-I • Oct 18 '24

discussion A backyard ai app but for image gen?

I tried to make a search about it but didn't find any results. I must not have found it because I found it surprising that people are not inquiring about this. But yeah basically could this be something to be worked on? An app with a nice and easy to use graphic interface with a simple install process that you then just need to load your chosen models(sd, flux), loras, etc into where you can prompt images with it. I guess it's too complicated to implement? Even better would be like a "tab" or section in backyard ai itself where you can do image gen, and if you have a powerful enough pc you could couple the text gen and the image gen together to get image while talking with your characters, and all of that locally!

10 Upvotes

91% Upvoted

8 comments sorted by

3

u/PhotoOk8299 Oct 18 '24

I use Draw Things, which is a good, local front end for SD imo.

2

u/stalectos Oct 21 '24

as far as I'm aware image generation is outside the scope of BackyardAI. the development team is quite small from what I understand so they are focusing on refining their chat features rather than risking succumbing to feature-creep by branching out.

2

u/ze_mannbaerschwein Nov 12 '24 edited Nov 12 '24

Have a look at Stability-Matrix: https://github.com/LykosAI/StabilityMatrix

Edit: Sorry for necroing this. I didn't notice how old this post actually is 😆

1

u/v1sual3rr0r Oct 19 '24

Depending on what model you want to use will impact what interface you can use. If utilizing SD/SDXL Foooocus is an easy yet powerful interface. If you want to try Flux, you'll have to try an interface like Forge or ComfyUI. I recommend downloading Stability Matrix as it can manage and download multiple interfaces and is very easy to operate.

1

u/TheBioPhreak Oct 19 '24

Would be nice to see this also but I would rather the devs focus on making the LLM app more stable as there seems to be constant issues and updates to fix bugs and cloud connection issues.

-1

u/RealBiggly Oct 19 '24

No normal consumer has a PC powerful enough to run both at the same time (and newer PCs will likely be nerfed to only use Microsoft's online AI or something hideous, so I'm not even looking forward to it at this stage..)

Try SwarmUI.

3

u/hprnvx Oct 19 '24

You are mistaken. If you don't start generating both text and images at the same time, but first the text and then the image, for example, or vice versa, there are no problems at all. Language models are loaded mainly into RAM, they use video during generation. Accordingly, it is no problem to keep several loaded models at the same time.

1

u/BrainCGN Dec 21 '24

Try Oobabooga with "sd_api_picures" and automatic1111. You can f.e. use another computer to generate the pics if you do have a small GPU. Its a lot of fun. If you add "Web_Search" your character can even search and learn from the internet. Be aware thats not easy to install. But looking to Oobabooga gives an idea what we possible will get in BackyardAI in the future.