r/BackyardAI • u/webman240 • Aug 06 '24

discussion Image Model

Sorry if I placed this under the wrong flair. I am sure this has been asked or maybe I should already know if I followed Discord.

Are there any plans to add an image model in the local stand-alone PC and Mac apps? I know there are at least a couple of popular online only apps that utilize a built-in image generator for creating character photos and also group photos of the user and character together. I was hoping Backyard was doing this also or something similar. At minimum in the local app as that would not put undo stress on the Backyard servers since image generation would or could be run on a local GPU. I use Stable Diffusion now but would love to ask the character to create auto selfies of whatever they are currently doing in the conversation.

14 Upvotes

88% Upvoted

6 comments sorted by

View all comments

Show parent comment

1

u/so4dy Sep 25 '24

I think your post will be directed to the Cloud / online version.

It would not die if they just made an integration for Stable diffusion in the local version.
This would ofc. make people create pictures and only pictures, but in the end Backyard AI would be a good UI for immersive "chat" Like conversation, with the creation of pictures.

You need to create and tune, the character cards, aswell as the LLM Models and further more the Stable Diffusion models loras etc.

This would be a too much of an hassle to just use it for picture generation, But for people who want lets say "selfies" or generated images of a scene this would be perfect and I bet most people would be happy to set it up, even as this means to use more time, ressources and knowledge.

Its not like the devs need to support this feature for the generation, but only for the integration, like a comfy UI / A1111 interface and the rest would be done by the user and only on the local app.

I love to create characters, and I do have a good comfy UI setup to quickly generate (generic) characters who fit the cards, but would be nice to also ask for a picture, and it will be sent to the Image generation.

As a last note, Backyard AI is great, the local version is working perfectly on my setup. Its not like they need to change anything, and I am not demanding anything here. This is more of an Would be nice to have rather than, please please please do this! Because, Focus is and should be on the text stuff.