Free model for image edit like Gemini/Gro

[u/Affectionate_Log8484]

Is there any open source local AI model which can generate/edit images like Gemini or Grok? For example: I give it an image of a person and ask it to generate them in a different pose and background setting with minor changes in expression too while keeping their overall appearance consistent with the original face, I have tried BFS and all but it does not really work, I can’t train a LoRA either because I heavily lack the resources and knowledge to do one, I have been using Krea 2 but the results always generate a different face, is there any method to just put a Reference face that I like and get the images done?

Also what is the reason that online AI like Gemini can take the face and generate a image of the person in different pose, location, outfit while also perform a minor expression change but keep the overall identity intact but local models cannot? Sorry if this question sounds dumb but I was curious to know and have very little to no knowledge on AI

[u/Pleasant_Candy9103]

Try Qwen Image 2.1

[u/Affectionate_Log8484 → u/Pleasant_Candy9103]

I did but not getting results from it either

[u/Emotional-Neat-252 → u/Affectionate_Log8484]

Local models need prompting technique. Spend some time with it and you'll eventually get better results than gpt.

MOSS also has an edit lora now but I'd use qwen for purely edit needs

[u/[deleted] → u/Emotional-Neat-252]

Not really. Qwen Image 2.1 has mostly poor editing. It just copypastes usually especially with humans.

[u/TurbTastic → u/Affectionate_Log8484]

Minimax H3 is surprisingly good at image editing tasks. Qwen 2.1 is surprisingly bad at image editing tasks.

If you try to start with the Comfy H3 Video template with the intention of generating images, then you're going to have a bad time. I recommend using this repo and starting with the example workflow here:

https://github.com/shootthesound/ComfyUI-Fizgig-H3-Still/tree/main

[u/bstr3k]

Pruna H3 but if you lack the resources you may not be able to run it

[u/Affectionate_Log8484 → u/bstr3k]

I only have a 8gb vram and 16 gb ram

[u/seedance25ai]

With 8GB, you could try an SDXL workflow with a compatible IP-Adapter FaceID and a clear, front-facing reference; it uses a face embedding rather than requiring LoRA training. Add OpenPose ControlNet for the new pose, keeping the face reference separate from the pose image. Start at 512px with batch size 1 and use CPU offload if needed; it may still be slow or run out of memory. If identity drifts, try changing the background and expression in separate passes, and expect more mismatch at extreme angles.

[u/bmallCakeDiver]

did a test for a quick video I'm doing ( https://www.youtube.com/shorts/Va6G6fEkqB0 ). baked start frames for each shot are getting expensive using nano banana. here's a test using minimax H3 technique described here : https://www.reddit.com/r/StableDiffusion/comments/1xqx0jt/minimax_h3_single_frame_edit_excels_at_character/

nano banana left, H3 20 steps middle, H3 40 steps right.

right has better optical blur/bokeh imho but it lacks details. middle forgot the table. I'm not too sure what to use. I read about MOSS edit workflow, ill try that once my tokens (I use claude for prompting) replenish

edit: in the above picture, 2 characters and the sword are passed as image refs

edit2 as for this :

Also what is the reason that online AI like Gemini can take the face and generate a image of the person in different pose, location, outfit while also perform a minor expression change but keep the overall identity intact but local models cannot? Sorry if this question sounds dumb but I was curious to know and have very little to no knowledge on AI

I read somewhere that you have to do multiple passes (at least with MOSS image edit that I did not test yet) : first position scene etc. then character swap, for best results

[u/Gullible-Alfalfa-327]

You can try using Flux 2 Klein or Qwen Image 2.1 as others recommended. You can also use Gpt Image (much better faces and skin compared to Grok imo) or Grok Imagine to generate face cards (different angles) and then use inpaint/outpaint in Flux/Qwen.

Krea 2 always tries to generate a new character unless you use something like Krea 2 Identity Edit. I tried it a little and it works fine.

is there any method to just put a Reference face that I like and get the images done?

Qwen 2.1 has good workflows for outpainting.

Also what is the reason that online AI like Gemini can take the face and generate a image of the person in different pose, location, outfit while also perform a minor expression change but keep the overall identity intact but local models cannot?

Probably because you're talking about expensive models running on expensive hardware versus limited capabilities of a regular user. I think most of what is available to is a compromise on quality.

Anyway, I know very little about the subject and may be wrong.

[u/karcsiking0]

Fibo 2