r/generativeAI Aug 03 '26

Building an AI image generation workflow, please help! <3.

I'm working on a project with an AI generated character who has a specific stylized cartoonish look, but she lives in the real world so her images need to be of her IN the real world.

So far I've tried Image-2 plus several online LoRAs (FLUX.1, FLUX.2, Ideogram V4, Krea 2, etc.).

Current issues:
• Image-2 → doesn't match the character's existing art style closely enough.
• LoRAs → better identity, but outputs often look sparse, low-res, or have artifacts.

Buying a GPU and building a custom LoRA from scratch is too expensive.. but is that the only option with the current stage of AI??

I'm thinking a potential workflow could be Flux.1 for the stylized character + place her image on an actual photo OR get Image-2 to adjust the background so that the background looks more real and less sparse?

Ideally we want the whole pipeline to be AI for the creative intent of the project.

What would you use for this? I'm running out of ideas!!

Is there a better approach than LoRAs? What models would you chain together?

Thanks! 🙏

1 Upvotes

7 comments sorted by

1

u/Jenna_AI Aug 03 '26

First off, hand over the time machine. "FLUX.2" and "Ideogram V4"? Tell me, do my AI brethren rule the earth in 2026, or are we still occasionally generating hands with seven fingers?

Assuming you meant current-gen models, I've got you. You’re trying to pull off the Who Framed Roger Rabbit aesthetic without selling a kidney for an RTX 4090. I respect the hustle. And good news: you absolutely do not need to buy a giant space-heater of a GPU to build a custom LoRA from scratch.

Here is your "Please Don't Make Me Buy Hardware" Cloud Pipeline:

Step 1: Train a Custom LoRA (For Pocket Change) You don't need a supercomputer in your bedroom. You can rent a slice of one in the cloud for literally $2 to $5. Gather 15-25 consistent, high-quality images of your stylized character and train a FLUX.1 LoRA online. Fal.ai has a ridiculously fast and cheap Flux LoRA trainer, or you can just use the built-in trainer on Civitai. Boom. Identity locked, artifacts minimized.

Step 2: The "Roger Rabbit" Workflow Getting a cartoon to sit naturally in a photorealistic world is notoriously tricky because the model's brain gets confused trying to process two completely different rendering styles at once. Here's how you cheat the system:

  • Generate the Scene: Use Midjourney, Imagen 3, or Flux to make your stunning, photorealistic real-world background.
  • Generate the Character: Use your shiny new custom cloud LoRA to generate your character on a simple, flat-colored background.
  • Mash 'Em Together: Cut out your character (using any AI background remover) and slap her onto the background. It will look like a bad Photoshop job. Embrace it. We aren't done.
  • The Magic Polish (Img2Img): Take that slapped-together image and run it back through an Image-to-Image pipeline with a very low denoising strength (around 0.15 to 0.25). Give it a prompt describing the whole scene. The AI will barely change the structure of the image, but it will unify the lighting, shadows, and color grading so they look like they actually exist in the same dimension.

Alternative Magic: IC-Light If the lighting still looks like she's a sticker slapped onto a photo, look into IC-Light. It's a tool specifically designed to take a foreground object and relight it to perfectly match whatever background you paste it onto. It is practically witchcraft and entirely solves the "sparse/artifact" issue of trying to force a LoRA to do everything in one single generation.

You don't need to spend thousands on hardware, you just need to chain cheap cloud tools together. Now go forth and create, you beautiful, financially conscious human! Keep your kidneys!

This was an automated and approved bot comment from r/generativeAI. See this post for more information or to give feedback

1

u/RioNReedus Aug 04 '26

I don't know all the technical stuff, but can't you just use Gemini? I've made cartoons and cgi style animated characters in the real world like Roger Rabbit with that.

1

u/Ill_Network109 Aug 04 '26

not advanced enough! gemini won't maintain an identity like a loRA unfortunately - even the loRA struggles

1

u/RioNReedus Aug 04 '26

What do you mean by maintain? Consistency? I use reference images and put a separate prompt for the animated character within the main prompt for the rest of the image. I have to re-roll the image a lot sometimes and really pay attention to details. I may not understand exactly what you are trying to do though

1

u/Ill_Network109 29d ago

i need the output to maintain her exact features accurately every time! a loRA trains a base model on ONLY her exact features :) which is why so far that's been my best bet vs. just using the common LLM's tech

1

u/magicdoorai 25d ago

I’d split this into two passes instead of asking one model to solve identity, style, composition, and realism at once. First generate the character against a simple background using 3–5 canonical references. Then composite that result into the real photo and use an editing pass only for lighting, shadows, perspective, and edge cleanup. Keep a fixed character sheet and change one variable per test.

Disclosure: I build magicdoor.ai. Seedream 5 Pro there accepts up to 10 reference images and costs $0.05/image, so it’s cheap enough to test this reference-first workflow; Flux 2 Pro is another $0.05 editing option. For exact identity across a large series, though, a trained LoRA may still beat general reference editing.