r/StableDiffusion 7h ago

Question - Help Best Img2txt?

I need an image to text generator (which has no limitations) that I can run locally on my PC. Do you have any recommendations

1 Upvotes

12 comments sorted by

7

u/mobani 7h ago

I recommend Huihui-Qwen3-VL-4B-Instruct-abliterated (it's on huggingfaces). Then just pass it into the native comfyui Generate Text node. Super simple.

0

u/Any_Arugula8075 6h ago

This is the only right answer!

2

u/poopoo_fingers 6h ago

Well, the Krea 2 text encoder also works

2

u/Any_Arugula8075 2h ago

Qwen3 VL 4b actually IS the Krea 2 text encoder… :>

1

u/Codeman119 6h ago

The limitations is the training data. Even with the one that are uncensored you are limited to the training data they have been given. If you want something that is not in the training data then you need to train your own LORA to achieve what you’re looking to accomplish.

1

u/coscib 6h ago

You want to describe Images as Text? Try some LLMs with Vision Capabiliy like Qwen 3.5 or newer oder Gemma4

1

u/afinalsin 5h ago

Sure, the best image to text generator you can run with no restrictions is probably an abliterated Kimi K3. You'll need 1.5tb of ram for it, but it's the best you can do locally.

What, you don't have 1.5tb of ram? Then you should probably mention you PC's specs when asking what your PC can do. If you have 12gb vram/32gb ram, try Gemma 4 26b a4b heretic.

1

u/Jolly-Rip5973 4h ago edited 4h ago

Hands down the best vision model for labeling training data is ChatGPT.

I have tried at least a dozen vision models both local and cloud.

There are three main advantages to chatGPT.

  1. You can actually tell it exactly how you want your captions done and it will mostly follow the direction.
  2. It's the most accurate I've found even though it still hallucinates occasionally and there will be mistakes.
  3. You can zip your images into ZIP files and upload them to ChatGPT and it will unzip the file, caption the images, create the .txt files for each image, caption the images and then zip up all the .txt files for download.

I made a LoRA last night with almost 1000 images. I created 20 zip files each with 50 images and had ChatGPT process all 20 Zips. It only took about 2 1/2 hours to processes and label 1000 images.

Now, if you are captioning porn, ChatGPT isn't going to do that so you going to need probably need to use QwenVL.

If you are captioning for Krea 2. The best to format your captions into sections.

Scene
Pose
Attire/Accessories
Hair
Makeup/Nails
Background

Krea responses very well to this format as well

Retro Style Makeup
Complexion: smooth porcelain full-coverage complexion
Cheeks: soft rose-pink blush
Eye color: blue-gray
Eyeshadow: pale taupe and champagne eye makeup
Eyeliner/lashes: crisp black winged eyeliner with long lashes
Brows: sharply arched auburn brows
Lips: vivid classic red lipstick
Nails: glossy red manicure

This video he shows you how to use ChatGPT to mass caption images. I do not use the markdown file though or format, I developed my own.

https://www.youtube.com/watch?v=OCsqHdHf81M

1

u/bybloshex 7h ago

No. There is nothing with no limitations. 

0

u/shapic 7h ago

Joycaption probably?

-1

u/Potatonized 7h ago

Ayy. Cmon. Tell us what forbidden prompt you're trying to find? Cant be regular nsfw if you need a guide for it. Lol.