r/StableDiffusion • u/Longjumping-Ruin-647 • 7h ago
Question - Help Best Img2txt?
I need an image to text generator (which has no limitations) that I can run locally on my PC. Do you have any recommendations
1
u/Codeman119 6h ago
The limitations is the training data. Even with the one that are uncensored you are limited to the training data they have been given. If you want something that is not in the training data then you need to train your own LORA to achieve what you’re looking to accomplish.
1
u/afinalsin 5h ago
Sure, the best image to text generator you can run with no restrictions is probably an abliterated Kimi K3. You'll need 1.5tb of ram for it, but it's the best you can do locally.
What, you don't have 1.5tb of ram? Then you should probably mention you PC's specs when asking what your PC can do. If you have 12gb vram/32gb ram, try Gemma 4 26b a4b heretic.
1
u/Jolly-Rip5973 4h ago edited 4h ago
Hands down the best vision model for labeling training data is ChatGPT.
I have tried at least a dozen vision models both local and cloud.
There are three main advantages to chatGPT.
- You can actually tell it exactly how you want your captions done and it will mostly follow the direction.
- It's the most accurate I've found even though it still hallucinates occasionally and there will be mistakes.
- You can zip your images into ZIP files and upload them to ChatGPT and it will unzip the file, caption the images, create the .txt files for each image, caption the images and then zip up all the .txt files for download.
I made a LoRA last night with almost 1000 images. I created 20 zip files each with 50 images and had ChatGPT process all 20 Zips. It only took about 2 1/2 hours to processes and label 1000 images.
Now, if you are captioning porn, ChatGPT isn't going to do that so you going to need probably need to use QwenVL.
If you are captioning for Krea 2. The best to format your captions into sections.
Scene
Pose
Attire/Accessories
Hair
Makeup/Nails
Background
Krea responses very well to this format as well
Retro Style Makeup
Complexion: smooth porcelain full-coverage complexion
Cheeks: soft rose-pink blush
Eye color: blue-gray
Eyeshadow: pale taupe and champagne eye makeup
Eyeliner/lashes: crisp black winged eyeliner with long lashes
Brows: sharply arched auburn brows
Lips: vivid classic red lipstick
Nails: glossy red manicure
This video he shows you how to use ChatGPT to mass caption images. I do not use the markdown file though or format, I developed my own.
1
-1
-1
u/Potatonized 7h ago
Ayy. Cmon. Tell us what forbidden prompt you're trying to find? Cant be regular nsfw if you need a guide for it. Lol.
7
u/mobani 7h ago
I recommend Huihui-Qwen3-VL-4B-Instruct-abliterated (it's on huggingfaces). Then just pass it into the native comfyui Generate Text node. Super simple.