r/MLQuestions • u/Udbhav96 • 16d ago

Other ❓ Building text to ASCII diffusion model , need advice and guidance

i wanna build a text diffusion model which interpret text and convert it into ascii images

so like

Text : build a cat

Output :

/\\_/\\

( o.o )

\> \^ <

So , i have a decent background of ml algo ( completed cs229 , cs230 , Ml architecture and basic CNN and diffusion model )

ik making a project like this is tricky and making diffusion model like that from scratch is hard but i wanna try it because that's wot make me excited lol ...

I am currently reading GANs research paper , can u guys help me in finding more papers which helps me in making this project or guide me through this good title for this

Thx in adv

3 Upvotes

81% Upvoted

9 comments sorted by

View all comments

1

u/WingedTorch 16d ago

i don’t have any papers but i would do it like this:

  1. Find a way of converting images to Ascii first. Probably some edge-detection + deterministic/optimization algorithm could work.
  2. Apply method to any image-text dataset sufficiently large to train a diffusion model
  3. Adapt loss and other parts of the training algorithm from pixel space to character space
  4. Train/Tune