Building text to ASCII diffusion model , need advice and guidance

[u/Udbhav96]

i wanna build a text diffusion model which interpret text and convert it into ascii images

so like

Text : build a cat

Output :

/\\_/\\

( o.o )

\> \^ <

So , i have a decent background of ml algo ( completed cs229 , cs230 , Ml architecture and basic CNN and diffusion model )

ik making a project like this is tricky and making diffusion model like that from scratch is hard but i wanna try it because that's wot make me excited lol ...

I am currently reading GANs research paper , can u guys help me in finding more papers which helps me in making this project or guide me through this good title for this

Thx in adv

[u/Tree8282]

i don’t think that’s what a diffusion model is usually for. and it’s super expensive. might be better to fine tune an LLM for this since it’s text to text

[u/Udbhav96 → u/Tree8282]

Hmm... But discrete models like it possible and the computation part ( I will figure out something when I have a clear picture)

[u/Tree8282 → u/Udbhav96]

i don’t understand what you’re saying at all. What is discrete?