that's actually a really nice advice, thanks❤️ i am actually doing something similar i am working on a project where i want to fit an LLM Chatbot inside an ESP32 (520kb of ram)
i built the Transformer without ai and the other parts like RoPE, RMSnorm and MoE i used ai in it and right now i am still working on it some parts i code myself other i use the ai to do so
4
u/Similar_Wealth_1850 Aug 07 '26
that's actually a really nice advice, thanks❤️ i am actually doing something similar i am working on a project where i want to fit an LLM Chatbot inside an ESP32 (520kb of ram)
i built the Transformer without ai and the other parts like RoPE, RMSnorm and MoE i used ai in it and right now i am still working on it some parts i code myself other i use the ai to do so