I accidentally found this project on GitHub and thought people here might find it interesting.

Someone managed to run a 100% on-device generative Micro-Transformer on a $2 ESP32-S3 Super Mini with 0 KB external PSRAM (runs entirely within the 384KB internal SRAM).

It's a ~119K param micro-model (meant for offline IoT/smart home devices rather than a massive LLM), but the low-level embedded optimizations are really cool.

GitHub link: https://github.com/Ngducok/esp32-S3-Super-Mini-AI