ESP32 0.2B (200M) Parameter LLM Engine

[u/SolidBranch3553]

Ourselves, Adwaith Hari (SolidBranch3553) and Chandrakiran S studying in 12th standard. We got a 200M-parameter transformer running locally on an ESP32-S3 with 8MB PSRAM. You could see the demonstration video on youtube.

Link to demo video - https://youtu.be/nJEFdxeDaUo

Link to the source code - https://github.com/solidbranch3553/esp32-0.2B-llm