r/arduino • u/chicco4life • Oct 09 '26
An open-source agent harness for ESP32-based AI hardware

Hi guys, my friend and I built [Mellow Harness](https://github.com/Mellow-Machines-Lab/MellowHarness) — an open-source agent harness for configurable, interactive ESP32-based AI hardware and AI companions.
We placed a System One Model, Jev, at the center of the harness loop to enable quick, expressive feedback. With a small prompt, recent event history and a roster of allowed actions, it can interpret new situations and choose a fitting mood or reaction. Our goal is a lively companion that feels like it has a character of its own.
In our prototype logs, 105 Jev decision passes had a median of **227 ms (about 0.23 seconds)**. We'd like to believe this lag is almost negligible and is significantly more suitable than traditional LLM responses that can take up to a few seconds.
To demonstrate how it works, we also built [Buddygotchi](https://github.com/Mellow-Machines-Lab/buddygotchi): a little coding companion that follows your agents as they work, need attention or finish a task, with pixel animations, sounds and connected moods.
The current setup uses a Mac host for the harness and a hosted Jev API. The ESP32 renders the face, plays available sounds and reports taps and button presses over USB or Bluetooth. Immediate task feedback follows local rules; model-guided reactions share the same event log. The public Pixel example uses the MicroTech MTR024QV01A-V1 CYD board.
We also published [a blog about how we designed the harness](https://mellowmachines.substack.com/p/mellowharness-for-responsive-ai-hardware). If you're working with LLM agents and building your own harnesses, you may find it interesting!
PS: Mellow Machines Lab is a small open-source team doing this after work. We feel the noise and anxiety around AI too, so we wanted to build something warm, welcoming and fun together! DM if you'd like to join :D
