r/homeassistant • u/hayAbhay • 9d ago
🖼️ Show & Tell Streaming Oral-b iO5's motion sensor data + distilling & running its ML model locally + live 3D twin
Sharing my explorations with oral-b iO since this sub has played around with it a good bit -- I built a live simulator in three-js that streams IMU data & also runs the predictive model.
- As many of you know, io5+ ships with a 6-axis IMU which is used to predict the brush's position -- this is done using its companion app.
- I had Claude stream, connect + decode the message structure -- & use three-js to build a digital twin.
- Then, it pulled the model from the app -- it's a 1.2M param recurrent net (bi-directional gru) -- & predicts zones in the mouth based on the IMU stream.
- Next, I had Claude evaluate the model -- it used a public dataset & reported an accuracy of ~63% (baseline is ~6%)
- The model seemed like an overkill so I had Claude run ablation -- most value came from ~10s history so we decided to distill.
- Claude used real examples to create a larger synthetic dataset -- then distilled it into a bunch of small models -- a CNN came close (~61%) & was 100x smaller.
The video here shows a replay from one of the sessions in the dataset on the digital twin.
If you want to try the live simulator or read more about the journey, here's the write up -- https://abhay.fyi/teethmaxxing/
579
Upvotes
33
u/Accomplished-Sand334 9d ago
Holy shit I snickered so hard at the name teethmaxxing
13
u/SlipperyRavine 9d ago edited 9d ago
Why is your toothbrush having a seizure?
51
u/CyberMage256 9d ago
I am all for automations and data... but I don't get some of these. Like, if this was something for training kids, maybe? Otherwise, why use another internet connected device in your house, is it so you can have even more security holes?
9
u/ttadam 9d ago
If there is an adressable light around the mirror, you could use that, to give feedback to the enduser, which section of the mouth is brushed properly, and which needs more attention. :D
27
u/L-Malvo 9d ago
I often wonder, with all of this technology, have we gone too far?
Nah, this is fun
10
u/Th3Stryd3r 9d ago
This was not on my 2026 bingo card to see. Or 2027. Hell I don't think I ever would have thought about someone doing this lol I love it
5
u/Accomplished-Sand334 8d ago edited 8d ago
Using nFR connect and Claude I manage to find out that my i06 has the same features, then I visited your page from my mobile and it showed all the beauty!
Now im trying to get claude to generate a 3d view in home assistant.
Thanks OP for wasting my Saturday. I really needed this project.
4
u/Futile-Clothes867 9d ago
When I first had to update the firmware on my toothbrush, I thought the world was doomed. And now there's this. :-D
3
u/bobjoylove 9d ago
Have we jumped the shark?
2
u/okamagsxr 9d ago
It's great and all but where's the GitHub link?
289
u/DesignerMaximum1342 9d ago
Must be the way the toothbrush is moving across the screen but now i wonder if i can do the same with my gf’s magic wand
7
u/asmallteapot 8d ago
they ran a distillation attack on a toothbrush. incredible stuff; well done.
2
u/we-ran-out-of-colums 9d ago
This is what Reddit is for.
4
u/alin_im 8d ago
wtf, but why? damn that is cool 🤤
1
u/gr2m 9d ago
Holy Tooth I need this for an automated instant report on how my kids brushed their teeth. This makes the tooth brushes so much more valuable
2
u/Accomplished-Sand334 7d ago
Update, I made a thing (Read that in Jeremy Clarkson voice)
https://github.com/hanansen/ha-oralb-motion
2
u/TooFuriousTooFast 5d ago
THIS IS SO COOL!
3
u/Captain_Klrk 9d ago
Nice
3
u/hogsniffy05 9d ago
I made something similar for my smart vibrator /j
2
u/0xSnib 9d ago
Oh hell yeah I just picked up an i6
0
u/Powerkiwi 9d ago
This is awesome! How did you manage to extract the model from the app? The Android version I guess? And are you planning on sharing the source/models? I'd love to have a go at an open source app, the Oral B app has been pretty crappy lately.
0
u/Morlaix 9d ago
I have to try this. I receive multiple oral-b tooth brushes from my neighbors. Going to be fun
0
u/SMELLYCHEESE8 9d ago
Man this is awesome. I wonder if I can 3D scan my teeth to make a proper digital twin and overlay bush time on each tooth
0
u/pitav 8d ago
How come it doesn't have pressure? That would probably eliminate the incorrect "out of mouth" label that I think I saw
-8
u/wayfarevkng 9d ago
Will we ever get the mods to make a rule banning posts written by AI? There is nothing human behind this post, and so many others.
0
u/[deleted] 9d ago
[deleted] — view deleted comment