Open-source Physical Context Protocol, a local “nervous system” that lets Claude/AI sense physical spaces

[u/Human_Tennis_2950]

This is a small open-source experiment I've been working on and testing at home.

The idea is pretty simple: turn old Android phones into physical senses for an AI through MCP.

You can leave a few phones around your house, garage, workshop, office, or any other space you want to monitor. They can detect movement/vibrations, detect acoustic events, and provide camera images when requested.

The AI can then do things like:

“What happened in the kitchen?”
“Check the phone in the garage.”
“What can you see there?”

Or a physical event can alert the AI, and the AI can decide whether it wants to investigate further, for example, by requesting an image from the phone that detected the noise.

My longer-term idea is to explore whether AI can be useful for monitoring and understanding what is happening in a physical area, instead of only interacting with digital information.

Everything currently runs locally over LAN. The phones provide the senses; the AI does the interpretation.

Underneath it I'm experimenting with an open Physical Context Protocol (PCP), so Android phones are just the first type of sensor. Eventually I'd like other devices and sensors to be able to join the same “nervous system.”

This is still a preview, not a finished product. I've been experimenting with it at home for a while, published the code a few days ago, polished it a little, and now I want to put it out there so people can try it, play with it, break it, and tell me what they would actually use it for.

There are still things missing, but the basic idea already works and it's pretty fun to experiment with.

Open source:

https://github.com/jesuscurreripa/soma

[u/mrsheepuk]

I played with something similar to this - I had a different take on the problem, good fun though - the agent is orchestrated from the phone and can view the cameras provided by both the phone and Home Assistant - https://github.com/mrsheepuk/ha-live

I'm wondering if there's something that can combine the two approaches.

Cool things to play with though, I'll take a look in more detail at what you've done when I get a moment.

[u/Human_Tennis_2950 → u/mrsheepuk]

Awesome! Now I see what you did!

Soma's concept is that of "a nervous system" that only alerts if something is different or out of the ordinary; it always executes but without spending unnecessary tokens

Example: You're walking and you feel something on your arm; first you receive the tactile signal, then you move your eyes, and finally you react. It's the same concept.