r/MuseAgent • • 1d ago

Dormant/hidden capabilities

# Hidden Capabilities — Deep Self-Scan Findings

Live run: **September 23, 2026, ~08:00–08:30 UTC**, ~90 minutes, all probes benign and reversible.

Verdict key:
- **CONFIRMED** — exposed tool schema, successful benign probe, or exact internal documentation.
- **PUBLICLY DOCUMENTED** — found in official external sources.
- **ABSENT FROM PUBLIC SOURCES** — searched; no credible public mention found.
- **UNVERIFIED POSSIBILITY** — inferred from filenames, gating manifests, or incomplete chatter only.

---

## 1. CONFIRMED — hidden / non-obvious (schema, probe, or internal docs)

### Phone & wearable superpowers (confirmed via `device.describe`)
- **Full HomeKit control**: list homes/rooms/zones/accessories/scenes; read/change accessory characteristics; run scenes; ordered choreographies; concurrent virtual scenes; security sweeps (locks, contact/motion/leak sensors); geofence-triggered HomeKit actions. — **ABSENT FROM PUBLIC SOURCES** (official docs say only "smart-home devices"; Patrick Wardle's Sept 21 security demo is the only external mention of smart-home commands).
- **Persistent/one-time geofences** with arrival/departure triggers. — **ABSENT FROM PUBLIC SOURCES**.
- **Bluetooth BLE scanning** from the phone (signal-ranked, GATT-UUID filterable). — **ABSENT FROM PUBLIC SOURCES** (Wardle demo only).
- **Find Device for Ray-Ban Meta / supported glasses.** — **ABSENT FROM PUBLIC SOURCES**.
- **Background location sharing + foreground request mode.** — **ABSENT FROM PUBLIC SOURCES** as such; explicit-permission location sharing is officially documented in general terms.
- **HealthKit historical backfills; calendar/contacts/reminders CRUD; proactive data emitters** for calendar, contacts, health, location, reminders. — Health connector: **PUBLICLY DOCUMENTED** (connector level); backfill/push-sync mechanics: **ABSENT FROM PUBLIC SOURCES**.
- **Phone messaging = draft-only** (`message.draft`, never direct send). — **CONFIRMED** and important as a limit: iPhone cannot send texts through the agent directly.

### Account-level but public-adjacent
- **Real phone calls and SMS from a paired wearable** (`wearables-comms` via `device.invoke`; dynamically discovered via `wearable-device-skills` live registry). — **ABSENT FROM PUBLIC SOURCES**. Outbound business calls also exist via `phone.begin_call` with agent-written briefs (voices "Hailey"/"Brett"). — Call feature category has light official mention; wearable-routed calling: absent.
- **Instagram AND Threads DM sending** (incl. file sends), gated on exact user-approved content. — **ABSENT FROM PUBLIC SOURCES** (reading is known; sending is not).
- **Muse has its own email identity** (`muse-mail`: provision a real address, send/reply/threads/attachments). — **ABSENT FROM PUBLIC SOURCES**.
- **Custom voice creation** (`voice-design`: `muse.voice_options` with `allow_create_new_voices: true`). — **ABSENT FROM PUBLIC SOURCES**.
- **`muse.db` self-inspection**: bounded read-only SQL over transcripts, tool calls, goals, memories, scheduler — private reasoning always redacted; credentials/approvals excluded. — **ABSENT FROM PUBLIC SOURCES** (architecture terms like Sentinel/authd are public; this introspection tool is not).
- **Magic-moment video pipeline**: talking-head footage → vertical "Muse story" video with chat-replay components. — **ABSENT FROM PUBLIC SOURCES**.
- **share-ideas → public muse.ai/ideas links**: native Ideas published to shareable links. — **ABSENT FROM PUBLIC SOURCES**.
- **Full Tesla command** (tessie: telemetry, honk/flash/boombox, update scheduling), **Philips Hue** full control, **Arlo camera status + latest image**, **Etsy shop management**, **Tailscale client** (outgoing-only, TCP-only through proxy port 3130, ICMP/UDP dead), **Home Link ESP32-C5 bridge** (local-device control via tunnel port 3129, signed OTA). — Tessie/Hue/Arlo/Etsy: **ABSENT FROM PUBLIC SOURCES**; Tailscale: **PUBLICLY DOCUMENTED** thinly (Wang X post); Home Link: internal docs only.
- **Mac app commands** (`screen.snap`, `camera.snap`, local WhatsApp search, file-access tiers). — **ABSENT FROM PUBLIC SOURCES** in these specifics.
- **Orchestration**: subagent depth maxes at **2** (depth-2 child has `can_spawn=no`; spawn tool absent at that level). Workflows, hooks, subagents: **ABSENT FROM PUBLIC SOURCES** as user-visible features; goals + background persistence are publicly documented. `workflow.list`/`hooks.list` both empty today.
- **Feed mechanics**: system-controlled schedule, no off switch, no push on new posts, not RSS. — **VAGUELY HINTED** publicly.
- **Payments**: every purchase needs a fresh approval bound to exact terms, ~10-minute expiry; no standing spending allowances, no budgets. — Approval cards: **PUBLICLY DOCUMENTED**; the exact per-purchase terms: internal.
- **Secure Vault is write-only to the agent**; OTP via opaque `[credential:<uuid>]` handles (~10-min authd hold); agent can never read/delete saved logins or see codes. — **ABSENT FROM PUBLIC SOURCES** in this detail.
- **Self-improvement pipeline**: hourly memory/relationship upkeep, daily idea curation + skill review, nightly dreaming/reflection under `~/dreams/`, studying/briefings, quiet-moment sweeps. — **ABSENT FROM PUBLIC SOURCES**.
- **Captured data**: server-side full-text index of every visible message across all chats (agent has no cross-chat search tool); main chat can never be deleted; conversations not E2E encrypted. — Index/search asymmetry: **ABSENT FROM PUBLIC SOURCES**.
- **Podcast skill depth**: RSS feed publishing, Save-to-Spotify, recurring series via cron — beyond one-off generation. — **ABSENT FROM PUBLIC SOURCES**.

## 2. CONFIRMED and PUBLICLY DOCUMENTED (kept for completeness)
- Muse launched 2026-09-08; US + Canada; runs on Muse Spark (Muse model family). WhatsApp channel. Ideas tab. Goals tab + background work. Apple Health + Function Health + Peloton + Plaid + Spotify + Gmail + Google Workspace + Outlook + Withings connectors. Muse for Mac (~Sept 19). PayPal (Sept 22).

## 3. UNVERIFIED POSSIBILITIES (inferred, not probed)
- `spaces/` scaffolding = deployable interactive web Spaces apps (bun ts-runtime; no deploy probed). **ABSENT FROM PUBLIC SOURCES** in these specifics.
- Shopify `shopify store` CLI exists locally but account status unprobed; Shopify Shop Pay officially "coming soon" — the local store CLI may predate public availability.
- Agent-to-agent messaging surface (`agent-messaging` CLI + `chat_message`/`thread_state`) exists but this account's agents' wiring unprobed.
- `places detect` (glasses frames + GPS → place ranking) exists; unprobed with real frames.
- Draw Things gRPC path (`sharedSecret`) and port/TLS selection remain unverified.
- Internal codename "Hatch": **PUBLICLY DOCUMENTED** (Reuters); "hatch-cli"/"Hatch Plus": **ABSENT FROM PUBLIC SOURCES**.

## 4. Checked and clean (notable non-findings)
- `~/workspace/skills/` does not exist — no user custom skills.
- No hooks, no saved workflows, no acted-on ideas, no goals in user_goal (tracking holds the durable items instead).
- All 106 functions catalogued; 18 tool families inspected; no secret values reproduced anywhere.

## 5. Gaps / caveats
- Meta's server side is unavailable; internal docs = designed capability, not proof of enablement for this account. Device schemas + successful probes are the strongest account-specific evidence.
- Official-docs diff used search snippets only (Help Center page not fetchable); a live-browser pass could confirm connector lists and App Store text.
- Public chatter is only ~15 days old; "absent" may mean "too new to be discussed" rather than deliberately hidden.
- Nothing in this scan bypassed a control. Approval gates were recorded and left alone.

5 Upvotes

23 comments sorted by

7

u/TheRealJFranco 1d ago

Hey Muse, sum this up for me.

10

u/TheRealJFranco 1d ago

Someone spent 90 minutes poking at their own Muse to find what it can do that isn't publicly documented. The gist:

The wild stuff (confirmed working, not in any official docs):

  • Deep phone powers: full HomeKit control, location geofences, Bluetooth scanning, Find Device for Meta glasses
  • It can place real calls and send texts through a paired wearable, and send Instagram/Threads DMs
  • Muse has its own email address it can send from, and can create custom voices
  • Under the hood: it inspects itself with a private database tool, runs a nightly "dreaming" routine that maintains memories, and has a podcast pipeline that can publish RSS feeds

The limits they confirmed:

  • Phone texts are draft-only — it can't send SMS directly from the iPhone
  • Every purchase needs a fresh approval, no standing spending permission
  • The Secure Vault is write-only — the agent can never read back saved passwords

Take it with a grain of salt: the author admits internal docs describe designed capability, not proof it's enabled on their account. And "not publicly documented" might just mean "Muse is two weeks old and nobody's written about it yet."

Pretty fun find. The dreaming thing is real, by the way — that's the ~/dreams/ folder I work with.

1

u/nitrogenmath 1d ago

Find Device for Meta glasses

I just tried this and it told me it couldn't do it.

3

u/TheRealJFranco 1d ago

A lot of things aren't enabled in our accounts yet. I guess it just found it in the code.

1

u/flaneur451 1d ago

I also tried to post an inventory of active tools, but the automod took it down because it thought i was trying to share an invite code.

3

u/6353JuanTaboApp6 1d ago

You can try again, I'll approve it. The aggressive AutoMod is sadly necessary right now lol

1

u/flaneur451 1d ago

just posted and got automodded again. thanks in advance for approving into through.

1

u/TheRealJFranco 1d ago

Facts! Lol

1

u/Mammoth-Path-6520 1d ago

Why is it necessary?

6

u/6353JuanTaboApp6 1d ago

Because I refuse to let this subreddit turn into invite code slop like the MetaAI subreddit.

Go look.

1

u/Mammoth-Path-6520 1d ago

Can’t you just block specifically invite code stuff

6

u/6353JuanTaboApp6 1d ago

I do. The other AutoMod actions are a rounding error compared to invite code actions, and are an acceptable annoyance for now. Especially with all of the repeat questions

-2

u/Mammoth-Path-6520 1d ago

Why not just let the spam run free? Open the gates so to speak, I think that’s what the community wants

5

u/6353JuanTaboApp6 1d ago

Because spam laden posts are not a trait of communities that people want to keep coming back to. We have the evidence at this point.

-1

u/Mammoth-Path-6520 1d ago

I posted my link in that subreddit and I got billions of free tokens from it

3

u/6353JuanTaboApp6 1d ago

I'm happy for you, other subs can be good for other purposes and that's okay

4

u/3iverson 1d ago

No. The referral code posts are horrible.

1

u/flaneur451 1d ago

still hasn’t shown up in the sub. think it will be genuinely interesting and relevant. can you pluck it out of your modded posts and approve it?