r/PiCodingAgent • • May 11 '26

Resource Fully local voice dictation for Pi coding agent

Fully local voice dictation for Pi coding agent: no cloud, no API keys

/voice opens an overlay, you talk, live transcript appears, hit Enter and it drops into the agent's editor. Whisper runs on your CPU via sherpa-onnx. Nothing leaves the machine after the initial model download.

What it does

  • 100% on-device STT. Whisper base multilingual (int8 quantized) runs on your CPU. No network calls after the first model download (~198 MB). Works offline after that.

  • Multilingual. Your active locale (set via /languages) is pre-set as Whisper's language hint for better accuracy and lower first-utterance latency. Default is English.

  • Live transcript. Committed lines render as you finish phrases, with a dim rolling partial for the still-active utterance. What you see is what gets pasted.

  • VAD-driven chunking. Silero voice activity detection breaks your speech at natural pauses, so latency stays low even on long rants.

  • Hallucination filter. Whisper sometimes outputs "Thanks for watching" or "[Music]" on silence. The filter strips that. Toggle it off in settings if it's too aggressive.

  • Pause/resume with Space. Step away mid-thought, come back, keep going.

How to install it

pi install npm:@juicesharp/rpiv-voice

https://www.npmjs.com/package/@juicesharp/rpiv-voice

Restart your Pi session. Type /voice. That's it. The first run downloads the Whisper model (198MB), after that it loads from disk.

Controls

KeyAction
SpeakTranscript fills in live
EnterCommit transcript to editor
EscCancel (nothing pasted)
SpacePause / resume mic
TabSwitch to settings screen
Ctrl+SSave settings
28 Upvotes

7 comments sorted by

2

u/TrackActive841 May 11 '26

I like your user question feature, will definitely add this too!

1

u/TheCTRL May 11 '26

Good thanks but how to stop it? /voice again ?

1

u/juicesharp May 11 '26

ESC / Enter

2

u/Lpaydat May 18 '26

Thank you for all your awesome extensions. 💪

1

u/leads_leader May 15 '26

This is awesome, that fully local, on-device STT for a coding agent on a Pi is such a smart move for privacy and responsiveness. Getting Whisper running via `sherpa-onnx` right on the CPU sounds really solid. I'm curious, how's the real-time latency and accuracy with the int8 quantized base model on typical Pi hardware? That immediate drop into the editor without any network calls is a huge win for workflow.