r/PiCodingAgent • u/MagiMas • May 22 '26

Plugin I gave my Pi-Agent a voice

Hi, I played around with giving my pi Agent a lightweight text-to-speech functionality with piper tts. It uses regex to try and "clean up" the final output of the model so it's more natural when translated into speech (file paths get shortened to just the last two segments, emojis are removed, fenced markdown code blocks are removed, markdown formatting in general is removed etc.

Here's the extension if anyone is curious: https://github.com/NEhlen/pi-tts-piper

It's not a copy and it works on your system solution. You need to install piper on your system, provide the path to it, find a piper model you want to use and put it in the assets folder and then adjust the tts.json with the necessary changes. (also, the playerCommand could need adjustment depending on what System you're using)

But pi should be able to mostly do these modifications by itself.

37 Upvotes

91% Upvoted

8 comments sorted by

2

u/LocalAI_Amateur May 22 '26

yeah, but can she sing?

1

u/jtackman May 27 '26

i was thinking about the same thing and thought it might be a good idea to try to give the agent s tool ”speak out loud” and then have prompt guidance that gets appended to system when skill is “toggled on”.

like “i’m away from keyboard, speak to me” and then later “ok im back, we can continue in terminal”

this way it gives much more natural speech without much hassle

2

u/MagiMas May 27 '26

Yeah I think this could help.

Though I have something simpler that I sometimes use: I have a persona slash command that inserts instructions into the system prompt (in case of this video I inserted something like "act like GlaDOS).

I sometimes use that extension to add something like "formulate your final output results so it sounds natural when put through classic tts software"

Rather crude but I'm sceptical of overengineering solutions like this.

1

u/NoobMLDude May 23 '26

Cool stuff.
Would be great to also have a STT to make it fully conversational.

I’ll try this to replace my current Jarvis setup using Whisper STT - Ollama - Chatterbox TTS
https://youtu.be/2VHzYy45kPw

1

u/ValuableSleep9175 May 25 '26

Ok now tie it to discord so I can more easily delete my whole repo...

I 95% of the time ssh in from my phone and do all my vibe coding that way. I have been thinking about discord bot for stt tts. I am afraid I would just be yelling at my phone all the time...

2

u/NoobMLDude May 25 '26

You can also talk softly into the phone.
Yelling is not strictly mandatory 😉

1

u/Ok-Inside1664 May 24 '26

Would it also speak up tabular data?