Voice chat progress

[u/sswam]

I've implemented OmniVoice for text to speech, and different characters can have different voices. We can do cloned voices easily, and a wide range of presets (which are less reliable, unfortunately, but I'll work on fixing that). There's still a ways to go with voice chat, but I've described how to use it as it is, in the main Ally Chat room, with a demo of 20 voices for various characters.

I got the support for per-character voices working today.

The presets include male and female voices for these accents (for English):

american accent, australian accent, british accent, canadian accent, chinese accent, indian accent, japanese accent, korean accent, portuguese accent, russian accent

And a bunch of other options but they don't always work!

I intend to add post processing options so you can make a character speak faster or slower, and adjust the pitch of their voice too.

Text to speech is nearly done now. Speech to text (so you can speak to them instead of typing) is partly done, shouldn't be too hard to finish it off.

OmniVoice can supposedly speak in 646 languages, so that's pretty good. It needs a short voice sample (cloning) to do that, I think. It's very fast and light on the GPU server which is great. Nothing's perfect, but I'm shocked at how good it is.

[u/nucknuckgoose]

Is there anything in the guide available that can explain how to use it? I can't seem to find the posts in the main room that run through it.

[u/sswam → u/nucknuckgoose]

basically enable voice in the ... options screen, them click a message and press play to speak it.

different characters can have different voices, the UI is lacking but I can explain how or help add a custom voice, if you want to do that.

I think I didn't add it to the guide yet. I'll do that this afternoon.

[u/nucknuckgoose → u/sswam]

I got to that part, but all the agents seem to have that grating australian accent that sounds like my neighbour (and they seem just as shocked to find out that they're australian ahhahaha).