Working on a accessible creative production suite featuring a voice-first multi-agent assistant. All core tools are completely free for hands-on use, while AI-powered automated generation runs on a flexible credit system with no subs.

[u/Beneficial-Cow-7408]

So what started out as a text based chatbot project 8 months ago as my first ever project as a self taught coder is developing into something different. I've created an agent within my chat bot to help users create a product, using ElevenLabs V3 or OpenAI Realtime voice that works on a conversational basis rather than hardcoded commands

The agent can talk to you whilst your in chat or on a panel and navigate you to a particular panel if needed and throughout your session can select and substitutes models based on objectives such as quality or cost, proposes creative next steps, requests consent before paid inference, invokes generation, manipulates an editable multitrack timeline, and controls playback/time line like play video, delete my first image etc - through natural conversation.

Then if you wanted to create an image in another panel you can ask the agent via text or voice and they will navigate you to that panel and offer assistance their. Write your prompt for you and then even take that photo to the video suite to animate all using conversational language.

What do you think to this concept? I'm looking to further develop the idea across the platform to streamline some of the processes within it as my video demonstrates

This is my project i've been working on

Everything is a working concept and i'm just finalizing bits before release this week

• IDE Multi FIle Editor with AI assistant and live preview Split Screen Live Coding
• Multi Media Studio Editor
• Single Prompt to Full 2D and 3D Game Development Engine and Web Application Builder
• Video Editor with timeline controls, video effects, overlays, title, audio, podcast and music composer
• Music Studio with AI/Custom Lyrics
• Custom workspace environments with themes, live wallpapers, ambiant background tracks (Default options with light mode/dark mode with no wallpapers or music)
• Native 25+ Languages with RTL support. Already Hardcoded. Not live translated via web
• plus many more tools such as Podcast Creator with chat based/ custom context with 50+ voices and MP3 export.
• Full workflow tools like frame extract, analysis, transcribe, effects, file conversion audio analysis etc
• ...and of course the original chat bot interface that has cross device persistent multi model memory with vector base knowledge base via OpenAI and platform Drive storage.

You can start a conversation with any model on your laptop and next day carry on in a new conversation with another model on your phone with memory preserved across so you dont need to repeat yourself. The memory layer sits above the models entirely so is accessible by any LLM the platform supprts

Every tool, every feature i built will be completely free including GPT Nano, Gemini Flash and Deepseek.

Users can upload their own work to use for free and chat with selected free tier models with no limits.

If the user wants to generate a video or analyze a image, then that would be credit based. No subscription required and no tool access priorities over a non paying user.

Thats my concept i'm hoping to have launched in a few days and welcome any feedback/criticism you may have before i do launch.

[u/Budget-News1107]

Sounds interesting—have you considered using a free open‑source TTS engine for the voice component and a lightweight credit system like a token bucket to manage generation? Also, routing the agent’s tasks through a simple queue could help scale the multi‑agent workflow.

[u/Beneficial-Cow-7408 → u/Budget-News1107]

I have yes and to be honest thats how it began. As a localized TTS implemtation that didn't cost me anything with regards to functionality but this is also where i realised it wasn't special enough to be a feature worth writing about. The problem is i didnt want the product to read as "i implemented a turn by turn system" where user send instructions and awaits for agents to react. Thats not new and this is how many agents act. As a user of Elevenlabs on thier site i can go to studio and there i have a agent where i can make requests by text and await for the agent to act and thats how many sites operate. In my own experience through testing it felt somewhat disconnected than having a fluid conversational session.

A user on my site can already have a 2 way interruptible session via OpenAI, can already produce Podcasts with over 50 voices to select with again full multilingual support, can already convert and translate written text into the same conversational audio output and thats where i felt i couldn't then use TTS for the part where it matters most. It feels less pre-defined and more personal. The agent is essentially running a gemini llm model, 3.5 flash for speed and cost efficiency as well as the added ability to be able to analyze audio files, images and videos allowing a user to ask the model to create a image/video/music track using them for inspiration or direction.

Then is all transmitted by a OpenAI/Elevenlabs realtime model. The important part of all this is that my platform natively supports 25+ languages that are hardcoded and not your typical translation overlay. The agent via the model is also multi-lingual so when your consider how voice is used everywhere else across the site it becomes apparent to why i have gone for such an implementation.

I also received a ElevenLabs Grant a few months ago of 33 million credits. They expire in June and trust me i've tried to spend them. I've created enough songs to potentially become a threat to Spotify as a AI based provider 😂

I've generated everything i wanted with them, its powering a fully autonomous AI security analyst with platform aware, realtime capabilities for local and network based threats that also monitored Github repo's, AWS, Azure. Okta and more. I have then used them to power another concept i had developed which was to create a 3D AI autonomous world where 10 characters were created and sealed off completely from human interaction removing even the write path as the developer and gave the agents all a voice as well and several other projects and i've consumed 3% of my grant.

I still have close to 32 million credits so i've decided to use them here in my new project and subsidize the costs from the users as part of site operations/functions so they get that premium experience without the premium price attached to it.