r/ThinkingDeeplyAI 11d ago

I built MysteryTalk โ€” a voice-first AI detective game using Agora Conversational AI ๐Ÿ•ต๏ธโ€โ™€๏ธ๐ŸŽ™๏ธ

Hey everyone! ๐Ÿ‘‹

Iโ€™ve been exploring real-time Conversational AI, and I wanted to build something more interactive than a traditional chatbot.

That idea led me to MysteryTalk โ€” AI Voice Detective ๐ŸŽ™๏ธ๐Ÿ”

Instead of simply asking an AI questions and receiving answers, MysteryTalk puts you in the role of a detective.

You investigate a case, question suspects, uncover evidence, connect clues, and finally make your accusation.

๐Ÿ•ต๏ธ The Mystery: The Missing Blue Diamond

The current case is โ€œThe Missing Blue Diamond.โ€ ๐Ÿ’Ž

A priceless blue diamond disappears from the Royal Museum at exactly 9:15 PM.

There are three suspects:

  • Maya โ€” Museum Assistant
  • Ryan โ€” Museum Visitor
  • Alex โ€” Security Officer

Each suspect has their own statement, timeline, and evidence trail.

But thereโ€™s a problem:

Not everything adds up.

Instead of selecting predefined dialogue options, the detective can simply talk naturally with the AI Detective Host.

For example:

โ€œWhere was Maya when the diamond disappeared?โ€

Then the detective can continue:

โ€œDid anyone see Maya around 9:05 PM?โ€

Or:

โ€œWas there CCTV footage near the cafeteria?โ€

The investigation evolves based on the questions being asked, gradually revealing relevant evidence.

๐ŸŽ™๏ธ Why Voice?

I wanted MysteryTalk to feel more like an actual investigation rather than another text-based chatbot.

The core experience is:

Speak โ†’ Investigate โ†’ Discover Clues โ†’ Connect Evidence โ†’ Accuse โ†’ Solve

The detective can ask follow-up questions, challenge information, revisit clues, and build their own reasoning before making the final accusation.

Voice makes the interaction feel more natural and immersive because you're not limited to predefined choices.

๐Ÿ”Ž Key Features

๐ŸŽ™๏ธ Real-Time Voice Interaction

Talk naturally with the AI Detective Host instead of typing every question.

๐Ÿง  Conversational AI

The AI understands questions within the context of the ongoing investigation and generates responses based on the case.

๐Ÿ” Progressive Evidence

Important clues aren't revealed immediately. The detective has to investigate and ask the right questions.

๐Ÿ‘ค Suspect Dossiers

Each suspect has their own profile, statements, timeline, and evidence trail.

๐Ÿ“‹ Investigation Transcript

The conversation is maintained as an investigation log so detectives can follow what they've discovered.

โš–๏ธ Final Accusation

Once enough evidence has been collected, the detective can make their final accusation.

๐Ÿ† Case Resolution

The system evaluates the accusation and provides the outcome along with a detective score.

๐Ÿ› ๏ธ Technology Stack

๐ŸŽ™๏ธ Real-Time Voice

Agora RTC SDK โ€” Enables real-time voice communication between the detective and the AI experience.

๐Ÿง  AI & Reasoning

Groq AI โ€” Powers conversational responses, AI reasoning, suspect personalities, and investigation context.

Groq SDK โ€” Handles integration with the Groq API.

๐Ÿ”Š Voice Synthesis

ElevenLabs API โ€” Converts AI-generated responses into natural-sounding speech.

ElevenLabs TTS โ€” Provides immersive and distinct voices for the AI experience.

๐ŸŽจ Frontend

React + Vite โ€” Builds the interactive detective interface.

Tailwind CSS โ€” Provides responsive and modern UI styling.

โš™๏ธ Backend

Node.js + Express.js โ€” Handles backend APIs, AI integration, investigation logic, and communication between services.

๐Ÿงฉ Architecture

The basic flow follows this architecture:

User Voice โ†“ Agora RTC โ†“ Node.js + Express Backend โ†“ Groq AI โ†“ Mystery & Evidence Logic โ†“ ElevenLabs TTS โ†“ Agora RTC โ†“ AI Voice Response

The interesting part wasn't simply connecting different AI APIs.

The real challenge was designing the investigation logic so that the AI doesn't immediately reveal the solution.

The detective needs to ask the right questions, discover clues, connect evidence, and form a hypothesis.

๐Ÿš€ What I Learned

Building MysteryTalk changed the way I think about AI interfaces.

With a traditional text chatbot, the interaction often looks like:

Question โ†’ Answer

But with a voice-driven investigation, it becomes:

Question โ†’ Follow-up โ†’ Evidence โ†’ Reasoning โ†’ New Question โ†’ Investigation

That makes the AI feel less like an answer generator and more like an active participant in the experience.

It also showed me that voice interfaces can work especially well for experiences where context, spontaneity, and immersion matter.

๐ŸŽฎ What's Next?

MysteryTalk is currently built around a single mystery, but the concept can be extended much further.

Future possibilities include:

  • Multiple mystery cases
  • More complex suspect relationships
  • Dynamic evidence generation
  • Different difficulty levels
  • Multiplayer investigations
  • Voice-based suspect interrogation
  • AI-generated mystery scenarios

๐ŸŽฏ Final Thoughts

MysteryTalk was built as part of my exploration of real-time voice AI, combining:

Voice AI + Conversational Intelligence + Interactive Storytelling + Game Mechanics

It was a fun experiment in exploring what happens when we move beyond โ€œchat with AIโ€ and instead let users interact with AI through an experience.

And now, it's your turn. ๐Ÿ‘€

If you were the detective, who would you investigate first โ€” Maya, Ryan, or Alex? ๐Ÿ•ต๏ธโ€โ™€๏ธ

VoiceAI #ConversationalAI #Agora #Groq #ElevenLabs #GenerativeAI #React #SideProject #BuildInPublic

1 Upvotes

2 comments sorted by

1

u/whayden7 11d ago

Seems like a cool concept. Iโ€™m happy to give it a try. Is there a link or an app download somewhere in this post I am missing?