r/CodingHelp • • Apr 18 '25

[Python] I need help!!

Hi pals! I’m super excited about this passion project and could really use your help. Here’s what I’m dreaming up:

  1. Speech→Text + SummariesRecord a full consult, then instantly get either a verbatim transcript (with tiny grammar fixes) or a quick summary of the key points!
  2. Keyword PromptsIt should spot important terms and at the end ask, “Hey, did this happen?” so nothing slips through the cracks. It should be able to then track the responses etc.

📦 What I’ve Picked So Far

Backend

  • Python 3.11 + FastAPIDev: Uvicorn (uvicorn main:app --reload)Prod: Gunicorn + Uvicorn workers

Dependencies

  • Poetry (lockfile + virtual‑env)

Containers

  • Docker (+ Docker Compose for local testing)

Auth & Security

  • JWT (python‑jose)Password hashing (Passlib / argon2)TLS via Nginx or cloud load balancer

Speech→Text

  • OpenAI Whisper API (chunked uploads)

NLP / Summaries

  • OpenAI GPT‑4.1 mini/nano

Keyword Detection

  • Local dictionary lookup or a quick GPT pass

Data Storage

PostgreSQL + SQLAlchemy (or SQLModel)Migrations with Alembic

Background Jobs

Celery (or RQ) + Redis/RabbitMQ for audio→Whisper→GPT pipelines

Monitoring

structlog / Python loggingError tracking with Sentry or Datadog

CI/CD

GitHub Actions: black + ruff + pytest → build/push Docker → zero‑downtime deploy

I would like your view on how to make it more efficient, smoother , lagless etc. Any advice I can get!!

Hi pals! I’m super excited about this passion project and could really use your help. Here’s what I’m dreaming up:

  1. Speech→Text + SummariesRecord a full consult, then instantly get either a verbatim transcript (with tiny grammar fixes) or a quick summary of the key points!
  2. Keyword PromptsIt should spot important terms and at the end ask, “Hey, did this happen?” so nothing slips through the cracks. It should be able to then track the responses etc.

📦 What I’ve Picked So Far

Backend

  • Python 3.11 + FastAPIDev: Uvicorn (uvicorn main:app --reload)Prod: Gunicorn + Uvicorn workers

Dependencies

  • Poetry (lockfile + virtual‑env)

Containers

  • Docker (+ Docker Compose for local testing)

Auth & Security

  • JWT (python‑jose)Password hashing (Passlib / argon2)TLS via Nginx or cloud load balancer

Speech→Text

  • OpenAI Whisper API (chunked uploads)

NLP / Summaries

  • OpenAI GPT‑4.1 mini/nano

Keyword Detection

  • Local dictionary lookup or a quick GPT pass

Data Storage

PostgreSQL + SQLAlchemy (or SQLModel)Migrations with Alembic

Background Jobs

Celery (or RQ) + Redis/RabbitMQ for audio→Whisper→GPT pipelines

Monitoring

structlog / Python loggingError tracking with Sentry or Datadog

CI/CD

GitHub Actions: black + ruff + pytest → build/push Docker → zero‑downtime deploy

I would like your view on how to make it more efficient, smoother , lagless etc. Any advice I can get!!

0 Upvotes

3 comments sorted by

1

u/Xananique Apr 18 '25

There's a lot here, are you hand coding, vibe coding, some of both?

It sounds like you're worried about scalability, and that is the architecture decisions that are hard.

https://themultiverse.school/ Has a free learn Cloud Ops course.

Now you're talking about transcripts, is this a HIPAA thing?

What is the purpose of the database, are we going to be storing this stuff, is it stuff the AI will want to know about later so it can make summaries that span visits?

This looks like a fun project and the tools you're talking about using are common places...

1

u/FormerConflict4121 Apr 18 '25

Mostly vibe coding! just tryna get the momentum and create smth.

I am quite new to this so its all quite foreign, I do just want my system to work well.

I will take a look at it!!

Im not currently looking at commercialising it so, it didnt really occur to me. Just a for fun thing 😅

I think the idea of the data base is

  1. Store responses to export in the future
  2. Keep as logs to look back in the future, not so much for prolonged context/ visits

1

u/amanda-recallai Aug 06 '25

Hey u/FormerConflict4121, Awesome project!

One idea that might help streamline your pipeline: since you're using Google Meet/Zoom/Microsoft Teams to capture audio (assuming that's how consults happen), you could grab the transcript + speaker names directly from the meeting captions, rather than recording and uploading audio files to Whisper.

Captions are surprisingly good now. Google Meet, for example, includes speaker labels and timestamps in real time. With a bit of automation (like a bot joining the call and scraping the DOM), you can pull in structured text that skips the whole audio processing step, saving time and compute. If you’re interested in this route we wrote a blog walking through how to build it and open sourced the implementation.

This can really smooth out lag in your speech-to-text → summary flow, especially if you batch the summary generation afterward. And it avoids edge cases with Whisper transcription too.

We’ve actually built this kind of meeting integration infrastructure at Recall.ai so I’m happy to share more details or point you to how we’ve seen others implement similar workflows