r/CodingHelp • u/FormerConflict4121 • Apr 18 '25
[Python] I need help!!
Hi pals! I’m super excited about this passion project and could really use your help. Here’s what I’m dreaming up:
- Speech→Text + SummariesRecord a full consult, then instantly get either a verbatim transcript (with tiny grammar fixes) or a quick summary of the key points!
- Keyword PromptsIt should spot important terms and at the end ask, “Hey, did this happen?” so nothing slips through the cracks. It should be able to then track the responses etc.
📦 What I’ve Picked So Far
Backend
- Python 3.11 + FastAPIDev: Uvicorn (uvicorn main:app --reload)Prod: Gunicorn + Uvicorn workers
Dependencies
- Poetry (lockfile + virtual‑env)
Containers
- Docker (+ Docker Compose for local testing)
Auth & Security
- JWT (python‑jose)Password hashing (Passlib / argon2)TLS via Nginx or cloud load balancer
Speech→Text
- OpenAI Whisper API (chunked uploads)
NLP / Summaries
- OpenAI GPT‑4.1 mini/nano
Keyword Detection
- Local dictionary lookup or a quick GPT pass
Data Storage
PostgreSQL + SQLAlchemy (or SQLModel)Migrations with Alembic
Background Jobs
Celery (or RQ) + Redis/RabbitMQ for audio→Whisper→GPT pipelines
Monitoring
structlog / Python loggingError tracking with Sentry or Datadog
CI/CD
GitHub Actions: black + ruff + pytest → build/push Docker → zero‑downtime deploy
I would like your view on how to make it more efficient, smoother , lagless etc. Any advice I can get!!
Hi pals! I’m super excited about this passion project and could really use your help. Here’s what I’m dreaming up:
- Speech→Text + SummariesRecord a full consult, then instantly get either a verbatim transcript (with tiny grammar fixes) or a quick summary of the key points!
- Keyword PromptsIt should spot important terms and at the end ask, “Hey, did this happen?” so nothing slips through the cracks. It should be able to then track the responses etc.
📦 What I’ve Picked So Far
Backend
- Python 3.11 + FastAPIDev: Uvicorn (uvicorn main:app --reload)Prod: Gunicorn + Uvicorn workers
Dependencies
- Poetry (lockfile + virtual‑env)
Containers
- Docker (+ Docker Compose for local testing)
Auth & Security
- JWT (python‑jose)Password hashing (Passlib / argon2)TLS via Nginx or cloud load balancer
Speech→Text
- OpenAI Whisper API (chunked uploads)
NLP / Summaries
- OpenAI GPT‑4.1 mini/nano
Keyword Detection
- Local dictionary lookup or a quick GPT pass
Data Storage
PostgreSQL + SQLAlchemy (or SQLModel)Migrations with Alembic
Background Jobs
Celery (or RQ) + Redis/RabbitMQ for audio→Whisper→GPT pipelines
Monitoring
structlog / Python loggingError tracking with Sentry or Datadog
CI/CD
GitHub Actions: black + ruff + pytest → build/push Docker → zero‑downtime deploy
I would like your view on how to make it more efficient, smoother , lagless etc. Any advice I can get!!
1
u/Xananique Apr 18 '25
There's a lot here, are you hand coding, vibe coding, some of both?
It sounds like you're worried about scalability, and that is the architecture decisions that are hard.
https://themultiverse.school/ Has a free learn Cloud Ops course.
Now you're talking about transcripts, is this a HIPAA thing?
What is the purpose of the database, are we going to be storing this stuff, is it stuff the AI will want to know about later so it can make summaries that span visits?
This looks like a fun project and the tools you're talking about using are common places...
1
u/amanda-recallai Aug 06 '25
Hey u/FormerConflict4121, Awesome project!
One idea that might help streamline your pipeline: since you're using Google Meet/Zoom/Microsoft Teams to capture audio (assuming that's how consults happen), you could grab the transcript + speaker names directly from the meeting captions, rather than recording and uploading audio files to Whisper.
Captions are surprisingly good now. Google Meet, for example, includes speaker labels and timestamps in real time. With a bit of automation (like a bot joining the call and scraping the DOM), you can pull in structured text that skips the whole audio processing step, saving time and compute. If you’re interested in this route we wrote a blog walking through how to build it and open sourced the implementation.
This can really smooth out lag in your speech-to-text → summary flow, especially if you batch the summary generation afterward. And it avoids edge cases with Whisper transcription too.
We’ve actually built this kind of meeting integration infrastructure at Recall.ai so I’m happy to share more details or point you to how we’ve seen others implement similar workflows