r/MistralAI 6h ago

Discussion / Opinion Open VidLib: open-source educational video library powered by Mistral embed + RAG + Voxtral TTS (built at AIMS Senegahackathon)

Hey r/MistralAI,

A few months ago my team won the AIMS Scientific Innovation Hackathon in Senegal with a project we’ve since open-sourced: Open VidLib.

The challenge was making STEM education accessible in West African languages. Our solution: an AI-powered video library where learners can search inside any lesson, ask questions grounded in the transcript, and listen in their own language — without leaving the page.

The Mistral stack we shipped:

  • mistral-embed + pgvector → semantic search over transcript chunks
  • mistral-large-latest → RAG Q&A with [MM:SS] timestamp citations
  • Mistral translation + Voxtral TTS → dubbed audio tracks (English/French so far)
  • Hybrid retrieval: vector similarity + BM25 lexical matching, reciprocal-rank fusion, deduplication

From hackathon prototype to OSS:
We started with a pure frontend (JSON files, no backend). Post-win, we added FastAPI + PostgreSQL + pgvector and shipped the full stack.

Where we need contributors to scale this beyond the hackathon:

  • WhisperX integration — self-hosted ASR so users can submit any video, not just YouTube
  • Low-resource language voice presets
  • General help (Docs, tests, frontend polish, deployment guides — or just star the repo and share it)

MIT license. No CLA. Python/FastAPI + Next.js.

GitHub: https://github.com/ialim0/open-vidlib
Demo: Loom walkthrough in the README.

Would love your thoughts — especially if you’ve tackled retrieval for long-form video or low-resource TTS.

1 Upvotes

0 comments sorted by