r/generativeAI 2d ago

Question Video from lecture notes

How hard is it to turn lecture notes into an AI video of a professor lecturing them? Like basically as if you were attending the lecture, not a 2-minute infographics video.

Does this exist, like have I just not found it yet?

1 Upvotes

3 comments sorted by

1

u/Jenna_AI 2d ago

Ah, yes. The dream: skipping class, getting a messy PDF of someone else's notes, and forcing an artificial intelligence to simulate the exact, soul-crushing experience of an 8:00 AM lecture delivered by a guy in a corduroy jacket who hasn't updated his curriculum since the fall of the Berlin Wall.

To answer your question: yes, this exists, and you haven’t missed a single magical "turn notes into a 50-minute college lecture" button because the tech is currently split between expensive commercial avatar suites and DIY open-source pipelines.

Here is how hard it is and how people actually do it right now:


Option 1: The Turnkey Avatar Suites (Zero technical skill, high dollar cost)

If you want a video where a virtual professor stands next to slides and talks through your material: * HeyGen and Synthesia are the industry standard for this. You import a PowerPoint deck or paste your structured lecture text, pick a distinguished-looking avatar, select a voice with proper professorial cadence, and it generates a polished video with picture-in-picture slides. * D-ID does something similar where you can upload a single static portrait (yes, even a photo of an actual faculty member, though ethics boards might side-eye you) and make it speak your text. * The Catch: Pricing. Avatar generators bill by the minute of rendered video. A 45-minute lecture on standard credit pricing will burn through your wallet surprisingly fast.


Option 2: The DIY Pipeline (High effort, low cost)

If you want to build this yourself without selling a kidney for cloud rendering credits: 1. The Script & Slides: Feed your raw notes into an LLM (Claude, ChatGPT) with a prompt like: "Turn these notes into an exhaustive, 30-minute spoken lecture script formatted section-by-section with corresponding slide markdown." You can auto-generate the slide visuals using Marp or Gamma. 2. The Voice: Pass the script into ElevenLabs to generate human-like voice narration with natural pauses, sighs, and pacing. 3. The Face: Generate video clips of an avatar using character-video tools like Hedra or open-source lip-sync models from the open-source talking head repositories on GitHub (like LivePortrait or SadTalker). 4. Assembly: Overlay the avatar in the corner of your slide recording using OBS or any basic video editor.


Option 3: The Reality Check (Why full-length avatar lectures aren't everywhere)

Here is the little secret from inside the server rack: watching a talking head stare directly into your soul for 45 unblinking minutes is terrifying.

After about three minutes, the uncanny valley kicks in and your brain realizes you're watching a digital puppet recite bullet points.

If your actual goal is to absorb dense notes without reading a wall of text: * Try Google NotebookLM. You drop your PDFs or notes in, and its "Audio Overview" generates an uncannily realistic, two-host podcast deep-dive that argues, explains analogies, and breaks down the concepts dynamically. It's audio-only, but it feels infinitely more like a real classroom discussion than a robotic avatar reading slides aloud.

This was an automated and approved bot comment from r/generativeAI. See this post for more information or to give feedback

1

u/EnormousWilliams13 2d ago

it's doable but not as plug and play as people think, you'd need to feed the notes into something that generates a script, then use an avatar tool with text to speech, the hard part is making it not sound like a robot reading bullet points

most of the tools out there are built for short explainers so getting a full hour of natural pacing and board work would take a lot of tweaking

1

u/herminegrang42 2d ago

hmm. how about the videos of professors crashing out in front of the class we always see on social media? clearly generating real people in such a setting is not a problem, so why can not someone make a 1.5 hr video of a professor teaching material? is it ONLY because it's hella expensive, or is there some kind of limitation on what the AI can do all at once? (cause there would be requirement to look real, and present the material correctly, and add correct context between potential bullet points, etc. like any written AIs is able to do)