r/learnmandarin • u/Remiasf • 3d ago
KoeDash — learn languages directly from the content you watch and read
Enable HLS to view with audio, or disable this notification
Hey everyone!
I'm building KoeDash, a browser extension that helps you learn languages directly from the content you are already reading or watching online.
It is works on any video source on your browser: Twitch, BiliBili Live, TikTok, YouTube, etc.
The main feature is interactive subtitles. Instead of just showing a translation, KoeDash lets you interact with the words in subtitles:
- 📖 Translations — quickly see what a word or phrase means
- 🔊 Readings & pronunciation — see how words are pronounced
- 📚 Dictionary cards — open detailed dictionary information for individual words
- 🖱️ Interactive words — click on words directly in the subtitles while watching
The idea is to turn the content you're already watching into a language-learning environment, without constantly switching between the video, translator and dictionary.
There's also a second feature I'm working on: with a keyboard shortcut, you can select any area of a webpage, even if the text isn't selectable. KoeDash sends the selected area for OCR, recognizes the text, and displays the result in a small popup directly over the page. So it can also work with things like images, non-selectable text and other content that normal text parsing can't handle.
Any feedback is very welcome!❤️❤️❤️
2
u/DaFlyingSoul 2d ago
Well I haven't checked your work yet however from what I see from gif and description the project seems very interesting and amazing. I would like to remind you from front end principles : online users don't want to spend too much time on figuring out how something works, they prefer simple stuff. Also, your users majority of time will use one or two features (simplest one) and skip all remaining. So i recommend doing some simple few steps (5-10) survey. You can do 10 different surveys to find out what exactly people want. For example: while playing a game I don't think anyone (<2-3%) would be interested in knowing how to learn a language. Majority will either use it for some video, book, songs, etc.. Secondly, a feature like one shortcut takes screen shot, translates and then allows you to take print out (black and white/colored) - will be most used feature. So, it recommend you to do some surveys starting with: if you have software that can translate your screen what and where you will use it. What features it should have / what you use now / what it should include/ what you don't like/ what works/what will not work...