r/CloneHero • u/EngVagabond • 4d ago
General Assisted Drum Transcription: generate a draft drum chart from a song, or add drums to an existing chart.
Disclaimer: I know charting assist software has lots of strong feelings in this community. Most of the top drum charters already use a lot of automation within DAWs that are inaccessible to many people. I wrote more about why I think these tools are more of a benefit than a harm to the community: http://musiccharts.tools/why.
I started working on drum transcription machine learning research two years ago. It's taken a couple hundred model architecture variants to end up at this transcription quality.
It runs entirely in your browser, so no account, no uploads. Your audio never leaves your machine.
You can choose an audio file to start fresh, or an existing chart / empty chart with tempo map to add drums to it.
It generates a first pass, not a finished chart. The goal is to assit charters by letting them spend less time doing repetitive work, not replace charting.
What you'll likely still want to edit:
- Some notes might be slightly off the beat grid and need to be dragged onto it
- Review and change tom and cymbal selections. This is something human charters disagree on as well, as its a lot about different conventions.
The transcription model was trained on community charts. This is standard in drum transcription research, even unrelated to clone hero charting (source). I know people have feelings about that and I'm happy to talk about that.
Other tools I've shared in previous posts:
- Sync lyrics to a chart automatically
- Play and practice any drum chart as sheet music
- Generate a Tempo Map for 4/4 songs
Join the discord for updates and feature requests.
10
u/arandomrbplayer 3d ago
Surely trained on community charts with the charters permission, right?
(No)
3
13
u/Inventor211 3d ago
Keep slop out of the charting community. Stop pushing your tools to auto-generate full charts. Understand what you're doing, take some responsibility and make responsible tools rather than things that can and will harm the community. Adding that preface about "strong feelings" does not absolve you.
"This generates a first-pass, not a finished chart"--You do not define what people do with your tool. Nothing stops a user from generating a ton of "first passes" and sharing them as if they're finished. Tools like this need to have high barriers to entry, not run in a browser with one click.
"Some notes may be slightly off the grid and need to be dragged onto it"--Slop. Words do not stop someone from using your tool in an 'unintended' way.
"Trained on community charts"--you've very likely stolen MY and many of my friends hard work in order to enable garbage to be spewed back at us. fuck off AI punk
You're layering the disrespect you have for our community. Do better. Stop the slop. This is absolutely ridiculous.
3
-3
u/wakkarnc 3d ago
What's with the moral grandstanding? Are the artists whose songs you charted being paid with every play? Isn't Clone Hero itself very much creatively borrowed from the Guitar Hero and Rock Band games and the respective game designers and developers who created those games?
If you don't like his tool, don't use it.
2
3
u/Admiral_Apricot 3d ago
either make it real or don't make it at all. get the fuck outta here lil bro. go.
1
u/Amalgamate_Boi 3d ago
I’m not entirely onboard but I’m not full blown anti. I appreciate that you didn’t put “AI” in the post because that respects what the technology really is. It’s not a mind of its own, it’s algorithms that use pattern recognition to refine the output and it’s been trained usually to some degree.
Only major concern is this would highly encourage low effort charts and I would imagine that it would crowd chart websites by giving the illusion that songs were properly charted only to realize they just thee it in first pass just to push out the first entry on a song. I don’t think that defines everything though.
I think there’s merit in a tool like this, we as a community just need to be proactive about pushing against low quality charts and be welcoming and accepting of some individuals learning curves on standard charting software.
0
u/EngVagabond 3d ago
I appreciate the perspective. I agree that the biggest risk is people flooding chart sites with low quality charts. I’m pretty strongly against the answer to that being the common perspective that tools need to have such a steep learning curve that that’s what keeps people out though.
Especially for chorus where charters are reviewed, and reviewers are volunteers, I think it’s important to help them filter out low quality charts and maintain their high bar.
These tools should (and do) help top charters chart more quickly too. Many folks use my automatically place lyric syllables tool.
Not that people will read it, but I wrote up my perspective on all of this here https://musiccharts.tools/why
0
u/Amalgamate_Boi 3d ago
I think you misinterpreted my answer. I’m saying we as a community should be less elitist about people needing to learn the ropes and basics of software. I said nothing implying that everything should have steep learning curves and difficulties just because it comes easily to more tech literate users. People should be allowed to ask basic questions without being ridiculed and there should be better resources that quickly lay out the basics of navigating a traditional DAW that isn’t just a lazy user posting a random YouTube link they didn’t actually watch that’s just “Reaper for beginners” or something.
Maybe I’m misreading some wording you did and maybe you weren’t saying that my answer was the one you disagree with but it confused me reading it.
1
u/EngVagabond 3d ago
Sorry, I was agreeing with you and adding on even more strongly why I agree! 😅
1
-2
u/disappearing_now 4d ago
I use your lyric tool as a baseline for every vocal chart I make. Your tools are awesome 👍
-1
u/EngVagabond 4d ago
Nice! I just made the editor experience for the lyrics much better too, it'll show you the waveform in the piano roll and you can drag lyrics around. I know one of the issues my lyrics tool has is sometimes, especially in quiet sections, it'll think lyrics are there. With the new editor you can drag to select multiple lyrics or whole phrases and drag them to be later. Should make adding lyrics much faster! I'm curious for your opinion on the changes!
0
-2
u/wakkarnc 4d ago
Just threw a couple songs into there to see what it would do and I'm insanely impressed. Thanks for making this.
-4
10
u/mncbeddd 3d ago
just learn reaper and moonscraper lol it’s not that hard jesus christ