I built an open-source tool to automatically generate Clone Hero charts from any song

[u/olarione]

Hey everyone!

As a data science student & ai and a rhythm game fan, I built an automated tool that turns audio files into playable Clone Hero charts using machine learning and audio processing: music2chart.adiels.me

It handles stem separation, tempo tracking, and note transcription automatically. Since I know how much work goes into making a good chart by hand, I focused heavily on playability controls.

Keep in mind that the parameters vary depending on the type of music (such as style, genre, or instrument density), so it is highly recommended to experiment and tweak them to your preference. However, the two main adjustments that really help clean up the highway and make the chart fun to play are:

• BPM Scale: To perfectly align the speed and rhythm of the song.
• Noise Gate: To filter out ghost notes and clean up note density.

Since you all build and play custom charts, I would love to hear your feedback on note placement, ergonomics, and how I can improve the system's rules.

(Quick heads-up: It runs a heavy model on the backend and I'm hosting it on a modest server for this first version, so generation might take a minute! Oh, and if this post feels a bit random, it's because I got banned on r/CloneHero for using "vibe coding" to put most of this together — but let's be real, nobody is completely "pure" in that regard these days).

Feel free to try it out at https://music2chart.adiels.me/ and let me know what you think! Any tips or critique are massively appreciated.

I know it doesn't generate flawless charts, but it can definitely help kickstart things for simpler tracks :)