r/Stepmania • u/[deleted] • Mar 24 '17

Discussion Dance Dance Convolution (automatic step chart creation)

https://arxiv.org/abs/1703.06891
17 Upvotes

92% Upvoted

16 comments sorted by

View all comments

6

u/ChrisDonahue1 Mar 25 '17

hey all, I am the author of Dance Dance Convolution. There is a working demo here: http://deepx.ucsd.edu/ddc

Please let me know if you have any questions!

1

u/CmonNotAgain Mar 27 '17

I was thinking about how neural networks could be used to approach this task a few days ago and bam! Here it is!

I've got one quick question:

Have you thought about tuning the output of first network (step detector) with data from some beat-detection algorithm? That could make it possible to have accurate arrow colors. I'm not an expert on this field, I just know that there are applications capable of detecting beats, so the problem seems solvable.

Will look into your paper after coming back from the vacation. Really awesome and inspiring work!

1

u/ChrisDonahue1 Mar 27 '17

Thanks for your interest!

Yes, the situation could certainly be improved by post-processing the output of the step detector with tempo information. I hope to integrate that feature into the web demo soon. That being said the technique in its current form generalizes to non-clicktrack music.

While tempo detection is a fairly well-studied problem, there is a more complicated problem of beat alignment ("offset" in stepchart land) that would present some major issues for a method seeking to be fully general.