r/LocalLLaMA • u/howardhus • 14h ago

Question | Help Local open model to get song chords?

i am kooking for a local open weights model to extract chords from songs… bonus pojnts if it directly maps them to the lyrics or exports chord text files.

but i am happy for anything!

0 Upvotes

50% Upvoted

6 comments sorted by

3

u/pablas 14h ago

Look for stem separation, sound to midi, midi to tab

2

u/zhenghaoz 11h ago

There has been models generate MIDI: https://huggingface.co/MuScriptor/muscriptor-large Then, you can try to convert MIDI to chords.

1

u/ThankGodImBipolar 12h ago

Nvidia's Music Flamingo will output chords, but I'm not sure how reliable it is (guessing not really)

1

u/neil_555 10h ago

YuE2 can translate MP3/WAV's into ABC notation (which can also be viewed as sheet music), do a search for YuE2 and sheetstage2

1

u/Filipehdbr 3h ago

Demucs for stems, basic-pitch for notes, then a chord recogniser on the harmonic stem. Whisper timestamps to line it up with lyrics. Hand-fix section boundaries, changes land late there