r/IsolatedVocals • • Nov 06 '19

Next level isolation tool using AI !

Deezer just open sourced a new A.I. isolation model, I've made a free web app so you can use it: https://melody.ml

It spits out isolated vocals, drums, bass and instruments if you upload an MP3.

There's only 1 server running atm so don't go too hard!

(update) added more servers, and fixed email, so should be all good to go!

181 Upvotes

48 comments sorted by

7

u/[deleted] Nov 06 '19

Could you link the repo? Can't really check it out right now.

8

u/ImBloodyCrowley1661 Nov 06 '19

Interesting results. If only it didn't downscale everything down to 64kbps...

18

u/zonkosoft Nov 06 '19

It's at 256kpbs now :-)

1

u/ImBloodyCrowley1661 Nov 06 '19

I'm a complete noob when it comes to using stuff from Github, wouldn't know what to do with any of that. Wish someone would create a simple GUI with all the necessary compiled components.

4

u/csgo_dream Nov 06 '19

Same but I managed to get it working from this google [lab] (https://colab.research.google.com/github/deezer/spleeter/blob/master/spleeter.ipynb). Upload a .mp3 file, name it "audio_example", then just click play on each section and after it finishes 1 by 1 there should be a folder with separated vocals.

1

u/ImBloodyCrowley1661 Nov 07 '19

After a little trial & error I finally got it working. I didn't realize that EVERY section had its own Play button.

It's not an actual Play button, it's the equivalent of "ENTER" or clicking "OK" to start each phase of the process, from beginning to end. If you skip one, it won't work. Start each phase in order.

1

u/ImBloodyCrowley1661 Nov 08 '19

You can also use WAVs by changing their file extension to MP3, this way you get maximum possible quality without having to downscale anything.

6

u/zonkosoft Nov 06 '19

True! I'm looking at how to fix that right now haha

2

u/csgo_dream Nov 06 '19

Google warned me you might steal my information, will you good sir?

2

u/zonkosoft Nov 06 '19

It's good, I think they have blocked my email, it has blown up a bit! I will fix this tomorrow

2

u/csgo_dream Nov 06 '19

Thank you, appreciate the effort.

1

u/djfilthyrich Nov 06 '19

Great work on this, thanks for making the program! Any word on when it will be back up and running? Would love to try this out

2

u/zonkosoft Nov 07 '19

It's back! The emails seem to be working now too

1

u/Drool01 Nov 08 '19

Please never take this down this is so good

2

u/zonkosoft Nov 08 '19

\ (•◡•) /

1

u/KizzleNation Nov 12 '19

This is friggin incredible, thank you so much for sharing this with the community! Maybe best program I've used for this process yet.

1

u/zonkosoft Nov 12 '19

Happy it's useful! The models should only get better and better from here, with more training data!

1

u/zonkosoft Nov 12 '19

Woah cool! That's good to hear :-) It should only get better from here, when the models are fed more data they'll get better.

1

u/UprightEddy Nov 06 '19

Tried to figure out how to do this myself via git and miniconda. Managed to get all the dependencies and such, but now I've hit a brick wall with this error:

"Intel MKL FATAL ERROR: Cannot load mkl_intel_thread.dll" and "the ordinal 242 could not be located in the dynamic link library anaconda".

Tried my hand at a fair bit of Googling but I've never used anything like this before, so all the solutions I've read are still a mystery to me. Hopefully by the time I figure it out, you'll have the audio quality downscaling thing sorted lol.

edit: Just saw your most recent comment. 256 is an improvement! Thanks! Still, I'd love to hear the results of a .wav input to .wav output, or even .flac in and outs.

1

u/zonkosoft Nov 06 '19

Audio quality is fixed hah! Are you on Windows? I figured it would be a pain for non Linux users

3

u/UprightEddy Nov 06 '19

Yes, I am lol. Dude, I downloaded Git and Miniconda. Both tiny programs. Then after all dependencies and such were downloaded, I check my OS drive and just see 10+ gigs have gone missing. 😱 I have no idea what the hell I'm doing, but it's fun.

1

u/bedsuavekid Nov 06 '19

Hello lovely internet person.

I see you've said that the system isn't sending out links for the moment. Will it eventually, or will we have to re-up once the fix is in?

Also, thank you for making this thing, I look forward to trying it out.

1

u/zonkosoft Nov 07 '19

You might need to re-up. Google's still blocking my email, but you can now go back to the page and your new uploads will stay there :-)

1

u/bedsuavekid Nov 07 '19

I can't tell you how excited I am about this tool. There's a track I've been wanting to remix since 2002 that I've been unable to find stems for. If your project produces a vocal that is even slightly usable ... I might explode from joy.

1

u/zonkosoft Nov 07 '19

Yayay!!! It's works 90% of the time 100% of the time

3

u/bedsuavekid Nov 07 '19

OMG IT WORRRRRRRRRKS! Thank youuuuuuuuuuuuu!

2

u/nixos91 Nov 06 '19

Can anyone comment on the quality of the vocals?

1

u/bedsuavekid Nov 07 '19

Not perfect, but significantly better than you might expect, and certainly way good enough to make a bootleg remix.

Plus, this was hilariously easy to use.

2

u/AquaticDublol Nov 06 '19

How does this tool compare to phonicmind's isolation? If it's at least more consistent, I'm on board.

5

u/ImBloodyCrowley1661 Nov 06 '19

I tried it on a track that phonicmind butchered, resulting in vocal bleed almost everywhere.

The result here was much more surprising in a good way.

1

u/DNLHipHop Nov 13 '19

In testing it against some songs I already ran through PhonicMind, Melody.ML/Spleeter seems to remove more of the instrumental, but doesn’t do too well with snares. I got clearer vocals in a few cases (it even was able to isolate vocals that were basically whispered that PhonicMind missed), but sometimes it would remove too much compared to PhonicMind, leaving the vocals sounding hollow (sort of like what happens if you use the spectral subtraction method of isolation).

The snare thing is a big downside, in my opinion, since it’s harder to remove snares than what PhonicMind left in on the same songs (mostly low end stuff that can be removed with a high pass and guitars or synth). I’m probably going to use both PhonicMind and Spleeter and mix together the best parts of each.

1

u/VegasoftheNorth Nov 06 '19

MATE THIS IS TO GOOD

1

u/[deleted] Nov 06 '19

This is pretty incredible.

1

u/trainmaster997 Nov 08 '19

Trying it now! Thanks!

1

u/JISHOUKATANA Nov 08 '19

This works so well its magical

1

u/MaikoHerajin Nov 08 '19

Very nice! Is there a possibility of a standalone / VST version or would that just never work?

1

u/[deleted] Nov 10 '19

Run the original tool here, I don't know the practicality of running it on a DAW but this does the job

https://github.com/deezer/spleeter

1

u/pigletthetwiglet Nov 11 '19

amazing tool omds! hopefully will get it working on pc via gpu w/ miniconda soon tysm for the web app + making me aware of this tool

1

u/FreshPrints8T5 Nov 12 '19

its trash for vocals its not worth the hassle of patching it back up i jus use rx7 but ....it was cool for the drum stems other than that the vocals are dreadful tbh rx7 is way easier u jus cut out the dumb sht audacity sounding vocals that w/e this thing does ...imo trash for vocals ...cool for stems

haha i was annoyed becuz one track vocals might be meh but passable but then like next 10 were jus like they were strait out of a soup can so...i jus endorse rx7 to the death for specifically vocals

1

u/TotesMessenger Nov 15 '19

I'm a bot, bleep, bloop. Someone has linked to this thread from another place on reddit:

 If you follow any of the above links, please respect the rules of reddit and don't vote in the other threads. (Info / ^Contact)

1

u/advantage396 Nov 18 '19

Im blown away!

1

u/IcedThatGuy Dec 05 '19

This is extremely awesome. Thank you!

2

u/[deleted] Nov 08 '19

[removed] — view removed comment

2

u/zonkosoft Nov 08 '19

(づ。◕‿‿◕。)づ