I just realized Demucs (I assume any variation) is extremely good at separating background noise/wind from speech.
I took some video outside when it was windy which had horrible windnouise and rumbling.
I dropped the MP4 video file into x-minus.pro and it totally separated the noise from the voice.
Demucs for audio cleanup
- Kwai Chang
- Posts: 1572
- Joined: Tue May 25, 2021 3:46 am
- Has thanked: 331 times
- Been thanked: 191 times
Re: Demucs for audio cleanup
That's called a Hope Detector(sniffer!)Engonoceras wrote: ↑Sun Sep 24, 2023 7:17 pm I just realized Demucs (I assume any variation) is extremely good at separating background noise/wind from speech.
I took some video outside when it was windy which had horrible windnouise and rumbling.
I dropped the MP4 video file into x-minus.pro and it totally separated the noise from the voice.
Will it be any match for the Fairchild 660? It might be!
The problem is Americans won't buy products in generic packaging(without the WIND!).
So, do we really want to end the conversation?
Thank you, for another objective-specific contribution. I am still playing your Baby You're A Rich Man and It's All Too Much!
Keep up the nice work!
KC
- Lord Reith
- Posts: 4703
- Joined: Thu Feb 18, 2021 8:22 am
- Location: BBC House
- Has thanked: 148 times
- Been thanked: 4087 times
Re: Demucs for audio cleanup
Yes I am surprised there has not been more research devoted to this. On mvsep there is a variation of UVR which separates audio into music and hiss but it works only partially. Promising though. There's also a varaiation for echo and reverb which is not too bad but likewise still not completely there.
Women there don't treat you mean, in Abilene
- Rave O Lucien
- Posts: 313
- Joined: Mon Feb 22, 2021 11:14 pm
- Has thanked: 720 times
- Been thanked: 60 times
Re: Demucs for audio cleanup
Do you suppose it could remove the screams from the Hollywood Bowl concerts?Engonoceras wrote: ↑Sun Sep 24, 2023 7:17 pm I just realized Demucs (I assume any variation) is extremely good at separating background noise/wind from speech.
I took some video outside when it was windy which had horrible windnouise and rumbling.
I dropped the MP4 video file into x-minus.pro and it totally separated the noise from the voice.
When you've got it, jump up! ~ John Lennon
- Lord Reith
- Posts: 4703
- Joined: Thu Feb 18, 2021 8:22 am
- Location: BBC House
- Has thanked: 148 times
- Been thanked: 4087 times
Re: Demucs for audio cleanup
You can do that with audacity.Engonoceras wrote: ↑Sun Sep 24, 2023 10:23 pm What they also need is an algorithm dedicated to simply separating the left, middle and right channel information.
Women there don't treat you mean, in Abilene
Re: Demucs for audio cleanup
Yeah. But now imagine if AI could bypass the uncertainty principle there and give us crisper center extractions. With standard tools we are stuck with a tradeoff between frequency or time precision - one or the other is always smeared, so especially center isolations sound shitty. That would be a game changer.Lord Reith wrote: ↑Mon Sep 25, 2023 11:42 amYou can do that with audacity.Engonoceras wrote: ↑Sun Sep 24, 2023 10:23 pm What they also need is an algorithm dedicated to simply separating the left, middle and right channel information.
- Lord Reith
- Posts: 4703
- Joined: Thu Feb 18, 2021 8:22 am
- Location: BBC House
- Has thanked: 148 times
- Been thanked: 4087 times
Re: Demucs for audio cleanup
This is true. Still an amazing tool though.csnyfan wrote: ↑Mon Sep 25, 2023 3:59 pmYeah. But now imagine if AI could bypass the uncertainty principle there and give us crisper center extractions. With standard tools we are stuck with a tradeoff between frequency or time precision - one or the other is always smeared, so especially center isolations sound shitty. That would be a game changer.Lord Reith wrote: ↑Mon Sep 25, 2023 11:42 amYou can do that with audacity.Engonoceras wrote: ↑Sun Sep 24, 2023 10:23 pm What they also need is an algorithm dedicated to simply separating the left, middle and right channel information.
Seamlessly removing hiss would be the big one for me. You can very nicely do this with speech but not music yet.
Women there don't treat you mean, in Abilene
- alphabeatles
- Posts: 1373
- Joined: Fri Feb 19, 2021 10:44 pm
- Has thanked: 126 times
- Been thanked: 191 times
Re: Demucs for audio cleanup
A website to search for AI apps for Music and other tasks:
hxxps://opentools.ai/
hxxps://opentools.ai/