Is this a thing yet? "Deep faking" someone's voice with a simple plugin. Like autotune but changing the voice instead of the tuning. Looking to put someone else's voice in a song and get sued.
As well as a.i. enabled plugins to make your output sound like whatever you train it to. Audio wise and performance wise.
There will be a day when you'll have perfect guitar simulation, perfect e.q. duplication, and performance execution tweaked to match anyone.
I'm really surprised something like this hasn't surface in a VST already. I certainly wouldn't invest $$$$ in a guitar sim right now, at some point using a GAN to match the preamp/eq/output/speaker/mic stages of a guitar amp will happen and the analog/digital argument will be over.
Vocalists will be in for a shock soon. Within 5 years you should be able to have "anyone" sing on your music.
Guitar playing is going to get messed up, as not just tuning but timing, vibrato and phrasing becomes tweakable. Fret buzz will be eliminated.
Personally I'm really looking forward to an a.i. trainable midi drum editor.
A.i. trainable eq. Mastering. As long as you have the right thing to train it on.
It will be the Really Big Deal in audio by 2022. And unfortunately allow more charlatans to appear to have talent. The hidden danger to humans: a.i. assisted activity masking true ability, spread across a few generations could have irreparable effects on the genome.
The computational power required to do what you are suggesting in real time in VST form just isn't there. I don't believe you are going to hear anything like that in VST form for a long time, at least not anything convincing.
Considering Deepfake even the best deep fake still looks odd and well, fake! - but to me the best are still comfortably better in some regards than the no expense hollywood CGI (see the jarringly odd Rachel FX in the otherwise visually excellent Blade Runner 2049, and the possibly worse video game style Grand Moff Tarkin in Rogue One).
Given a bit of time and effort the deep fake technique could have done a better job than than those premium efforts.
The computational power required to do what you are suggesting in real time in VST form just isn't there.
Initially it will be like Melodyne.
Quote:
I don't believe you are going to hear anything like that in VST form for a long time, at least not anything convincing.
I wouldn't be surprised if it happens before the end of next year. Max 3 years.
Quote:
Considering Deepfake even the best deep fake still looks odd and well, fake!
They're not all the same or trying to do the same thing. And it's not just about Deep Fake; there are a multitude of approaches happening simultaneously. What I'm referencing are the applications of applying styles via GANs and the generation methods that are effectively indistinguishable. The a.i. generated faces are well out of the uncanny valley. The Dadabots project should give everyone pause.
Quote:
no expense hollywood CGI (see the jarringly odd Rachel FX in the otherwise visually excellent Blade Runner 2049, and the possibly worse video game style Grand Moff Tarkin in Rogue One).
Tarkin was horrible but at least Rogue One was better than the abomination that was Last Jedi...
..but Deep Fake is just one basic use of techniques that are accelerating faster than Moore's law. Effectively my argument: you're able to do on your desktop over night what required millions of $ and months in Hollywood just a year ago.
...
Tarkin was horrible but at least Rogue One was better than the abomination that was Last Jedi...
Yes, I didn't like Rogue One but it was much, MUCH better than the Last Jedi.
Quote:
Originally Posted by chip mcdonald
..but Deep Fake is just one basic use of techniques that are accelerating faster than Moore's law. Effectively my argument: you're able to do on your desktop over night what required millions of $ and months in Hollywood just a year ago.
It's coming faster than you think.
The face mapping technology in Deep Fake is a neat trick, completely unrelated to audio techniques.
I think you are making some wild assumptions about how far technology will get in such a short time frame. Even the de-aging techniques used in The Irishman are pretty ropey in parts, looking like camp make up at times according to reviewers, and that's 2019 cost no object stuff.
The computational power required to do what you are suggesting in real time in VST form just isn't there. I don't believe you are going to hear anything like that in VST form for a long time, at least not anything convincing.
Oh, yes, it's available allright. Just not in VST form, but simple apps on several appstores. Most notably on a Chinese appstore. The one on the western side of things was removed after public outcry.
Quote:
Considering Deepfake even the best deep fake still looks odd and well, fake! - but to me the best are still comfortably better in some regards than the no expense hollywood CGI (see the jarringly odd Rachel FX in the otherwise visually excellent Blade Runner 2049, and the possibly worse video game style Grand Moff Tarkin in Rogue One).
Given a bit of time and effort the deep fake technique could have done a better job than than those premium efforts.
I've seen and heard pretty convincing examples from researchers. There's at least one site I remember that specialises in these: deepfake.com.
Mostly pics and video, not audio.
__________________
In a time of deceit telling the truth is a revolutionary act.
George Orwell
Is this a thing yet? "Deep faking" someone's voice with a simple plugin. Like autotune but changing the voice instead of the tuning. Looking to put someone else's voice in a song and get sued.
Not really a deep fake like you are referring to, but around 2000 I had a plugin called "Voice Tweaker" that could do a Barry White fake pretty well using it's "Maleify" preset. It had another preset called "Womanize" that did the opposite and would prolly need a name change for today's market.
__________________
Glennbo
Hear My Music - Click Me!!!
--
Apparently they're making a new movie with James Dean in it. I mean... CGI James Dean or deep faked James Dean.. not James Dean's rotted corpse The voice will be some voice actor doing his best James Dean impersonation, I presume.
I'd have to guess that we aren't far from technology existing where you could completely and convincingly fake video/audio of anyone, and that tech being used for even greater evils. How are we going to be able to verify authenticity of some "recorded" video? Say someone admitting to a crime, or a high ranking political official doing something that could incite a war, or implicate them (not that we need deep fakes for that!)
__________________ My Rig (also serves as my gaming PC): MSI Mag X570 Tomahawk Mobo, Ryzen R9 3900X, 32GB RAM, Samsung 960 Evo 500gb NVMe, Crucial 1TB NVMe, NVidia RTX 2080 Super, Arturia Minifuse 2, Nektar Impact LX25+ MIDI Controller Keyboard.
To expand this a bit further, how long until Pandora (or Spotify, whatever) is simply streaming us AI-generated content, that's better than what humans are creating?
I'm putting the over/under at 2030 for music.
2033 for video game content (i.e. not just random maps; whole epic story lines, new enemies, new graphic textures, new voice audio, all created on-the-fly).
2040 for AI-generated TV and movies.
My only real question is will humanity make it that long Sleep tight!
__________________
It helps if the hitter thinks you're a little crazy
- Nolan Ryan
To expand this a bit further, how long until Pandora (or Spotify, whatever) is simply streaming us AI-generated content, that's better than what humans are creating?
You're saying that like it's a bad thing. If AI's produce better music than people, I'm happy to listen to it. We'll just net universal basic income to make up for the lost jobs. Yang 2020!
Deep fake vocal plugin?
Hybrid Mode
