Using artificial intelligence to make movies lip-sync Smash Mouth’s ‘All Star’


Visual effects engineer Jonty Pressinger (who previously fixed The Lion King remake by deepfaking it to look more like the cartoon version) was testing out Wav2Lip and put together this compilation of movies lip-syncing Smash Mouth’s All Star. Wav2Lip basically takes any video and syncs the lip movements using just an audio file. They even have an interactive demo you can use to test it out.

It’s just crazy that after decades of hearing about artificial intelligence and how the computers would think for themselves and take over the world, it turns out we’d just be using the technology to make videos of Tom Hanks lip-syncing to terrible songs. I mean, I’m not complaining. Dumb internet videos totally beat being hunted down and murdered by Terminator robots.

Keep going for the full video, as well as some examples of terrible dubbing that this technology would actually be useful for.

And an example of a really poorly dubbed Kung Fu movie:

And the incredible TV edit of Snakes on a Plane:

Previous Story

It was just a matter of time, but Twitter user Foone managed to get Doom running on a digital pregnancy test. I tried zooming in and turning…

Next Story

Not gonna lie. The way the year’s been going, I wouldn’t mind getting in on some of that high five action. The perfect Tik Tok exists…—…

To illustrate the dangers of deepfakes, a team from the MIT Center for Advanced Virtuality created a deepfake of President Nixon delivering the real contingency speech written…

Researchers have developed a system for taking photo collections from the internet and turning them into 3D reconstructions. They call it NeRF-W, which stands for Neural Radiance…

Quarantine does weird things to people, and in the case of engineer Ethan Rosenthal it made him develop a system for optimizing a peanut butter and banana…

Using an ensemble of neural networks, YouTuber Denis Shiryaev upscaled the oldest recorded video: Louis Le Prince’s Roundhay Garden Scene which was shot in October of 1888….

Leave a reply

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>