High Resolution Neural Face Swapping for Visual Effects
We propose an algorithm for fully automatic neural face swapping in images and videos. To the best of our knowledge, this is the first method capable of rendering photo-realistic and temporally coherent results at megapixel resolution. To this end, we introduce a progressively trained multi-way comb network and a light- and contrast-preserving blending method. We also show that while progressive training enables generation of high-resolution images, extending the architecture and training data beyond two people allows us to achieve higher fidelity in generated expressions. When compositing the generated expression onto the target face, we show how to adapt the blending strategy to preserve contrast and low-frequency lighting. Finally, we incorporate a refinement strategy into the face landmark stabilization algorithm to achieve temporal stability, which is crucial for working with high-resolution videos. We conduct an extensive ablation study to show the influence of our design choices on the quality of the swap and compare our work with popular state-of-the-art methods.
Link to publication file:
1 view
474
65
6 months ago 00:10:04 1
DAVID GILMOUR with DAVID BOWIE 『 Comfortably Numb 』
6 months ago 00:23:16 1
Need for Speed: Porsche Unleashed PS1 Gameplay HD (Beetle PSX HW)
6 months ago 00:04:04 1
a-ha - Take On Me (Official Video) [Remastered in 4K]
6 months ago 00:15:31 1
5. High Resolution Screenshots
6 months ago 00:14:22 1
THROUGH THE LENSES - PICO 4 vs REVERB G2 vs VALVE INDEX ! - Best PC VR?
6 months ago 00:14:33 1
The FULL AMD Linux laptop! (RADEON GPU & Ryzen CPU): Tuxedo Sirius 16 review
6 months ago 03:05:47 1
JOI - Ambient Synthwave Music For Deep Sleep, Focus, Relaxation and Meditation
6 months ago 00:08:00 6
The Easiest Way to Animate a Map in After Effects 2023 (NO PLUGINS)
6 months ago 00:02:17 1
FUNGI IMAX movie - narrated by Björk, presented by Merlin Sheldrake, time-lapses by Planet Fungi.
6 months ago 00:02:10 3
[60 fps] Moscow, Tverskaya Street in 1896
6 months ago 00:15:18 1
MOST POWERFUL MacBook vs PC Laptop (RIP Windows?)
6 months ago 11:55:00 1
Ocean 4K - Sea Animals for Relaxation, Beautiful Coral Reef Fish in Aquarium, 4K Video Ultra HD #108
6 months ago 02:24:24 1
The Corporation | Full-Length Feature Film | Uprezed HD Version
6 months ago 08:36:56 1
12K HDR 120FPS Dolby Vision - Technology image of the future - Inspiring Cinematic Music
6 months ago 00:00:15 7
Streamline Your 3D Character Workflow | Download CC Character Base For Free Now