Photorealistic digital re-aging of faces in video is becoming increasingly common in entertainment and advertising. But the predominant 2D painting workflow often requires frame-by-frame manual work that can take days to accomplish, even by skilled artists. Although research on facial image re-aging has attempted to automate and solve this problem, current techniques are of little practical use as they typically suffer from facial identity loss, poor resolution, and unstable results across subsequent video frames. In this paper, we present the first practical, fully-automatic and production-ready method for re-aging faces in video images. Our first key insight is in addressing the problem of collecting longitudinal training data for learning to re-age faces over extended periods of time, a task that is nearly impossible to accomplish for a large number of real people. We show how such a longitudinal dataset can be constructed by leveraging the current state-of-the-art in facial re-aging that, although failing on real images, does provide photoreal re-aging results on synthetic faces. Our second key insight is then to leverage such synthetic data and formulate facial re-aging as a practical image-to-image translation task that can be performed by training a well-understood U-Net architecture, without the need for more complex network designs. We demonstrate how the simple U-Net, surprisingly, allows us to advance the state of the art for re-aging real faces on video, with unprecedented temporal stability and preservation of facial identity across variable expressions, viewpoints, and lighting conditions. Finally, our new face re-aging network (FRAN) incorporates simple and intuitive mechanisms that provides artists with localized control and creative freedom to direct and fine-tune the re-aging effect, a feature that is largely important in real production pipelines and often overlooked in related research work.
Publication link:
1 view
249
64
2 weeks ago 00:05:43 1
Hot Water Music - After The Impossible feat. City And Colour (Official Music Video)
2 weeks ago 00:11:07 1
The. Classic. Cat. - Caturday Film Club
2 weeks ago 00:37:31 1
Wild Beauty of Alaska 4K: A Relaxing Journey Through Nature/ Alaska Life/ Relaxation Film
2 weeks ago 01:03:36 1
Making An Afro House Track in 1 HOUR (Full Process)
2 weeks ago 00:03:18 1
Falling In Reverse - “Ronald“ (feat. Tech N9ne & Alex Terrible)
2 weeks ago 00:05:12 1
Handmade Serving Tray Tutorial
2 weeks ago 00:07:03 1
TOWARD THE THRONE - The Ashes of Pain (OFFICIAL VIDEO)
2 weeks ago 11:54:59 1
Legendary Melodies You Can Never Get Bored Of Listening ’S WINTER AGAIN! Music heals the heart
2 weeks ago 00:01:15 1
Electro Andes: Pilot Trailer
2 weeks ago 00:03:23 1
K/DA - POP/STARS (ft. Madison Beer, (G)I-DLE, Jaira Burns) | Music Video - League of Legends
2 weeks ago 00:03:10 1
Newborn Muskox’s First Day
2 weeks ago 00:31:07 1
How To Get LOUD FULL MASTERS With MASTER PLAN 1.5
2 weeks ago 00:03:27 1
Sleep Theory - “Gone or Staying“ (Official Music Video)
2 weeks ago 00:03:20 1
NOTHING MORE ft David Draiman - ANGEL SONG (Official Music Video)
2 weeks ago 00:01:59 1
Roborock Qrevo Master - Clean like a Master
2 weeks ago 00:16:55 1
BIG Delivery in the NEW Kansas DLC in ATS | Triple 55“ TVs
2 weeks ago 00:05:35 1
Tha Dogg Pound, Snoop Dogg - Who Da Hardest? ft. RBX, The Lady of Rage
2 weeks ago 01:14:35 1
New Italo Disco Music 2024 ❤️ You’re A Woman, Touch By Touch ❤️ Eurodisco Dance 80s 90s Megamix
2 weeks ago 00:03:11 1
Djazz
2 weeks ago 00:17:11 1
Kord: Russia’s New .50 Cal Heavy Machine Gun
2 weeks ago 00:02:50 1
The Revenge: Timo Boll vs. KUKA Robot
2 weeks ago 00:02:52 1
RONDÉ - Undecided (Official Video)
2 weeks ago 00:04:48 1
Kovacs & Till Lindemann - Child Of Sin (Official Video)
2 weeks ago 00:01:11 1
Giant Magellan Telescope Enclosure Ready for Construction