Controllable Neural Style Transfer for Dynamic Meshes Video
In recent years, animation movies are shifting from realistic representations to more stylized depictions that support unique de- sign languages. To favor that, recent works implemented a Neural Style Transfer (NST) pipeline that supports the stylization of 3D assets by 2D images. In this paper we propose a novel mesh stylization technique that improves previous NST works in several ways. First, we replace the standard Gram-Matrix style loss by a Neural Neighbor formulation that enables sharper and artifact-free results. To support large mesh deformations, we reparametrize the optimized mesh positions through an implicit formulation based on the Laplace-Beltrami operator that better captures silhouette gradients that are common in inverse differentiable rendering setups. This reparametrization is coupled with a coarse-to-fine stylization setup, which enables deformations that can change large structures of the mesh. We provide artistic control through a novel method that enables directional and temporal control over synthesized styles by a guiding vector field. Lastly, we improve the previous time- coherency schemes and develop an efficient regularization that controls volume changes during the stylization process. These improvements enable high quality mesh stylizations that can create unique looks for both simulations and 3D assets.
Publication Link:
12 views
31
10
3 weeks ago 00:01:51 1
New “Neural Dust” sensor could be implanted in the body
3 weeks ago 00:02:36 1
COGNITIVE RESEARCHERS are targeting ORGANS OF CONTROL for TRAINING, RESEARCH & DEVELOPMENT
3 weeks ago 00:05:45 11
Controllable Neural Style Transfer for Dynamic Meshes Video
4 weeks ago 02:16:32 1
Controlling Your Dopamine For Motivation, Focus & Satisfaction
4 weeks ago 00:30:26 1
Physics-informed Machine Learning for Inverse Problems
4 weeks ago 08:37:35 1
Elon Musk: Neuralink and the Future of Humanity | Lex Fridman Podcast #438
4 weeks ago 00:01:02 1
Neural Dominion Pre-Alpha Gameplay Trailer
1 month ago 00:19:21 1
16 Legendary Beats - A short history of the 808 🟥🟧🟨⬜ | Drum Patterns Explained
1 month ago 00:15:22 1
Microsoft Auto SR Tested: AI Upscaling For Every Game... But How Good Is It?
1 month ago 01:41:02 1
The Science of Emotions & Relationships
2 months ago 00:11:28 1
True Facts: Bees That Play With Balls And Do Math!
2 months ago 00:20:26 1
Using Video Games to Simulate Evolution
2 months ago 00:02:57 1
All Neural Networks. All Autonomous. All 1X speed | 1X AI Update
2 months ago 00:27:49 1
Oracle of Prophecy #D_GEN Cyber_exchange seamless and secure #crypto exchange and #cyberbarter
2 months ago 00:01:45 1
The joint educational program of the RobotX School of Robotics and Skoltech ISB Lab
2 months ago 00:10:29 1
AI Learns to Play Tag (and breaks the game)
2 months ago 00:13:54 37
WHY Use A Virtual BASS? (Shinzbass By Submission Audio)
2 months ago 00:01:00 1
Herald of Darkness [Alan Wake II] | Old Gods of Asgard #cover #alanwake #alanwake2 #fyp #guitar