Discovering Symbolic Models from Deep Learning with Inductive Biases (Paper Explained)
Neural networks are very good at predicting systems’ numerical outputs, but not very good at deriving the discrete symbolic equations that govern many physical systems. This paper combines Graph Networks with symbolic regression and shows that the strong inductive biases of these models can be used to derive accurate symbolic equations from observation data.
OUTLINE:
0:00 - Intro & Outline
1:10 - Problem Statement
4:25 - Symbolic Regression
6:40 - Graph Neural Networks
12:05 - Inductive Biases for Physics
15:15 - How Graph Networks compute outputs
23:10 - Loss Backpropagation
24:30 - Graph Network Recap
26:10 - Analogies of GN to Newtonian Mechanics
28:40 - From Graph Network to Equation
33:50 - L1 Regularization of Edge Messages
40:10 - Newtonian Dynamics Example
43:10 - Cosmology Example
44:45 - Conclusions & Appendix
Paper:
Code:
Abstract:
We develop a general approach to distill symbolic representations of a learned
1 view
627
216
8 hours ago 11:54:58 1
If you find this Video, THE UNIVERSE has sent you this MESSAGE 💵 to Attract Money, Wealth SUCCESS
1 day ago 00:19:29 1
🔱 Extremely Powerful Kali mantra to Destroy Enemy 🔥
2 days ago 00:11:13 1
Inside The Secret Life of The Saudi Prince Salman
3 days ago 00:19:27 1
How Pavel Durov resisted the authorities and сhanged the Internet? Life, projects and online privacy
3 days ago 00:05:17 1
Unlocking the Mystical Union: Beyond Literalism 🌀 by Barbara Symons
4 days ago 00:04:58 1
your mind will collapse if you try to imagine this | UNIVERSE SIZE COMPARISON
4 days ago 00:28:58 1
Serbia – Uncovering Europe’s MOST CONTROVERSIAL Country! 🇷🇸
4 days ago 02:46:04 1
THAILAND 2024: Bangkok, Wat Pho, Phuket, Samui, Patong, Mae Ko, Ang Thong National Marine Park 4K
4 days ago 01:29:40 1
White Terror |📣Far Right | Full Documentary
5 days ago 00:11:06 1
Inside Twin Towers before 9/11 - World Trade Center - New York City - 1998
5 days ago 00:27:25 1
The Power of Anointing Oil in Spiritual Warfare | Biblical Symbolism and Healing
5 days ago 00:02:42 1
Gal Gadot From Burger Flipper to Wonder Woman #DreamBig #GalGadot #WonderWoman #Persistence #Believe
6 days ago 01:02:32 1
Abandoned Cruise Ship Discovered in Jungle Lake – No One Knows How!
6 days ago 00:10:18 1
Ancient Advanced beings from the Ancient World! (Nandi, Ganesha, Shiva)
6 days ago 00:10:57 1
The 12,000-Year-Old Shigir Idol: Unraveling the Secrets of the World’s Oldest Wooden Sculpture
6 days ago 00:00:37 1
The Matrix (1999) From Film to Now Cast Evolution #matrix #actor #movie #evolution #top #celebrity
7 days ago 01:03:10 1
Abandoned Cruise Ship Left to Rot – What Happened to This Forgotten Giant?
1 week ago 00:30:18 1
Mike Tyson’s Lifestyle 2024 ★ House, Children, Net Worth & Women
1 week ago 00:04:48 1
Johnny Depp | Tarot
1 week ago 00:13:02 1
Kanayago: The Japanese Goddess of Smithing and Metalwork - Japanese Mythology/Lore
1 week ago 00:16:21 1
Subaru Sambar Van Review: This JDM Kei Car is WILD
1 week ago 00:00:57 1
Why Did So Many German Officers Have Facial Scars?... #history #ww2
1 week ago 00:00:00 1
528 Hz - True love is also looking for you💓A miracle of love will happen, He (She) will be with you
2 weeks ago 00:20:48 1
Chosen Ones, Your Shady Family is Panicking as You Escape the Cage They Locked You Up In😎