Fast and Slow Learning of Recurrent Independent Mechanisms (Machine Learning Paper Explained)
#metarim #deeprl #catastrophicforgetting
Reinforcement Learning is very tricky in environments where the objective shifts over time. This paper explores agents in multi-task environments that are usually subject to catastrophic forgetting. Building on the concept of Recurrent Independent Mechanisms (RIM), the authors propose to separate the learning procedures for the mechanism parameters (fast) and the attention parameters (slow) and achieve superior results and more stability, and even better zero-shot transfer performance.
OUTLINE:
0:00 - Intro & Overview
3:30 - Recombining pieces of knowledge
11:30 - Controllers as recurrent neural networks
14:20 - Recurrent Independent Mechanisms
21:20 - Learning at different time scales
28:40 - Experimental Results & My Criticism
44:20 - Conclusion & Comments
Paper:
RIM Paper:
Abstract:
Decomposing knowledge into interchangeable pieces promises a generalization advantage when there are changes in dist
7 views
7
3
2 months ago 00:02:13 2
The Chats - 6L GTR (Official Video)
2 months ago 00:12:17 1
Rivian R1T: Electrifying the Outdoors | Leg 4 of 5: La Sal to Tremonton | MotorTrend
2 months ago 00:12:07 1
Rivian R1T: Electrifying the Outdoors | Leg 3 of 5: Bartlesville to La Sal | MotorTrend
2 months ago 00:04:36 1
Nordvpn Review 🤑 What is the Most Safe VPN in The World?
2 months ago 00:19:02 1
Bach - Trio Sonata from The Musical Offering BWV 1079 | Netherlands Bach Society
2 months ago 00:15:40 1
Blind Test: 90s Techno / Acid Edition Part Two - Episode 33 (Electronic Beats TV)
2 months ago 00:01:25 1
Expressvpn Reviews 🔥 Is ExpressVPN the Fastest in the World?
2 months ago 00:37:02 1
Бесы. Документальный фильм (2000 г). Отчитка одержимых в Сибирском храме. Отец Василий.
2 months ago 00:03:08 1
Nordvpn Review 🔥 Where can I get a NordVPN promo code?
2 months ago 00:03:13 1
Hard Aggressive Rap Beat / Ethnic Balkan Type | ►Illegal◄ | prod. Jordan Beats (SOLD)
2 months ago 00:04:04 1
Freddie Mercury & Celine Dion - The Show Must Go On (Live) [GOLDEN DUET]
2 months ago 00:12:22 1
LAZO TIANA 😊🤩aqui solo se hace lo que se vende 🎀gana mucho con estas bellezas 🎀
2 months ago 00:00:42 1
How to Carve Fruit Very Fast and Beauty part 1934
2 months ago 00:01:39 1
WoT Blitz: Grab the Tiger 131 or AMX CDA 105 for Free!