Fixed-point Error Bounds for Mean-payoff Markov Decision Processes
A Google TechTalks, presented by Roberto Cominneti, 2024-03-19
A Google Algorithms Seminar. ABSTRACT: We discuss the use of optimal transport techniques to derive finite-time error bounds for reinforcement learning in mean-payoff Markov decision processes. The results are obtained as a special case of stochastic Krasnoselski—Mann fixed point iterations for nonexpansive maps. We present sufficient conditions on the stochastic noise and stepsizes that guarantee almost sure convergence of the iterates towards a fixed point, as well as non-asymptotic error bounds and convergence rates. Our main results concern the case of a martingale difference noise with variances that can possibly grow unbounded. We also analyze the case of uniformly bounded variances, and how they apply for Stochastic Gradient Descent in convex optimization.
ABOUT THE SPEAKER: Roberto Cominetti is a professor with the Faculty of Engineering and Sciences at Universidad Adolfo Ibáñez, Santiago, Chile. His research interests include convex analysis and game theory and their applications in transportation networks.
1 view
0
0
2 months ago 00:57:54 1
Fixed-point Error Bounds for Mean-payoff Markov Decision Processes
3 years ago 00:02:35 205
How to Fix MiFlash error:Not catch checkpoint (\$fastboot -s *lock)
2 years ago 00:08:26 1
How to Fix Windows 10 Error 0xc000021a
8 years ago 00:04:00 2
How To Fix “AP currently not in use. Internet connection too slow.“ Error on Android ?
2 years ago 00:07:55 1
How To Fix Adobe Illustrator Error 81 Update Windows Offline | Learning with Azad
11 months ago 00:03:33 1
Fix connection reset error in minecraft | internal exception
10 months ago 00:08:32 10
2016 + Chevy Malibu Shifter Error FAST FIX (Shift To Park Message) Traverse Volt Cadillac Buick gm
1 year ago 00:06:12 1
HOW TO FIX FIVEM CONNECTION ERROR FAILED?! WORKS IN ALL SERVERS‼️ GTA RP | GRIZZLEYWORLDRP
9 months ago 00:00:32 8
No enough extend space error fix on Ruida laser
3 months ago 00:14:17 1
Oppo A83T(A1) China touch not work Error charger/Firmware troubled after flashing FIX Done 100%
1 year ago 00:03:28 1
Fix For procedure entry point Steam Controller could not be located in the dynamic link library
4 years ago 00:10:52 1
Phoenix Point - Horribly Unpolished and Unbalanced
2 years ago 00:11:12 2
Fixing These 6 Abs Mistakes REALLY Changed My Training - Common Gym Errors
7 years ago 00:06:25 1
How to Fix Windows Update Failure | Windows Update Errors in Easy Steps
8 years ago 00:03:28 4
Fix League of legends login errors [DNS Server issues] (works as of 12/01/2015)
1 year ago 00:11:46 27
GoPro Karma Drone Pairing Issue - TRY THIS FIX!
8 months ago 00:36:47 1
Blender Photogrammetry: Repairing Holes & Fix Bad Meshes in Photo-Scan Models
1 year ago 00:05:09 2
Remnant:From the Ashes Corrupted/Deleted Profile fix and how to prevent it
4 weeks ago 00:08:54 1
Helldivers 2 - How to FIX FPS Drops and 0 Input Latency on ANY PC!✅
8 months ago 00:13:38 1
Fishbone diagram slide in PowerPoint
4 months ago 00:11:53 1
4 PowerPoint MISTAKES To AVOID in 2024!
1 year ago 00:51:08 15
There are NO Relative Performance GPUs and this is why / R9 290X vs GTX 780Ti in 2022