Legs as Manipulator: Pushing Quadrupedal Agility Beyond Locomotion
Webpage:
Authors: Xuxin Cheng, Ashish Kumar, Deepak Pathak
Published at ICRA 2023
Locomotion has seen dramatic progress for walking or running across challenging terrains. However, robotic quadrupeds are still far behind their biological counterparts, such as dogs, which display a variety of agile skills and can use the legs beyond locomotion to perform several basic manipulation tasks like interacting with objects and climbing. In this paper, we take a step towards bridging this gap by training quadruped robots not only to walk but also to use the front legs to climb walls, press buttons, and perform object interaction in the real world. To handle this challenging optimization, we decouple the skill learning broadly into locomotion, which involves anything that involves movement whether via walking or climbing a wall, and manipulation, which involves using one leg to interact while balancing on the other three legs. These skills are trained in simulation using curriculum and transferred to the real world using our proposed sim2real variant that builds upon recent locomotion success. Finally, we combine these skills into a robust long-term plan by learning a behavior tree that encodes a high-level task hierarchy from one clean expert demonstration. We evaluate our method in both simulation and real-world showing successful executions of both short as well as long-range tasks and how robustness helps confront external perturbations.
3 views
88
41
1 week ago 00:28:53 1
ГЕОЛОГИ ОБМАНУЛИ | ДОМ ПОД СНОС | СТРОЙХЛАМ
1 week ago 00:04:08 8
A New IK System
1 week ago 00:03:19 1
Transient - 4K, UHD, 1000FPS
1 week ago 00:12:22 2
MACRON S’APPRÊTE À TOUT CRAMER ?!
1 week ago 00:05:04 1
Chris Rea “Looking for the Summer“ Music Video (HD)
1 week ago 00:01:37 211
Castle Come - Official Announcement Trailer
1 week ago 00:10:56 1
Make Very Easy Pants, Wear in 8 Different Ways!❤️As skirt, dress, romper
1 week ago 00:00:13 1
It was me Barry! (Reverse Flash hate boner)
1 week ago 00:01:12 1
Palestinian mother and son who lost limbs in Israeli bombing hope to travel abroad for treatment
1 week ago 00:19:20 1
Top 50 Craziest Knockouts of June 2024 #7 (MMA•Muay Thai•Boxing•kickboxing)
1 week ago 00:23:36 1
ИДЕЯ К 8 МАРТА. МАСТЕР КЛАСС. IDEA FOR MARCH 8. MASTER CLASS
1 week ago 00:30:30 1
Listen until the end for a complete rebalancing of the 7 chakras • Mindfulmed Chakras
1 week ago 00:03:31 1
Mysteries of Baba Yaga A Fascinating Figure in Norse Mythology
1 week ago 00:00:44 1
💙call me girl - “Roxy Migurdia“ [ EDIT/AMV ]💙
1 week ago 00:04:41 1
Rammstein - Ausländer (Official Video)
1 week ago 00:04:51 1
Rammstein - Radio (Official Video)
1 week ago 00:04:21 1
Teddy Brown (1930)
1 week ago 00:21:27 1
How to DIY a round COCKTAIL OTTOMAN with capitone
1 week ago 00:03:36 1
Beth Hart - Bad Woman Blues (Official Music Video)
1 week ago 00:00:30 1
Glute Bridge Stretch Strengthens And Stretches Low Back, Elector Spinae, Hip And Glutes Muscles
1 week ago 00:08:13 1
They Made Her ’Give Birth’ Then Left Her In Front Of My Shelter When She Can’t Stand Up Alone...
1 week ago 00:48:16 1
Bonanza - Land Grab | Episode 81 | Classic Western | Cowboys | Full Length
1 week ago 00:00:10 1
Beautiful Chinese Girls【乔乔🐱】#douyin #tiktok #beautiful #shorts
1 week ago 00:01:27 1
Lunch Song | Songs For Kids | Dance Along | GoNoodle