Rotating without Seeing: Towards In-hand Dexterity through Touch
Our website:
Tactile information plays a critical role in human dexterity. It reveals useful contact information that may not be inferred directly from vision. In fact, humans can even perform in-hand dexterous manipulation without using vision. Can we enable the same ability for the multi-finger robot hand? In this paper, we propose to perform in-hand object rotation using only touching without seeing the object. Instead of relying on precise tactile sensing in a small region, we introduce a new system design using dense binary force sensors (touch or no touch) overlaying one side of the whole robot hand (palm, finger links, fingertips). Such a design is low-cost, giving a larger coverage of the object, and minimizing the Sim2Real gap at the same time. We train an in-hand rotation policy using Reinforcement Learning on diverse objects in simulation. Relying on touch-only sensing, we can directly deploy the policy in a real robot hand and rotate novel objects that are not presented in training. Extensive ablations are performed on how tactile information help in-hand manipulation.
3 views
532
140
1 month ago 00:03:25 1
Best proxy. : The Best Proxy Service for All Your Online Needs!
1 month ago 00:07:59 1
Rotator Cuff Killer (SHOULDER LATERAL RAISES!)
1 month ago 00:10:51 1
How to Care for Neon Pothos + 5 Things to AVOID! Epipremnum aureum
1 month ago 00:05:34 1
Cat Swing Pop-up card Tutorial- Super easy DIY (FREE template!)
2 months ago 00:01:10 1
360 Video: NASA Simulation Plunges Into a Black Hole
2 months ago 00:01:18 1
360 Video: NASA Simulation Shows a Flight Around a Black Hole
2 months ago 00:03:03 12
ABIMIG® AT - Swan Neck Overview
2 months ago 00:08:55 1
Tao Junliang 陶俊良 3 meters 66 knives from China
2 months ago 00:40:38 1
35 Min FIERY Full Body HIIT Cardio Workout (No Equipment) | FULL BODY Series 24
2 months ago 00:09:02 1
7 Minute Workout Song (w/timer) | Tabata Songs
2 months ago 00:02:38 1
How to Open Champagne (Without it Exploding!)
2 months ago 00:05:52 1
Giant Crepe paper flower for room decor,Flores de papel crêpe,Handmade Cherry Blossom@PaperSaiArt’s
2 months ago 04:37:09 19
Scrapy Course – Python Web Scraping for Beginners
2 months ago 00:00:17 1
Solar system’s helical motion through space
2 months ago 00:16:25 1
Volkswagen Golf 8 production: Factory tour in Wolfsburg
2 months ago 00:24:24 1
Chen Di 陈狄 6 meters 94 knives from China
2 months ago 00:00:27 1
ПИЛА для Гипса и КОЖА Человека
2 months ago 00:01:19 7
COUGAR Unveils FV270 RGB: A New Standard in Gaming PC Cases
2 months ago 00:03:28 1
Hiding behind tree - can it stop bullets?
2 months ago 00:05:23 1
Luca Agnelli, Rian Wood - Kiss Like This (Extended Mix) [ARTCORE Records]
2 months ago 00:13:10 1
CITRINE INFINITE RED CRITS: Recrystallization Augment | Dante Unbound
2 months ago 00:17:11 1
Kord: Russia’s New .50 Cal Heavy Machine Gun
2 months ago 00:08:02 6
🚙 New Public Event 🚙 (Without Wood) - Hill Climb Racing 2
2 months ago 00:03:39 1
Geomagnetic storms Sept. 25-28th 2020 - real-time HD