Awesome

awesome-humanoid-learning

A curated list of resources relevant to humanoid robots learning.

Given the similarities between the locomotion of humanoid robots and bipedal robots, we have included some works on bipedal locomotion for reference.

In recent research, I have noticed an increasing convergence between humanoid robotics and physics-based animation. I believe this is a highly promising direction for the development of humanoid robots. Therefore, I will be updating this repository with animation works that I find beneficial for humanoid robotics.

Robot models

Bipeds

Humanoids

News

• [20241024] EngineAI-robotics demonstrate a very natural gait [YouTube] [bilibili]

• [20241024] AigbotTech open-source their hardware design schematics and training framework [AgibotTech Github]

• [20241011] Tesla 'We, Robot' [Youtube]

• [20240821] The World Robot Conference was held in Beijing, with a total of 27 humanoid robots participating in the event. [WRC2024]

• [20240705] Humanoid robot vanguard matrix & Optiums at WAIC 2024 [YouTube]

• [20240704] Figure x BMW Group's Spartanburg Plant [YouTube]

• [20240514] Unitree G1 Humanoid Agent | AI Avatar [YouTube]

• [20240417] All New Atlas | Boston Dynamics [YouTube | IEEE SPECTRUM]

• [20240416] Farewell to HD Atlas 😢❤️ For almost a decade, Atlas has sparked our imagination, inspired the next generations of roboticists, and leapt over technical barriers in the field. ❤️ [YouTube]

• [20240408] Sanctuary AI - Phoenix at Human-Equivalent Speed [YouTube]

• [20240320] Unitree H1 The World's First Full-size Motor Drive Humanoid Robot Flips on Ground! AWESOME! [YouTube]

• [20240318] NVIDIA showcase the intelligent future of humanoid robots at GTC 2024 and announce a new project called GR00T [project | video1 | video2]

• [20240306] Robot Era releases their humanoid reinforcement sim2real code! [project | Code]

• [20240302] Unitree H1 Breaking humanoid robot speed world record [full-size humanoid] Evolution V3.0 [YouTube]

• [20240229] PNDbotics announces their humanoid robot 'Adam' [project | paper | YouTube]

• [20240119] Figure announces commercial agreement with BMW Manufacturing to bring general purpose robots into automotive production [PR Newswire | YouTube]

• [20240116] Tesla Optimus Bot Folds Laundry [ X | YouTube ]

Papers

2024

• [2024] Learning Humanoid Locomotion over Challenging Terrain [paper]

• [CoRL] One Policy to Run Them All: an End-to-end Learning Approach to Multi-Embodiment Locomotion [XLA] [paper] [code] [OpenReview]

• [CoRL] DiffuseLoco: Real-Time Legged Locomotion Control with Diffusion from Offline Datasets [paper] [OpenReview]

• [2024] Generalizable Humanoid Manipulation with Improved 3D Diffusion Policies [paper]

• [CoRL] OKAMI: Teaching Humanoid Robots Manipulation Skills through Single Video Imitation [paper]

• [2024] Learning Smooth Humanoid Locomotion through Lipschitz-Constrained Policies [project] [paper] [code]

• [2024] Stage-Wise Reward Shaping for Acrobatic Robots: A Constrained Multi-Objective Reinforcement Learning Approach [paper]

• [SIGGRAPH] MaskedMimic: Unified Physics-Based Character Control Through Masked Motion Inpainting [project] [paper]

• [CoRL] Adapting Humanoid Locomotion over Challenging Terrain via Two-Phase Training [project] [OpenReview]

• [SIGGRAPH] Robot Motion Diffusion Model: Motion Generation for Robotic Characters [project]

• [2024] Teleoperation of Humanoid Robots: A Survey [paper]

• [SIGGRAPH] VMP: Versatile Motion Priors for Robustly Tracking Motion on Physical Characters [project]

• [2024] Tailoring Solution Accuracy for Fast Whole-body Model Predictive Control of Legged Robots [paper] [video]

• [RSS] Advancing Humanoid Locomotion: Mastering Challenging Terrains with Denoising World Model Learning [paper]

• [RSS] Design and Control of a Bipedal Robotic Character [paper] [video]

• [2024] Open-TeleVision : Teleoperation with Immersive Active Visual Feedback [project]

• [2024] Learning Generic and Dynamic Locomotion of Humanoids Across Discrete Terrains [paper] [video]

• [2024] HumanPlus: Humanoid Shadowing and Imitation from Humans [project] [paper] [code]

• [2024] WoCoCo: Learning Whole-Body Humanoid Control with Sequential Contacts [project] [paper]

• [2024] OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learning [project] [paper]

• [2024] Humanoid Parkour Learning [project]

• [2024] Hierarchical World Models as Visual Whole-Body Humanoid Controllers [paper] [code]

• [2024] Toward Understanding Key Estimation in Learning Robust Humanoid Locomotion [paper]

• [2024] Unsupervised Neural Motion Retargeting for Humanoid Teleoperation [paper]

• [2024] Deep Reinforcement Learning for Bipedal Locomotion: A Brief Survey [paper]

• [2024] Revisiting Reward Design and Evaluation for Robust Humanoid Standing and Walking [project] [paper]

• [2024] Humanoid-Gym: Reinforcement Learning for Humanoid Robot with Zero-Shot Sim2Real Transfer [paper] [code]

• [2024] Humanoid Robots at work: where are we ? [Survey] [paper]

• [2024] Diffusing in Someone Else's Shoes: Robotic Perspective Taking with Diffusion [Manipulation] [paper]

• [2024] Large Language Models for Orchestrating Bimanual Robots [Manipulation] [paper]

• [2024] Humanoid Locomotion as Next Token Prediction [paper]

• [2024] HumanoidBench: Simulated Humanoid Benchmark for Whole-Body Locomotion and Manipulation [benchmark] [project] [paper] [code]

• [2024] Learning Human-to-Humanoid Real-Time Whole-Body Teleoperation [paper] [video]

• [2024] Reinforcement Learning for Versatile, Dynamic, and Robust Bipedal Locomotion Control [paper] [video]

• [2024] Whole-body Humanoid Robot Locomotion with Human Reference [imitation] [project] [paper] [video]

• [2024] Expressive Whole-Body Control for Humanoid Robots [imitation] [project] [paper]

2023

• [Nature-Machine-Intelligence] Hierarchical generative modelling for autonomous robots [paper]

• [ICRA] Optimizing Bipedal Locomotion for The 100m Dash With Comparison to Human Running. [paper]

• [2023] Learning Vision-Based Bipedal Locomotion for Challenging Terrain. [paper]

• [IROS] Development of a Whole-body Work Imitation Learning System by a Biped and Bi-armed Humanoid [paper] [project]

• [2023] Learning Bipedal Walking for Humanoids with Current Feedback. [paper] [code]

• [2023] Learning Humanoid Locomotion with Transformers. [paper]

• [Humanoid] Deep Imitation Learning for Humanoid Loco-manipulation through Human Teleoperation [imitation] [Tele-Opreation] [paper] [project] [code]

• [ICRA] Benchmarking Potential Based Rewards for Learning Humanoid Locomotion. [paper]

• [IEEE-RAL] Learning Complex Motor Skills for Legged Robot Fall Recovery. [paper]

2022

• [2022] MoCapAct: A Multi-Task Dataset for Simulated Humanoid Control. [imitation] [paper] [project]

• [2022] Imitate and Repurpose: Learning Reusable Robot Movement Skills From Human and Animal Behaviors. [imitation] [paper]

• [2022] NeRF2Real: Sim2real Transfer of Vision-guided Bipedal Motion Skills using Neural Radiance Fields. [paper]

• [2022] Learning Bipedal Walking On Planned Footsteps For Humanoid Robots. [paper] [code]

• [2022] Dynamic Bipedal Maneuvers through Sim-to-Real Reinforcement Learning. [paper]

• [2022] Sim-to-Real Learning of Compliant Bipedal Locomotion on Torque Sensor-Less Gear-Driven Humanoid. [paper]

• [PMLR] Towards Real Robot Learning in the Wild: A Case Study in Bipedal Locomotion. [paper]

• [PMLR] Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learning. [platform] [paper] [code]

• [ICRA] Sim-to-Real Learning of Footstep-Constrained Bipedal Dynamic Walking. [paper]

• [ACM GRAPH] ASE: Large-Scale Reusable Adversarial Skill Embeddings for Physically Simulated Characters [paper]

• [ICMA] Custom Sine Waves Are Enough for Imitation Learning of Bipedal Gaits with Different Styles. [paper]

• [Machines] Deep Reinforcement Learning for Model Predictive Controller Based on Disturbed Single Rigid Body Model of Biped Robots. [paper]

• [IEEE-RAS] Improving Sample Efficiency of Deep Reinforcement Learning for Bipedal Walking. [paper] [code]

• [IEEE-RAS] Dynamic Bipedal Turning through Sim-to-Real Reinforcement Learning. [paper]

• [IEEE-RAS] Learning Bipedal Walking On Planned Footsteps For Humanoid Robots. [paper] [code]

• [TCAS-II] Parallel Deep Reinforcement Learning Method for Gait Control of Biped Robot. [paper]

• [IEEE-RAL] Linear Policies are Sufficient to Realize Robust Bipedal Walking on Challenging Terrains. [paper]

2021

• [2021] Pushing the Limits: Running at 3.2m/s on Cassie. [sim2real][paper]

• [ICRA] Reinforcement Learning for Robust Parameterized Locomotion Control of Bipedal Robots. [sim2real] [paper]

• [ICRA] Sim-to-Real Learning of All Common Bipedal Gaits via Periodic Reward Composition. [paper]

• [ICRA] Deepwalk: Omnidirectional bipedal gait by deep reinforcement learning. [paper]

• [IROS] Robust Feedback Motion Policy Design Using Reinforcement Learning on a 3D Digit Bipedal Robot. [paper]

• [RSS] Blind Bipedal Stair Traversal via Sim-to-Real Reinforcement Learning. [paper]

• [ICRA] Learning Task Space Actions for Bipedal Locomotion [paper]

2020

• [RSS] Learning Memory-Based Control for Human-Scale Bipedal Locomotion. [sim2real] [paper] [unofficial_code]

• [PMLR] Learning Locomotion Skills for Cassie: Iterative Design and Sim-to-Real. [paper]

• [IEEE-RAL] Learning Natural Locomotion Behaviors for Humanoid Robots Using Human Bias. [paper]

• [3DV] Grasping Field: Learning Implicit Representations for Human Grasps [paper]

2019

• [IROS] Sim-to-Real Transfer for Biped Locomotion. [paper]

• [SIG GRAPH] Catch & Carry: Reusable Neural Controllers for Vision-Guided Whole-Body Tasks [paper]

• [Science Robotics] Learning Agile and Dynamic Motor Skills for Legged Robots. [paper] [code]

2018

• [IEEE RAS] Learning Whole-body Motor Skills for Humanoids. [paper]

Related awesome-lists

• awesome-isaac-gym
• Hybrid Robotics Publications
• Reinforcement-Learning-in-Robotics
• bipedal-robot-learning-collection
• Awesome_Quadrupedal_Robots
• Awesome-Implicit-NeRF-Robotics
• Legged-Robots
• Awesome Robot Descriptions
• awesome-legged-locomotion-learning
• awesome-humanoid-manipulation