A few-shot learning framework for planar pushing of unknown objects
Published in Intelligent Service Robotics, 2022
🤖 Few-Shot Learning for Planar Pushing
Learning to push novel objects with limited prior interactions using simulation and few-shot learning
📋 Overview
This work presents a few-shot learning framework for planar pushing of novel objects with unknown physical properties, including center of mass (CoM), friction, and inertia.
We introduce SimPush, a large-scale simulation dataset containing over two million pushes across diverse object shapes and physical configurations.
Based on this dataset, we develop an attention-based encoder–decoder model that leverages a small number of prior push interactions to predict object motion (Δx, Δy, Δθ) together with uncertainty estimates.
Building on the predicted push affordances, we propose an uncertainty-aware planning strategy that efficiently selects pushing actions to translate objects to target poses.
The method achieves accurate motion prediction in simulation and successfully transfers to real-world experiments without real-data training, while requiring fewer push steps than baseline methods.
🎯 Key Contributions
- Large-scale SimPush dataset with over 2 million pushing interactions
- Few-shot learning framework that adapts to novel objects with minimal prior interactions
- Attention-based encoder-decoder architecture for motion prediction with uncertainty estimation
- Uncertainty-aware planning strategy for efficient object manipulation
- Successful sim-to-real transfer without requiring real-world training data
🎥 Demonstration Videos
Description: This video demonstrates the benefits of the proposed uncertainty-aware pushing planning method compared with a greedy pushing strategy. The comparison shows how our method, which leverages predicted motion affordances and uncertainty estimates, can achieve the goal more efficiently with fewer pushing steps. The greedy strategy, which selects actions based only on immediate progress toward the goal, requires significantly more interactions. This highlights the value of considering uncertainty in planning and making more informed pushing decisions to guide objects to target poses.
📄 Publication Details
Authors: Ziyan Gao, Alp Elibol, Nak Young Chong
Venue: Intelligent Service Robotics
Volume: 15
Issue: 3
Pages: 335-350
Publication Date: 2022-07-01
Recommended citation: Gao, Z., Elibol, A., & Chong, N. Y. (2022). A few-shot learning framework for planar pushing of unknown objects. Intelligent Service Robotics, 15(3), 335-350.
Download Paper
