A few-shot learning framework for planar pushing of unknown objects

Published in Intelligent Service Robotics, 2022

🤖 Few-Shot Learning for Planar Pushing

Learning to push novel objects with limited prior interactions using simulation and few-shot learning

Few-Shot Learning Robot Pushing Motion Prediction Simulation-to-Reality Deep Learning

📋 Overview

This work presents a few-shot learning framework for planar pushing of novel objects with unknown physical properties, including center of mass (CoM), friction, and inertia.

We introduce SimPush, a large-scale simulation dataset containing over two million pushes across diverse object shapes and physical configurations.

Based on this dataset, we develop an attention-based encoder–decoder model that leverages a small number of prior push interactions to predict object motion (Δx, Δy, Δθ) together with uncertainty estimates.

Building on the predicted push affordances, we propose an uncertainty-aware planning strategy that efficiently selects pushing actions to translate objects to target poses.

The method achieves accurate motion prediction in simulation and successfully transfers to real-world experiments without real-data training, while requiring fewer push steps than baseline methods.

🎯 Key Contributions

  • Large-scale SimPush dataset with over 2 million pushing interactions
  • Few-shot learning framework that adapts to novel objects with minimal prior interactions
  • Attention-based encoder-decoder architecture for motion prediction with uncertainty estimation
  • Uncertainty-aware planning strategy for efficient object manipulation
  • Successful sim-to-real transfer without requiring real-world training data

🎥 Demonstration Videos

Planning Strategy Comparison: Proposed Method vs. Greedy Strategy

Description: This video demonstrates the benefits of the proposed uncertainty-aware pushing planning method compared with a greedy pushing strategy. The comparison shows how our method, which leverages predicted motion affordances and uncertainty estimates, can achieve the goal more efficiently with fewer pushing steps. The greedy strategy, which selects actions based only on immediate progress toward the goal, requires significantly more interactions. This highlights the value of considering uncertainty in planning and making more informed pushing decisions to guide objects to target poses.

📄 Publication Details

Authors: Ziyan Gao, Alp Elibol, Nak Young Chong

Venue: Intelligent Service Robotics

Volume: 15

Issue: 3

Pages: 335-350

Publication Date: 2022-07-01

DOI: Read on Springer Link

Recommended citation: Gao, Z., Elibol, A., & Chong, N. Y. (2022). A few-shot learning framework for planar pushing of unknown objects. Intelligent Service Robotics, 15(3), 335-350.
Download Paper