动态的DLO操作(DLO dynamic manipulation)

2023

Goal-Image Conditioned Dynamic Cable Manipulation through Bayesian Inference and Multi-Objective Black-Box Optimization ^kuniyuki-2023

Kuniyuki Takahashi et al., Preferred Networks Inc. ICRA 2023

CategoryMethod
Application
Problem abstractiondynamic, form a shape
DLO model (physical model/topology model/model-free)?stochastic forward model, Tree-structured Parzen Estimator,端到端
DLO detecting method (CV/Tact/Mixture)Only RGB, no D。通过阈值对图像二值化,作为神经网络的输入
If use CV, what method?
Motion planning method端到端,不进行motion plan
Shape Control建立前后帧(shape)与帧间关节运动的关联
  • 通过三自由度机械臂动态的摆动改变线缆形状
  • dynamic task
  • 端到端,输入图像输出关节角度。black-box optimization (BBO) -> Tree-structured Parzen Estimator (TPE)

2021

Robots of the Lost Arc: Self-Supervised Learning to Dynamically Manipulate Fixed-Endpoint Cables (2021)

Harry Zhang et al., ICRA 2021

  • Dynamic manipulation,完成三类操作
    • Vaulting: vault over obstacles a person vacuuming may find that the vacuum power cable is stuck on a chair, and use dynamic manipulation to “vault” the cable over the chair
    • Knocking: knock object from pedestals
    • Weaving: weave between obstacles
  • **仿真环境:**Featherstone rigid-body simulator from Bullet Physics via Blender. Cable consist of a series of small capsule links connected by spring and torsional forces
CategoryMethod
Applicationmanipulate vacuum power cable
Problem abstractionvaulting, knocking, weaving
DLO perceptionRGB image,直接输出给ResNet-34
DLO model (physical model/topology model/model-free)?model-free, use RGB image as the observation to estimate cable’s configuration space
Motion planning methodIterative traiNing for Dynamic manipulation

2017

Winding Manipulator Based on High-speed Visual Feedback Control (2017)

* Koichiro Ito et al., Yamakawa Laboratory, UTokyo, CCTA 2017*

  • “we propose casting manipulation based on highspeed visual feedback control with a whip.”
CategoryMethod
Application
Problem abstractiondynamic manipulation - winding
DLO model (physical model/topology model/model-free)?Physical + geometrical
DLO detecting method (CV/Tact/Mixture)high-speed camera
If use CV, what method?
Motion planning method
Shape Control


2010

Motion Planning for Dynamic Knotting of a Flexible Rope with a High-speed Robot Arm (2010)^yamakawa-irso2010

* Yuji Yamakawa et al., IROS2010*

  • 可能是最早一篇提到dynamic manipulation with flexible body的论文?
CategoryMethod
Application
Problem abstractiondynamic manipulation - knot tying
DLO model (physical model/topology model/model-free)?Multi-link system based on geometric property and some physical assumption.
DLO detecting method (CV/Tact/Mixture)Sim to real, no vision involved
If use CV, what method?
Motion planning methoddesired rope configuration is given by a human, converted to executable rope configuration, then to robot arm configuration through IK
Shape Control