Video-to-Model: Automatic Modeling of Deformable Linear Objects

Key points

• We utilize a recently developed CBF--CLF--QP numerical model that simplifies the characterization of deformable string motion through the selection of a small number of parameters.1
• The observed thread motion is then processed by a spatio-temporal CNN network that estimates the effective parameters of a structured CBF--CLF--QP model.1
• Experiments using unseen thread configurations and motion demonstrate that the framework can reliably reconstruct the thread behavior from video, automatically configure the structured model, and reproduce the expected thread motion with low tracking error.1
• The proposed approach reduces the need for manual parameter tuning and provides a step toward automatic video-based modeling of deformable linear objects.1

Sources (1)

• [1]Video-to-Model: Automatic Modeling of Deformable Linear Objects
  arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 7, 01:19 PM

  This paper presents a video-to-model framework for automatically modeling the motion of a deformable suture thread from an input video.

  We utilize a recently developed CBF--CLF--QP numerical model that simplifies the characterization of deformable string motion through the selection of a small number of parameters.

Extractive summary: sentences quoted from the sources.