ResearchResearch paperReinforcement Learning · Robotics & Embodied AI1 source · Oct 8, 2026

Sim-to-Real RL for ASVs using SysID

Autonomous Surface Vehicles (ASVs) operating in dynamic marine environments require robust control policies for tasks such as path following and station keeping, making reinforcement learning (RL) a promising alternative to classical controllers.

Key points

  • However, existing ASV simulators rarely support parallel environments for RL training.
  • To address these challenges, we present an ASV simulator and accompanying pipeline that enables training policies starting from unknown vehicle dynamics.
  • Our framework uses only a CAD model and brief set of open-water field trajectories for approximating and refining both hydrodynamic and thruster parameters.
  • Real-world deployments on a BlueBoat ASV demonstrate successful zero-shot sim-to-real transfer in path following and station-keeping tasks without prior hydrodynamic and propeller information.

Sources (1)

  • [1]Sim-to-Real RL for ASVs using SysID
    arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 8, 03:56 PM
    Autonomous Surface Vehicles (ASVs) operating in dynamic marine environments require robust control policies for tasks such as path following and station keeping, making reinforcement learning (RL) a promising alternative to classical controllers.
    However, existing ASV simulators rarely support parallel environments for RL training.

Extractive summary: sentences quoted from the sources.

Related