摘要
对海下管线的检测是保证其正常运行的必要环节。文章针对海下管道巡检问题,提出一种结合状态表示学习和深度强化学习的方法,使水下机器人能够基于图像进行管线跟踪。利用无监督表征学习方法提取海底管线图像特征,结合任务情况设计了动作、状态空间和奖励函数,通过SAC算法学习一个稳健的跟踪控制策略。最后搭建仿真环境进行试验,证明了所提出方法的有效性和泛化性。
The detection of subsea pipelines is a necessary link to ensure its normal operation.For the subsea pipeline inspection problem,this paper proposes a method combining state representation learning and deep reinforcement learning,so that the underwater robot can track the pipeline based on image.The unsupervised representation learning method is used to extract the image features of submarine pipelines.Combined with the task situation,the action,state space and reward function are designed.A robust tracking control strategy is learned through SAC algorithm.Finally,a simulation environment is built to test the effectiveness and generalization of the proposed method.
作者
王昊
颜承昊
任俊丽
邵思扬
WANG Hao;YAN Chenghao;REN Junli;SHAO Siyang(School of Information Engineering,Dalian Ocean University,Dalian 116023,China)
出处
《现代信息科技》
2021年第20期16-19,23,共5页
Modern Information Technology
基金
辽宁省教育厅基本科研项目(LJKZ0730,QL202016)
辽宁省自然科学基金项目(20180550674,2020-KF-12-09)
辽宁省重点研发计划项目(2020JH2/10100043)。
关键词
AUV
海底管线跟踪
状态表示学习
深度强化学习
AUV
subsea pipeline tracking
state representation learning
deep reinforcement learning