RepDNet:A re-parameterization despeckling network for autonomous underwater side-scan sonar imaging with prior-knowledge customized convolution

Side-scan sonar(SSS)is now a prevalent instrument for large-scale seafloor topography measurements,deployable on an autonomous underwater vehicle(AUV)to execute fully automated underwater acoustic scanning imaging along a predetermined trajectory.However,SSS images often suffer from speckle noise caused by mutual interference between echoes,and limited AUV computational resources further hinder noise suppression.Existing approaches for SSS image processing and speckle noise reduction rely heavily on complex network structures and fail to combine the benefits of deep learning and domain knowledge.To address the problem,Rep DNet,a novel and effective despeckling convolutional neural network is proposed.Rep DNet introduces two re-parameterized blocks:the Pixel Smoothing Block(PSB)and Edge Enhancement Block(EEB),preserving edge information while attenuating speckle noise.During training,PSB and EEB manifest as double-layered multi-branch structures,integrating first-order and secondorder derivatives and smoothing functions.During inference,the branches are re-parameterized into a 3×3 convolution,enabling efficient inference without sacrificing accuracy.Rep DNet comprises three computational operations:3×3 convolution,element-wise summation and Rectified Linear Unit activation.Evaluations on benchmark datasets,a real SSS dataset and Data collected at Lake Mulan aestablish Rep DNet as a well-balanced network,meeting the AUV computational constraints in terms of performance and latency.

渔业声学数据后处理软件现状评述与展望:以Sonar5-Pro为例

渔业声学数据解析是渔业资源声学调查研究和应用的关键所在。目前全球渔业声学数据后处理的代表性软件主要有挪威Sonar5-Pro和澳大利亚Echoview。以Sonar5-Pro为例,开展了5个方面的研究:1)回顾了该软件自1994年以来近30年的发展历史;2)介绍了软件对声学数据进行处理的总体思路,即前处理、数据分析和结果展示3个步骤及贯穿始终的数据检视功能,以及软件的5项重要设计理念;3)介绍了该软件9项代表性功能特性的实现思路和具体方法;4)以主流分析应用鱼类生物量分析过程为例,介绍了软件的数据处理流程;5)对该软件的3项核心关键技术,即多目标跟踪(multiple target tracking)、交叉过滤跟踪(crossfilter tracker)和图像分析工具(image analysis)进行了详细介绍。研究发现,一个成熟的渔业声学数据后处理系统庞大而复杂,涉及渔业、物理学和计算机多学科知识的融合,着力加强相关领域交叉学科人才培养,充分借鉴吸收国外已有先进理念和成熟技术,基于各种应用场景需求研发具有自主知识产权的分析软件,采用引进消化吸收再逐点突破最终集成创新的方式,可以作为未来提升中国渔业声学数据解析能力和水平的重要发展途径。

YOLOv5-Based Seabed Sediment Recognition Method for Side-Scan Sonar Imagery

Seabed sediment recognition is vital for the exploitation of marine resources.Side-scan sonar(SSS)is an excellent tool for acquiring the imagery of seafloor topography.Combined with ocean surface sampling,it provides detailed and accurate images of marine substrate features.Most of the processing of SSS imagery works around limited sampling stations and requires manual interpretation to complete the classification of seabed sediment imagery.In complex sea areas,with manual interpretation,small targets are often lost due to a large amount of information.To date,studies related to the automatic recognition of seabed sediments are still few.This paper proposes a seabed sediment recognition method based on You Only Look Once version 5 and SSS imagery to perform real-time sedi-ment classification and localization for accuracy,particularly on small targets and faster speeds.We used methods such as changing the dataset size,epoch,and optimizer and adding multiscale training to overcome the challenges of having a small sample and a low accuracy.With these methods,we improved the results on mean average precision by 8.98%and F1 score by 11.12%compared with the original method.In addition,the detection speed was approximately 100 frames per second,which is faster than that of previous methods.This speed enabled us to achieve real-time seabed sediment recognition from SSS imagery.

Underwater Gas Leakage Flow Detection and Classification Based on Multibeam Forward-Looking Sonar

The risk of gas leakage due to geological flaws in offshore carbon capture, utilization, and storage, as well as leakage from underwater oil or gas pipelines, highlights the need for underwater gas leakage monitoring technology. Remotely operated vehicles(ROVs) and autonomous underwater vehicles(AUVs) are equipped with high-resolution imaging sonar systems that have broad application potential in underwater gas and target detection tasks. However, some bubble clusters are relatively weak scatterers, so detecting and distinguishing them against the seabed reverberation in forward-looking sonar images are challenging. This study uses the dual-tree complex wavelet transform to extract the image features of multibeam forward-looking sonar. Underwater gas leakages with different flows are classified by combining deep learning theory. A pool experiment is designed to simulate gas leakage, where sonar images are obtained for further processing. Results demonstrate that this method can detect and classify underwater gas leakage streams with high classification accuracy. This performance indicates that the method can detect gas leakage from multibeam forward-looking sonar images and has the potential to predict gas leakage flow.

如何利用Jenkins与Sonar提升产品内在质量

对于软件工程而言,我们的内外部质量是什么呢?对客户、最终用户、间接用户的需求满足程度即是产品的外部质量。软件的内部质量,即产品架构的合理性,可扩展性,代码的规范性,可读性,简洁度,组件重用等等,这些质量属性往往对客户是不可见的。在公司内对代码的编写要求遵守编码规范,对于设计要求符合基本的设计原则,这些都是软件的内部质量!

An Underwater Robot Inspection Anomaly Localization Feedback System Based on Sonar Technology

This article introduces an underwater robot inspection anomaly localization feedback system comprising a real-time water surface tracking,detection,and positioning system located on the water surface,while the underwater robot inspection anomaly feedback system is housed within the underwater robot.The system facilitates the issuance of corresponding mechanical responses based on the water surface’s real-time tracking,detection,and positioning,enabling recognition and feedback of anomaly information.Through sonar technology,the underwater robot inspection anomaly feedback system monitors the underwater robot in real-time,triggering responsive actions upon encountering anomalies.The real-time tracking,detection,and positioning system from the water surface identifies abnormal conditions of underwater robots based on changes in sonar images,subsequently notifying personnel for necessary intervention.

DcNet: Dilated Convolutional Neural Networks for Side-Scan Sonar Image Semantic Segmentation

In ocean explorations,side-scan sonar(SSS)plays a very important role and can quickly depict seabed topography.As-sembling the SSS to an autonomous underwater vehicle(AUV)and performing semantic segmentation of an SSS image in real time can realize online submarine geomorphology or target recognition,which is conducive to submarine detection.However,because of the complexity of the marine environment,various noises in the ocean pollute the sonar image,which also encounters the intensity inhomogeneity problem.In this paper,we propose a novel neural network architecture named dilated convolutional neural network(DcNet)that can run in real time while addressing the above-mentioned issues and providing accurate semantic segmentation.The proposed architecture presents an encoder-decoder network to gradually reduce the spatial dimension of the input image and recover the details of the target,respectively.The core of our network is a novel block connection named DCblock,which mainly uses dilated convolution and depthwise separable convolution between the encoder and decoder to attain more context while still retaining high accuracy.Furthermore,our proposed method performs a super-resolution reconstruction to enlarge the dataset with high-quality im-ages.We compared our network to other common semantic segmentation networks performed on an NVIDIA Jetson TX2 using our sonar image datasets.Experimental results show that while the inference speed of the proposed network significantly outperforms state-of-the-art architectures,the accuracy of our method is still comparable,which indicates its potential applications not only in AUVs equipped with SSS but also in marine exploration.

Multi-beam Sonar and Side-scan Sonar Image Co-registering and Fusing

Multi-beam Sonar and Side-scan Sonar compensate each other. In order to fully utilize all information, it is necessary to fuse two kinds of image and data. And the image co-registration is an important and complicated job before fusion. This paper suggests combining bathymetric data with intensity image, obtaining the characteristic points through the minimal angles of lines, and then deciding the corresponding image points by the maximal correlate coefficient in searching space. Finally, the second order polynomial is applied to the deformation model. After the images have been co-registered, Wavelet is used to fuse the images. It is shown that this algorithm can be used in the flat seafloor or the isotropic seabed. Verification is made in the paper with the observed data.

Underwater Digital Terrain Model with GPS-aided High-resolution Profile-scan Sonar Images

The whole procedures of underwater digital terrain model (DTM) were presented by building with the global positioning system (GPS) aided high-resolution profile-scan sonar images.The algorithm regards the digital image scanned in a cycle as the raw data.First the label rings are detected with the improved Hough transform (HT) method and followed by curve-fitting for accurate location;then the most probable window for each ping is detected with weighted neighborhood gray-level co-occurrence matrix;and finally the DTM is built by integrating the GPS data with sonar data for 3D visualization.The case of an underwater trench for immersed tube road tunnel is illustrated.

Fast Segmentation Method of Sonar Images for Jacket Installation Environment

It has remained a hard nut for years to segment sonar images of jacket installation environment,most of which are noisy images with inevitable blur after noise reduction.For the purpose of solutions to this problem,a fast segmen-tation algorithm is proposed on the basis of the gray value characteristics of sonar images.This algorithm is endowed with the advantage in no need of segmentation thresholds.To realize this goal,we follow the undermentioned steps:first,calcu-late the gray matrix of the fuzzy image background.After adjusting the gray value,the image is divided into three regions:background region,buffer region and target regions.Afterfiltering,we reset the pixels with gray value lower than 255 to binarize images and eliminate most artifacts.Finally,the remaining noise is removed by morphological processing.The simulation results of several sonar images show that the algorithm can segment the fuzzy sonar images quickly and effectively.Thus,the stable and feasible method is testified.

Improving Yolo5 for Real-Time Detection of Small Targets in Side Scan Sonar Images

Side scan sonar(SSS)is an important means to detect and locate seafloor targets.Autonomous underwater vehicles(AUVs)carrying SSS stay near the seafloor to obtain high-resolution images and provide the outline of the target for observers.The target feature information of an SSS image is similar to the background information,and a small target has less pixel information;therefore,accu-rately identifying and locating small targets in SSS images is challenging.We collect the SSS images of iron metal balls(with a diameter of 1m)and rocks to solve the problem of target misclassification.Thus,the dataset contains two types of targets,namely,‘ball’and‘rock’.With the aim to enable AUVs to accurately and automatically identify small underwater targets in SSS images,this study designs a multisize parallel convolution module embedded in state-of-the-art Yolo5.An attention mechanism transformer and a convolutional block attention module are also introduced to compare their contributions to small target detection accuracy.The performance of the proposed method is further evaluated by taking the lightweight networks Mobilenet3 and Shufflenet2 as the backbone network of Yolo5.This study focuses on the performance of convolutional neural networks for the detection of small targets in SSS images,while another comparison experiment is carried out using traditional HOG+SVM to highlight the neural network’s ability.This study aims to improve the detection accuracy while ensuring the model efficiency to meet the real-time working requirements of AUV target detection.

Application Research of Sonar Detection Method in Melting Exploration at the Bottom of Piles

Karst landforms are widely distributed in China,and are most common in Yunnan,Guizhou and Guangxi.If the development of karst caves at the bottom of the piles cannot be accurately ascertained before the construction of bridge pile foundations,accidents such as hole collapse,slurry leakage,and drill sticking will easily occur.In this paper,the principle and method of sonar detection for detecting karst caves at the bottom of bridge piles was introduced,and the sonar detection data and the cave situation at the bottom of the pile during the construction process in combination with the case of Yunnan Zhenguo Highway Project was analyzed,which verifies the practicability and reliability of sonar detection method reliability.

声呐图像水下目标识别综述与展望

随着海洋资源开发和水下作业的增加,声呐图像水下目标识别已成为热门研究领域。该文全面回顾了该领域的现状和未来趋势。首先,强调了声呐图像水下目标识别的背景和重要性,指出水下环境复杂和样本稀缺增加了任务难度。其次,深入探讨了典型的成像声呐技术,包括前视声呐、侧扫声呐、合成孔径声呐、多波束测深仪、干涉合成孔径声呐和前视三维声呐等。接下来,系统地审视了二维和三维声呐图像水下目标识别方法,比较了不同算法的优劣,还讨论了声呐图像序列的关联识别方法。最后,总结了当前领域的主要挑战,展望了未来研究方向,旨在促进水下声呐目标识别领域的发展。

舰船尾流场模拟生成方法

为研究舰船尾流场生成方法,从而探索尾流特征对于舰船目标特性的影响。在实验室研究的基础上,利用螺旋桨和微孔陶瓷管组合装置,探索尾流场模拟生成方法。通过海上试验,基于多波束声呐平台,对该尾流场模拟生成方法进行了测试。试验结果为:在螺旋桨的带动下,微孔陶瓷管生成的模拟尾流声散射强度与实际尾流接近,尾流强度变化规律一致;随着螺旋桨转速的提高,模拟尾流持续时间显著增长,但最大声强有所降低。结论表明,使用微孔陶瓷管模拟气泡尾流生成可行性好,气泡发生装置放置在螺旋桨核心射流区有利于提升尾流模拟效果。

基于法线微分的3维声呐点云自适应简化方法

在不损失原始点云数据质量的前提下,大幅约简点云数据量是减少存储空间、降低后期计算强度的重要预处理步骤。针对这一需求,提出了针对水下3维声呐点云数据的自适应简化方法。首先,定义法线微分算子来识别点云中几何尺度的骤变,从而实现原始点云中边界部分点云和主体部分点云的分割。其次,对于点云的边界部分,应用移动最小二乘法来对边界点进行优化,降低噪点的影响,并保持其曲面的几何一致性;基于体素栅格结构,在边界上使用八叉树进行降采样,并在此基础上实施局部最远点采样,在实现均匀简化的同时保证已简化点云的边界部分具有各向同性,有效保留边界部分点云的几何特征信息。再次,对于点云的主体部分,为保持简化后点云整体的各向同性,使用体素中心采样法来减少数据量。然后,通过高斯滤波平滑点云表面,最后,整合简化后的边界点云和主体点云,得到简化结果。实验结果表明,提出的简化方法计算成本低、处理速度快,在与现行典型算法保持一致简化率的情况下,对水下点云数据的简化速度提高了约32%。另外,通过表面密度对比与几何失真分析,证明了提出方法对水下3维点云边界点及整体分布的优化作用。综上,此方法能提高水下作业目标探测效率,得到保留重要几何特征信息并具有各向同性的水下任务目标点云简化结果。

基于主动识别声呐的养殖塘南美白对虾探测与初步分析

为实现高效、快速和准确的虾类识别和行为观测,提出一种基于主动识别声呐(DIDSON)的养殖塘南美白对虾探测和行为分析方法。该方法利用无人艇搭载主动识别声呐(DIDSON)对养殖塘设置的8个观测点进行连续定点观测,利用基于ECHOVIEW构建的虾类识别计数模型对采集的图像数据进行识别提取,通过目标识别、目标提取、通量分析以及方向分析等方法获得养殖塘南美白对虾的初步行为特征。试验在8个观测点观测的虾群数量极值分别为251只和208只,均值为234只,单位时间内的虾群通量区间为[108,131]只/(min·m^(2)),不同点位虾群正向游塘的占比均大于85%,通量变化较小。结果显示,该方法可以观测到养殖塘内虾群存在规律性的游塘行为,相较于传统的水下视觉观察和被动声呐调查,有效解决了养殖塘中虾群行为观测的难题,为制定更加高效的虾塘饲养和管理方案提供科学的数据支持。

基于轻量化YOLOv7算法的侧扫声纳图像沉船检测

针对现有的侧扫声纳图像水下沉船检测方法存在检测速度慢,传统的YOLOv5算法存在的漏检的问题,提出基于轻量化YOLOv7算法的水下沉船检测改进方法。首先,通过随机翻转、随机噪声等操作扩充沉船图像的样本数量;然后,引入迁移学习策略,将在COCO数据集上学习到的权重迁移到沉船检测的YOLOv7网络中;其次,改进模型损失函数中惩罚项的计算方式,提升收敛速度;最后在YOLOv7网络中引入FasterNet结构,减少模型的参数量和计算复杂度,降低模型对硬件的需求,达到轻量化模型的目的。实验结果表明,改进方法较原始YOLOv7算法在类平均精度值(mAP值)上提升了4.75%,检测速度也由原来的0.0218秒/帧提升到0.0179秒/帧,证明了改进方法的工程应用价值。

多子阵SAS方位空变运动补偿子孔径算法

为解决方位空变的侧摆和偏航误差存在情形下合成孔径声纳的快速运动补偿与成像问题,提出一种多子阵合成孔径声纳方位空变运动补偿子孔径算法。首先,建立运动误差存在情形下的双程距离历程模型,并利用泰勒级数展开对双根号形式距离历程进行近似;然后,利用子孔径运动补偿和单基等效处理,将含有方位空变的侧摆和偏航误差的多子阵回波数据转换为理想的单阵回波数据;最后,利用经典的单阵频域逐线成像算法,实现快速运动补偿和高分辨成像。仿真实验与实测数据成像结果均验证了所提算法的有效性。

分布式动力吸能复合结构声纳透声窗设计研究

本文针对潜艇声纳透声窗低频水动力噪声控制需求,基于平板与声腔的耦合振动方程,利用声振传递矩阵、模态展开法以及湍流边界层脉动压力频率波数谱等,建立多层复合平板的水动力自噪声计算模型。根据动力吸振特性分析,形成分布式吸能单元控制下的平板振动噪声方程,评估分布式吸能复合结构透声窗水动力自噪声,通过循环水槽试验验证其水动力自噪声降噪效果,为新型低噪声透声窗设计提供技术支撑。

多源干扰下侧扫声呐图像复原的综合校正研究

为了减少因海洋环境以及侧扫声呐工作机理等干扰所造成的声呐图像畸变,提出多源干扰下侧扫声呐图像复原的综合校正方法。针对辐射图像明暗区域差异明显、轮廓特征模糊等问题,基于双伽马函数和Ret-inex理论设计辐射均衡化和轮廓清晰化算子,实现了图像辐射校正;针对环境干扰及工作机理所造成的图像水柱区及图像压缩等问题,设计了海底点检测因子并通过获取实际平距实现斜距校正;针对AUV速度波动造成的图像异常拖拽和压缩等问题,基于经纬度设计航行速度,并通过校正比例系数复原图像块来实现速度校正。实验测试结果表明,相较于其它方法,文中综合校正方法不仅使校正图像具有均衡性好、特征轮廓清晰、水柱区基本消除和两舫图像衔接平滑的优点,而且SNR指标平均提升了6.060%、ENT指标平均降低了16.583%、SD指标平均降低了49.904%、ENL指标平均增加了78.347%,有效实现了侧扫声呐图像的复原。