Measurement method for cluster warhead's dispersion area based on binocular stereo vision technique

Cluster warhead has become the main ammunition of gun,rocket projectile and missile and it has been widely equipped in almost every country.More and more attention is paid to the damage effect of cluster warhead.The size of the dispersion area of cluster warhead is the main standard by which the damage effect of cluster warhead is estimated.The practical method of measuring the dispersion area was developed based on binocular stereo vision measurement theory.The calibration principle of the binocular stereo vision cameras was studied.The matching algorithm that relies on the gradient fields of the neighborhood of a pixel has been used to obtain the spatial information of matched points by acquiring apair of corresponding points in the left and right images of binocular cameras.The 3Dpositions of the flying path of cluster warhead were calculated.The umbrella that is similar to the dispersion track of static explosive cluster warhead was applied in the experiment to get the projection area of the umbrella on the ground.Experiment results verify the feasibility of the proposed method.

Hawk‐eye‐inspired perception algorithm of stereo vision for obtaining orchard 3D point cloud navigation map

The binocular stereo vision is the lowest cost sensor for obtaining 3D information.Considering the weakness of long‐distance measurement and stability,the improvement of accuracy and stability of stereo vision is urgently required for application of precision agriculture.To address the challenges of stereo vision long‐distance measurement and stable perception without hardware upgrade,inspired by hawk eyes,higher resolution perception and the adaptive HDR(High Dynamic Range)were introduced in this paper.Simulating the function from physiological structure of‘deep fovea’and‘shallow fovea’of hawk eye,the higher resolution reconstruction method in this paper was aimed at ac-curacy improving.Inspired by adjustment of pupils,the adaptive HDR method was proposed for high dynamic range optimisation and stable perception.In various light conditions,compared with default stereo vision,the accuracy of proposed algorithm was improved by 28.0%evaluated by error ratio,and the stability was improved by 26.56%by disparity accuracy.For fixed distance measurement,the maximum improvement was 78.6%by standard deviation.Based on the hawk‐eye‐inspired perception algorithm,the point cloud of orchard was improved both in quality and quantity.The hawk‐eye‐inspired perception algorithm contributed great advance in binocular 3D point cloud recon-struction in orchard navigation map.

基于Stereo Camera-YOLOv5自然环境下百香果检测与定位模型

针对百香果采摘机器人在自然环境中作业时受复杂光线及遮挡影响,难以快速精确地检测及定位成熟百香果的问题,提出一种基于Stereo Camera-YOLOv5自然环境下成熟百香果检测及定位模型。针对自然环境下光线以及遮挡的影响,通过MSRCP算法、随机遮挡、数据增扩等图像处理算法对原始数据集进行优化。将优化的数据集输入到YOLOv5网络中训练出最优模型,在检测代码中嵌入双目立体视觉算法。该模型对自然环境下百香果进行检测及成熟度判断,将判断为成熟的百香果进行图像处理,并提取到中心点二维坐标。通过立体匹配及视差计算得到中心点的三维坐标。田间试验结果表明,该模型的目标检测准确率为97.8%,总体准确率为90.2%,平均运行时间为4.85 s。该系统鲁棒性强、实时性好,能够更好地实现自然环境下成熟百香果的检测及定位,为百香果采摘机器人后续工作奠定基础。

Accuracy study of a binocular-stereo-vision-based navigation robot for minimally invasive interventional procedures

BACKGROUND Medical robot is a promising surgical tool,but no specific one has been designed for interventional treatment of chronic pain.We developed a computed tomography-image based navigation robot using a new registration method with binocular vision.This kind of robot is appropriate for minimal invasive interventional procedures and easy to operate.The feasibility,accuracy and stability of this new robot need to be tested.AIM To assess quantitatively the feasibility,accuracy and stability of the binocularstereo-vision-based navigation robot for minimally invasive interventional procedures.METHODS A box model was designed for assessing the accuracy for targets at different distances.Nine(three sets)lead spheres were embedded in the model as puncture goals.The entry-to-target distances were set 50 mm(short-distance),100 mm(medium-distance)and 150 mm(long-distance).Puncture procedure was repeated three times for each goal.The Euclidian error of each puncture was calculated and statistically analyzed.Three head phantoms were used to explore the clinical feasibility and stability.Three independent operators conducted foramen ovale placement on head phantoms(both sides)by freehand or under the guidance of robot(18 punctures with each method).The operation time,adjustment time and one-time success rate were recorded,and the two guidancemethods were compared.RESULTS On the box model,the mean puncture errors of navigation robot were 1.7±0.9 mm for the short-distance target,2.4±1.0 mm for the moderate target and 4.4±1.4 mm for the long-distance target.On the head phantom,no obvious differences in operation time and adjustment time were found among the three performers(P>0.05).The median adjustment time was significantly less under the guidance of the robot than under free hand.The one-time success rate was significantly higher with the robot(P<0.05).There was no obvious difference in operation time between the two methods(P>0.05).CONCLUSION In the laboratory environment,accuracy of binocular-stereo-vision-based navigation robot is acceptable for target at 100 mm depth or less.Compared with freehand,foramen ovale placement accuracy can be improved with robot guidance.

Measuring Propeller Blade Width Using Binocular Stereo Vision

Propeller blade width measurement has been extensively studied in the past using direct and indirect methods, and it plays a great role in determining the quality of the finished products. It has surveyed that previous techniques are usually time-consuming and erroneous due to a large number of points to be processed in blade width measurement. This paper proposes a new method of measuring blade width using two images acquired from different viewpoints of the same blade. And a new feature points matching approach for propeller blade image is proposed in stereo vision measurement. Based on these, pixel coordinates of contour points of the blade in two images are extracted and converted to real world coordinates by image algorithm and binocular stereo machine vision theory. Then, from the real world coordinates, the blade width at any position can be determined by simple geometrical method.

Research on Extraction of Bottom of Shoe Pattern Based on Binocular Stereo Vision

In order to quickly and efficiently get the information of the bottom of the shoe pattern and spraying trajectory, the paper proposes a method based on binocular stereo vision. After acquiring target image, edge detection based on the canny algorithm, the paper begins stereo matching based on area and characteristics of algorithm. To eliminate false matching points, the paper uses the principle of polar geometry in computer vision. For the purpose of gaining the 3D point cloud of spraying curve, the paper adopts the principle of binocular stereo vision 3D measurement, and then carries on cubic spline curve fitting. By HALCON image processing software programming, it proves the feasibility and effectiveness of the method

REAL-TIME STEREO MATCHING ALGORITHM IN PHOTODYNAMIC THERAPY BINOCULAR SURVEILLANCE SYSTEM FOR PORT WINE STAIN

A stereo matching algorithm based on the epipolar line constraint is designed to meet the real-time and the accuracy requirements. The algorithm is applied to photodynamic therapy binocular surveillance system for port wine stain （PWS） when it monitors the position of the treatment region. The corner matching based on Hu moments is used to calculate the fundamental matrix of the binocular vision system. Experimental results are in agreement with the theoretical calculation.

基于双目视觉的车前行人检测方法研究

当前的汽车安全辅助驾驶和无人驾驶汽车是图像领域的研究热点,针对汽车在启动或行驶时车前存在行人可能导致的安全问题,着重研究了基于双目视觉的车前行人检测方法。进行了双目相机的相机标定和立体标定;通过改进后半全局立体匹配算法获取深度图,确定车前行人所处位置的感兴趣区域(Region of Interest,ROI),剔除冗余的背景信息;分割并提取了图像的降维梯度直方图(Histogram of Gradients,HOG)特征信息;将特征输入到支持向量机(Support Vector Machine,SVM)分类器训练,检测并标记出车前的行人目标。实验证明,所提算法对车前场景下的动态行人可以更为有效地检测,具备更优的检率精度、时效性和鲁棒性。

电力变压器关键尺寸视觉检测方法及其缩比模型验证

电力变压器的关键尺寸测量是其装配制造、运输安装过程中重要一环,现有测量方法操作繁琐且效率较低。为此,本文提出了一种适用于110 kV油浸式电力变压器关键尺寸视觉检测方法,该方法利用YOLO目标检测算法、Grabcut图像分割算法实现关键组部件的智能检测与分割,然后基于双目立体视觉原理实现套管相间距离及变压器最大截面外形尺寸等关键尺寸的测量。本文搭建了110 kV油浸式电力变压器外观缩比模型,试验分析了拍摄距离和角度等因素对电力变压器关键尺寸视觉检测的影响。结果表明,本文基于缩比模型试验实现了在不同拍摄距离与角度下变压器关键尺寸的视觉检测,验证了该方法的有效性。本文方法可以为110 kV油浸式电力变压器现场尺寸测量提供参考。

一种密集多尺度特征引导代价聚合的改进立体匹配网络

针对目前立体匹配算法在重复纹理、无纹理、边缘等不适定性区域仍存在匹配不准确的问题,提出了一种基于PSMNet的密集多尺度特征引导代价聚合的立体匹配算法—DGNet(Dense multi-scale features Guided aggregation Network)。首先,基于密集连接空洞空间金字塔池化结构设计了密集多尺度特征提取模块,该模块利用不同膨胀率的空洞卷积提取不同尺度的区域级特征,并通过密集连接方式有效整合不同尺度的图像特征,使网络捕获丰富的上下文关系;其次,在每个视差等级下将左右特征图串联形成初始代价体,再提出密集多尺度特征引导代价聚合结构,在聚合代价体的同时自适应融合代价体和密集多尺度特征,从而使后续的解码层在多尺度上下文信息的引导下解码出更加精确和高分辨率的几何信息;最后,将全局优化后的高分辨率代价体送入视差回归模块以获得视差图。实验结果表明:所提算法在KITTI 2015和KITTI 2012数据集上的误匹配率分别降至1.76%和1.24%,SceneFlow数据集上的端点误差降至0.56 px,与GWCNet、CPOP-Net等先进算法相比,所提算法在不适定区域有明显改善。

改进Census变换与特征融合的立体匹配算法

针对局部立体匹配算法匹配精度较低问题,提出一种改进Census变换与特征融合的立体匹配算法。首先,使用变换窗口的邻域像素信息代替中心像素,解决传统Census变换过度依赖窗口中心像素问题;其次,引入图像的颜色信息与梯度信息构建融合代价计算函数,提高初始匹配代价的可靠性;为建立邻域像素间联系,引入单向动态规划思想进行代价聚合;最后,提出一种基于八方向的视差空洞填充方法对视差图进行优化。实验结果表明:该算法在Middlebury数据集上的平均误匹配率为3.77%,优于其他改进Census变换方法,具有较高的匹配精度。

信号博弈的三维重建形变识别算法

现有双目立体视觉算法常常需要双目相机位置固定,在现实应用中,这类算法难以重构空间三维几何关系.为此,本文提出了一种不受位置限制的多视角图像三维重建与形变检测算法.该算法首先采用sift算法获取成对图像的特征点,以获取形变前后比对点对图像的特征信息;其次,利用信号博弈方法确定图像拍摄时相机的空间位置与视角,以准确获取图像的空间位置坐标;再次,依据上述信息完成物体的三维点云重建;进而,利用三维数据信息比对实现物体形变识别.最后,本文利用真实物体的实验,验证了三维重建形变识别算法的有效性.

基于Pynq的半全局立体匹配算法实现

立体匹配算法作为双目立体视觉技术的核心算法,具有运算复杂度高、资源占用率高、实时性差的特点。而现有的基于FPGA实现方法多采用高性能FPGA芯片,利用其板卡丰富的资源进行纯verilog语言开发。这样做虽然实时性效果不错,但存在开发难度较大、周期较长、成本较高的弊端。论文针对该问题,提出了一种基于相对低廉的Pynq-z2开发板在PL+PS端协同开发的SGM立体匹配算法,将运算量大的部分在FPGA端进行硬件加速,部分代价优化算法在ARM端利用Python语言实现。实验表明,该算法可有效降低资源占用率,基本满足在相对低廉的嵌入式设备中实现的要求。

基于双目视觉的柔性塑胶套壁厚检测系统研究

为了完成锥形波纹管形状的柔性塑胶防尘套壁厚的检测,建立一个基于双目立体视觉模型的测量系统。该系统中的两个工业数字摄像机通过PLC给予的外触发对工件同时进行图像采集,对采集的多组图像进行相应的预处理后,采用特征点提取方法实现图像拼接,运用特征匹配算法提取出相应待测点三维坐标信息,完成柔性塑胶防尘套壁厚检测。该测量系统,使用气动柔性夹爪夹取工件,减少柔性工件的夹取变形影响,使用高精度移动滑台带动工件运动到拍照位置,通过控制滑台特定的移动距离和对图形特征提取结合方法对多次拍照后的工件图像进行特征点筛选和图像拼接,完成工件壁厚的高精度检测。实验数据表明,该测量系统绝对检测精度达±0.05mm以内,简单快捷,缩短了工件生产工作中的设备调整时间。

基于双目视觉的输送带表面损伤定量分析方法

为了对输送带表面损伤进行定量分析以有效判断其损伤程度,并根据损伤程度选择检修方法和时间,为工作人员检修提供依据,提出了一种基于双目立体视觉的输送带表面损伤定量分析方法。该方法首先对双目相机进行相机标定,对输送带表面损伤图像进行图像处理校正、立体匹配,基于视差原理根据三角测量原理获取目标点的三维空间信息,通过数学计算模型对损伤程度进行定量分析,提出了改进的Census变换和SGM(semi-global matching)算法相结合的立体匹配算法。结果表明:提出的改进算法匹配效果有所提升,和Census变换算法及梯度算法进行对比,误匹配率分别降低了5.26百分点和3.92百分点,得出的视差图精度最高;通过提出的方法对输送带表面损伤进行定量分析,在输送带损伤长度、宽度、深度三者误差中,损伤深度误差最大为8.5%,仍在可接受范围。

双目视觉下钻杆接口定位的实现

智能机器人技术的快速发展推动了石油钻机装备自动化和智能化的提升。针对目前石油钻机上卸扣作业中,传统的钻杆接口定位存在困难,无法实现完全自动化的问题,提出了一种基于改进YOLOv5x算法的智能钻杆接口检测方法,并在双目视觉下建立了钻杆接口定位模型。模型基于卷积神经网络提取钻杆接口的图像特征,从而实现自动识别;融合CBAM(Convolution Block Attention Module)注意力机制以提高模型的特征提取与表达能力,引入更大尺度特征图作为小目标检测层,减少了钻杆接口图像中小目标的误检和漏检情况;结合SGBM(Semi-Global Block Matching)算法,实现双目视觉下钻杆接口的精准定位;通过网络训练检验改进算法的性能,并在模拟试验环境下开展了钻杆接口的定位试验。试验结果表明:改进YOLOv5x算法平均精度达到98.6%,比原始YOLOv5x算法提高了3.0%;上下接口平均定位误差分别为7.64和6.56 mm,符合工程误差要求,具有一定的工程应用价值。所得结论可为钻杆接口的准确检测和精准定位提供技术参考。

基于双目立体视觉和轻量化神经网络的交通标志分割和识别

为了降低交通标志图像分割运算量,提出一种基于双目立体视觉和轻量化神经网络的交通标志分割和识别方法。使用已标定的双目立体视觉相机采集交通标志图像,并将其作为轻量化卷积神经网络的输入,通过卷积运算和池化运算提取交通标志的特征。在全连接层中,采用极限学习机和权值修正方法修正输出权值,从而得到交通标志的分割结果。实验结果表明,所提方法能够有效采集高精度的交通标志图像,并降低图像分割运算的复杂性,从而提高交通标志图像的应用性。

基于双目视觉的废料尺寸测量系统设计与研究

为了克服工业废料尺寸测量时人工测量成本高且效率低的问题,提出了一种双目视觉系统。该系统融合了精密机械结构、双目视觉技术及先进图像分析算法,实现了废料三维尺寸的快速自动检测。在双目视觉测量技术应用上,系统基于平行式双目视觉理论,通过SGBM算法实现立体匹配。与BM算法相比,SGBM算法获得了更优的匹配精度与边缘清晰度,有效提升了测量的准确性,可输出高分辨率的视差图像与点云数据,为废料尺寸的关键参数提取提供了坚实基础。试验结果表明,该系统测量误差较低,不超过2.5 mm,符合要求。

基于双目视觉技术的茶叶嫩芽定位方法研究

进一步提升茶叶嫩芽定位的准确性及茶叶嫩芽采摘的作业效率,选取双目视觉技术作为切入点,针对其识别、定位、采摘等环节展开设计研究。考虑茶叶嫩芽采摘的基础特征和双目视觉技术的应用条件,合理搭建双目视觉模型,选用立体匹配的核心定位算法,完成茶叶嫩芽的定位方法与采摘功能优化,并布置相应的试验机构,展开定位采摘验证试验。结果表明:基于双目视觉技术的茶叶嫩芽定位方法应用具有显著的优越性,较普通定位方法而言,识别误匹配率可降低至4.01%,平均漏采率为3.20%,嫩芽采摘完整率达93.40%,可以很好地促进茶叶嫩芽的后续处理加工,是采摘茶叶嫩芽的品质化的重要基础保障。

双目立体视觉下破损黑陶三维重建方法仿真

在三维重建过程中,由于受环境光线变化、物体透明度、遮挡等因素影响,导致重建结果不准确或不完整,使得视觉效果较差。为了提高三维重建精度,提出一种基于双目立体视觉的破损黑陶三维重建方法。通过转换世界-相机-图像-像素坐标系,标定双目立体视觉相机内外参数,引入最小生成树方法立体匹配左右图像对,计算图像像素绝对强度、梯度、匹配截断值对黑陶重建曲面平滑度的影响,得到连续稠密的视差图,使用最小二乘曲线拟合法平滑处理黑陶三维点云数据,将游离在曲面外的点映射到曲面中,通过三角剖分实现破损黑陶三维表面重建。实验结果表明,所提方法能够有效提高重建后黑陶表面平滑度,且重建结果尺寸精准,拟合度高。