一种基于机器视觉的精准注意力追踪系统

针对学生注意力分配困难和对学习影响等问题,提出一种基于机器视觉的精准注意力追踪系统。该系统包括图像采集装置和精准的注意力追踪算法。图像采集装置可以获得更清晰的眼部区域图像。瞳孔中心定位算法用轻量级的MobileNet v3替换VGG16(visual geometry group network),采用两级特征融合和中心关键点预测技术,提高了检测速度和准确率。该算法检测速度可达36帧/s,准确率为97.42%。视线追踪算法旨在解决头部偏移的影响,实现对视线的精确追踪。研发了一款面向学龄儿童的阅读认知评价交互软件。该软件利用采集到的视线坐标计算相关眼动指标,再通过心理学理论分析建模来评估学龄儿童的思维认知能力,为心理学和教育学相关领域研究提供了参考和借鉴。

基于图像特征的双目测距系统的研究

针对双目视觉测距中测量误差大、图像信息单一、实时性差等问题,提出一种基于ORB(oriented fast and rotated brief)特征的双目测距方法。对视频帧进行中值滤波处理,提取图像ORB特征,通过实验选出匹配效果最好的汉明距离。对筛选后的匹配点进行RANSAC(random sample consensus)模型估计,去除误匹配,分析视差和真实距离的模型关系,构建最优的测距模型并在实验平台上进行验证。结果表明:所提方法比其他双目测距方法具有测距精确、运行速度快、鲁棒性强的优势,能够实时显示图中特征的距离信息。

Real-time tracking of deformable objects based on MOK algorithm

The traditional oriented FAST and rotated BRIEF（ORB） algorithm has problems of instability and repetition of keypoints and it does not possess scale invariance. In order to deal with these drawbacks, a modified ORB（MORB） algorithm is proposed. In order to improve the precision of matching and tracking, this paper puts forward an MOK algorithm that fuses MORB and Kanade-Lucas-Tomasi（KLT）. By using Kalman, the object＇s state in the next frame is predicted in order to reduce the size of search window and improve the real-time performance of object tracking. The experimental results show that the MOK algorithm can accurately track objects with deformation or with background clutters, exhibiting higher robustness and accuracy on diverse datasets. Also, the MOK algorithm has a good real-time performance with the average frame rate reaching 90.8 fps.

Valence orbital method of calculating harmonic emission from diatomic molecule

We present a valence orbital method of calculating high-order harmonic generation from a diatomic molecule with arbitrary orientation by using a space rotation operator. We evaluate the effects of each valence orbital on harmonic emissions from N2 and O2 molecules in detail separately. The calculation results confirm the different properties of harmonic yields from N2 and O2 molecules which are well consistent with available experimental data. We observe that due to the orientation dependence of ／sigma and ／pi orbitals, the bonding orbital （π2pz）^2 of N2 determines the maximum of harmonic emission when the molecular axis of N2 is aligned parallel to the laser vector, and the magnitude of the high harmonic signal gradually weakens with the orientation angle of molecular axis increasing. But for O2 molecule the antibonding orbitals （π2pz）^1 and （π2pz）^1 contribute to the maximum of harmonic yield when O2 is aligned at 45° and bonding orbitals （π2pz）^2 and （π2pz）^2 slightly influence the orientation angle of maximum of harmonic radiation not exactly at 45°.

RB-SLAM:visual SLAM based on rotated BEBLID feature point description

The extraction and description of image features are very important for visual simultaneous localization and mapping(V-SLAM).A rotated boosted efficient binary local image descriptor(BEBLID)SLAM(RB-SLAM)algorithm based on improved oriented fast and rotated brief(ORB)feature description is proposed in this paper,which can solve the problems of low localization accuracy and time efficiency of the current ORB-SLAM3 algorithm.Firstly,it uses the BEBLID to replace the feature point description algorithm of the original ORB to enhance the expressiveness and description efficiency of the image.Secondly,it adds rotational invariance to the BEBLID using the orientation information of the feature points.It also selects the rotationally stable bits in the BEBLID to further enhance the rotational invariance of the BEBLID.Finally,it retrains the binary visual dictionary based on the BEBLID to reduce the cumulative error of V-SLAM and improve the loading speed of the visual dictionary.Experiments show that the dictionary loading efficiency is improved by more than 10 times.The RB-SLAM algorithm improves the trajectory accuracy by 24.75%on the TUM dataset and 26.25%on the EuRoC dataset compared to the ORB-SLAM3 algorithm.

A Brain-inspired SLAM System Based on ORB Features

This paper describes a brain-inspired simultaneous localization and mapping （SLAM） system using oriented features from accelerated segment test and rotated binary robust independent elementary （ORB） features of RGB （red, green, blue） sensor for a mobile robot. The core SLAM system, dubbed RatSLAM, can construct a cognitive map using information of raw odometry and visual scenes in the path traveled. Different from existing RatSLAM system which only uses a simple vector to represent features of visual image, in this paper, we employ an efficient and very fast descriptor method, called ORB, to extract features from RCB images. Experiments show that these features are suitable to recognize the sequences of familiar visual scenes. Thus, while loop closure errors are detected, the descriptive features will help to modify the pose estimation by driving loop closure and localization in a map correction algorithm. Efficiency and robustness of our method are also demonstrated by comparing with different visual processing algorithms.