Transmission Considerations with QoS Support to Deliver Real-Time Distributed Speech Recognition Applications

Distributed speech recognition (DSR) applications have certain QoS (Quality of service) requirements in terms of latency, packet loss rate, etc. To deliver quality guaranteed DSR application over wirelined or wireless links, some QoS mechanisms should be provided. We put forward a RTP/RSVP transmission scheme with DSR-specific payload and QoS parameters by modifying the present WAP protocol stack. The simulation result shows that this scheme will provide adequate network bandwidth to keep the real-time transport of DSR data over either wirelined or wireless channels.

Resource Efficient Hardware Implementation for Real-Time Traffic Sign Recognition

Traffic sign recognition (TSR, or Road Sign Recognition, RSR) is one of the Advanced Driver Assistance System (ADAS) devices in modern cars. To concern the most important issues, which are real-time and resource efficiency, we propose a high efficiency hardware implementation for TSR. We divide the TSR procedure into two stages, detection and recognition. In the detection stage, under the assumption that most German traffic signs have red or blue colors with circle, triangle or rectangle shapes, we use Normalized RGB color transform and Single-Pass Connected Component Labeling (CCL) to find the potential traffic signs efficiently. For Single-Pass CCL, our contribution is to eliminate the “merge-stack” operations by recording connected relations of region in the scan phase and updating the labels in the iterating phase. In the recognition stage, the Histogram of Oriented Gradient (HOG) is used to generate the descriptor of the signs, and we classify the signs with Support Vector Machine (SVM). In the HOG module, we analyze the required minimum bits under different recognition rate. The proposed method achieves 96.61% detection rate and 90.85% recognition rate while testing with the GTSDB dataset. Our hardware implementation reduces the storage of CCL and simplifies the HOG computation. Main CCL storage size is reduced by 20% comparing to the most advanced design under typical condition. By using TSMC 90 nm technology, the proposed design operates at 105 MHz clock rate and processes in 135 fps with the image size of 1360 × 800. The chip size is about 1 mm2 and the power consumption is close to 8 mW. Therefore, this work is resource efficient and achieves real-time requirement.

Enhancing Human-Machine Interaction:Real-Time Emotion Recognition through Speech Analysis

Humans,as intricate beings driven by a multitude of emotions,possess a remarkable ability to decipher and respond to socio-affective cues.However,many individuals and machines struggle to interpret such nuanced signals,including variations in tone of voice.This paper explores the potential of intelligent technologies to bridge this gap and improve the quality of conversations.In particular,the authors propose a real-time processing method that captures and evaluates emotions in speech,utilizing a terminal device like the Raspberry Pi computer.Furthermore,the authors provide an overview of the current research landscape surrounding speech emotional recognition and delve into our methodology,which involves analyzing audio files from renowned emotional speech databases.To aid incomprehension,the authors present visualizations of these audio files in situ,employing dB-scaled Mel spectrograms generated through TensorFlow and Matplotlib.The authors use a support vector machine kernel and a Convolutional Neural Network with transfer learning to classify emotions.Notably,the classification accuracies achieved are 70% and 77%,respectively,demonstrating the efficacy of our approach when executed on an edge device rather than relying on a server.The system can evaluate pure emotion in speech and provide corresponding visualizations to depict the speaker’s emotional state in less than one second on a Raspberry Pi.These findings pave the way for more effective and emotionally intelligent human-machine interactions in various domains.

Gesture Recognition Based on Time-of-Flight Sensor and Residual Neural Network

With the advancement of technology and the increase in user demands, gesture recognition played a pivotal role in the field of human-computer interaction. Among various sensing devices, Time-of-Flight (ToF) sensors were widely applied due to their low cost. This paper explored the implementation of a human hand posture recognition system using ToF sensors and residual neural networks. Firstly, this paper reviewed the typical applications of human hand recognition. Secondly, this paper designed a hand gesture recognition system using a ToF sensor VL53L5. Subsequently, data preprocessing was conducted, followed by training the constructed residual neural network. Then, the recognition results were analyzed, indicating that gesture recognition based on the residual neural network achieved an accuracy of 98.5% in a 5-class classification scenario. Finally, the paper discussed existing issues and future research directions.

Construction of multi-factor identification model for real-time monitoring and early warning of mine water inrush

As a new technical means that can detect abnormal signs of water inrush in advance and give an early warning,the automatic monitoring and early warning of water inrush in mines has been widely valued in recent years.Due to the many factors affecting water inrush and the complicated water inrush mechanism,many factors close to water inrush may have precursory abnormal changes.At present,the existing monitoring and early warning system mainly uses a few monitoring indicators such as groundwater level,water influx,and temperature,and performs water inrush early warning through the abnormal change of a single factor.However,there are relatively few multi-factor comprehensive early warning identification models.Based on the analysis of the abnormal changes of precursor factors in multiple water inrush cases,11 measurable and effective indicators including groundwater flow field,hydrochemical field and temperature field are proposed.Finally,taking Hengyuan coal mine as an example,6 indicators with long-term monitoring data sequences were selected to establish a single-index hierarchical early-warning recognition model,a multi-factor linear recognition model,and a comprehensive intelligent early-warning recognition model.The results show that the correct rate of early warning can reach 95.2%.

Dynamic Hand Gesture Recognition Using 3D-CNN and LSTM Networks

Recognition of dynamic hand gestures in real-time is a difficult task because the system can never know when or from where the gesture starts and ends in a video stream.Many researchers have been working on visionbased gesture recognition due to its various applications.This paper proposes a deep learning architecture based on the combination of a 3D Convolutional Neural Network(3D-CNN)and a Long Short-Term Memory(LSTM)network.The proposed architecture extracts spatial-temporal information from video sequences input while avoiding extensive computation.The 3D-CNN is used for the extraction of spectral and spatial features which are then given to the LSTM network through which classification is carried out.The proposed model is a light-weight architecture with only 3.7 million training parameters.The model has been evaluated on 15 classes from the 20BN-jester dataset available publicly.The model was trained on 2000 video-clips per class which were separated into 80%training and 20%validation sets.An accuracy of 99%and 97%was achieved on training and testing data,respectively.We further show that the combination of 3D-CNN with LSTM gives superior results as compared to MobileNetv2+LSTM.

Transformer-like model with linear attention for speech emotion recognition

Because of the excellent performance of Transformer in sequence learning tasks,such as natural language processing,an improved Transformer-like model is proposed that is suitable for speech emotion recognition tasks.To alleviate the prohibitive time consumption and memory footprint caused by softmax inside the multihead attention unit in Transformer,a new linear self-attention algorithm is proposed.The original exponential function is replaced by a Taylor series expansion formula.On the basis of the associative property of matrix products,the time and space complexity of softmax operation regarding the input's length is reduced from O(N2)to O(N),where N is the sequence length.Experimental results on the emotional corpora of two languages show that the proposed linear attention algorithm can achieve similar performance to the original scaled dot product attention,while the training time and memory cost are reduced by half.Furthermore,the improved model obtains more robust performance on speech emotion recognition compared with the original Transformer.

Performance Comparison of DCT and VQ Based Techniques for Iris Recognition

Iris recognition enjoys universality, high degree of uniqueness and moderate user co-operation. This makes iris recognition systems unavoidable in emerging security ＆ authentication mechanisms. An iris recognition system based on vector quantization （VQ） techniques is proposed and its performance is compared with the discrete cosine transform （DCT）. The proposed system does not need any pre-processing and segmentation of the iris. We have tested Linde-Buzo- Gray （LBG）, Kekre＇s proportionate error （KPE） algorithm and Kekre＇s fast codebook generation （KFCG） algorithm for the clustering purpose. Proposed vector quantization based method using KFCG requires 99.99% less computations as that of full 2-dimensional DCT. Further, the KFCG method gives better performance with the accuracy of 89.10% outperforming DCT that gives accuracy around 66.10%.

New method for recognition of circular traffic sign based on radial symmetry and pseudo-zernike moments

Recognizing various traffic signs,especially the popular circular traffic signs,is an essential task for implementing advanced driver assistance system.To recognize circular traffic signs with high accuracy and robustness,a novel approach which uses the so-called improved constrained binary fast radial symmetry（ICBFRS） detector and pseudo-zernike moments based support vector machine（PZM-SVM） classifier is proposed.In the detection stage,the scene image containing the traffic signs will be converted into Lab color space for color segmentation.Then the ICBFRS detector can efficiently capture the position and scale of sign candidates within the scene by detecting the centers of circles.In the classification stage,once the candidates are cropped out of the image,pseudo-zernike moments are adopted to represent the features of extracted pictogram,which are then fed into a support vector machine to classify different traffic signs.Experimental results under different lighting conditions indicate that the proposed method has robust detection effect and high classification accuracy.

Real-Time Multimodal Biometric Authentication of Human Using Face Feature Analysis

As multimedia data sharing increases,data security in mobile devices and its mechanism can be seen as critical.Biometrics combines the physiological and behavioral qualities of an individual to validate their character in real-time.Humans incorporate physiological attributes like a fingerprint,face,iris,palm print,finger knuckle print,Deoxyribonucleic Acid(DNA),and behavioral qualities like walk,voice,mark,or keystroke.The main goal of this paper is to design a robust framework for automatic face recognition.Scale Invariant Feature Transform(SIFT)and Speeded-up Robust Features(SURF)are employed for face recognition.Also,we propose a modified Gabor Wavelet Transform for SIFT/SURF(GWT-SIFT/GWT-SURF)to increase the recognition accuracy of human faces.The proposed scheme is composed of three steps.First,the entropy of the image is removed using Discrete Wavelet Transform(DWT).Second,the computational complexity of the SIFT/SURF is reduced.Third,the accuracy is increased for authentication by the proposed GWT-SIFT/GWT-SURF algorithm.A comparative analysis of the proposed scheme is done on real-time Olivetti Research Laboratory(ORL)and Poznan University of Technology(PUT)databases.When compared to the traditional SIFT/SURF methods,we verify that the GWT-SIFT achieves the better accuracy of 99.32%and the better approach is the GWT-SURF as the run time of the GWT-SURF for 100 images is 3.4 seconds when compared to the GWT-SIFT which has a run time of 4.9 seconds for 100 images.

YOLOv5-Based Seabed Sediment Recognition Method for Side-Scan Sonar Imagery

Seabed sediment recognition is vital for the exploitation of marine resources.Side-scan sonar(SSS)is an excellent tool for acquiring the imagery of seafloor topography.Combined with ocean surface sampling,it provides detailed and accurate images of marine substrate features.Most of the processing of SSS imagery works around limited sampling stations and requires manual interpretation to complete the classification of seabed sediment imagery.In complex sea areas,with manual interpretation,small targets are often lost due to a large amount of information.To date,studies related to the automatic recognition of seabed sediments are still few.This paper proposes a seabed sediment recognition method based on You Only Look Once version 5 and SSS imagery to perform real-time sedi-ment classification and localization for accuracy,particularly on small targets and faster speeds.We used methods such as changing the dataset size,epoch,and optimizer and adding multiscale training to overcome the challenges of having a small sample and a low accuracy.With these methods,we improved the results on mean average precision by 8.98%and F1 score by 11.12%compared with the original method.In addition,the detection speed was approximately 100 frames per second,which is faster than that of previous methods.This speed enabled us to achieve real-time seabed sediment recognition from SSS imagery.

Real-time tracking of deformable objects based on MOK algorithm

The traditional oriented FAST and rotated BRIEF（ORB） algorithm has problems of instability and repetition of keypoints and it does not possess scale invariance. In order to deal with these drawbacks, a modified ORB（MORB） algorithm is proposed. In order to improve the precision of matching and tracking, this paper puts forward an MOK algorithm that fuses MORB and Kanade-Lucas-Tomasi（KLT）. By using Kalman, the object＇s state in the next frame is predicted in order to reduce the size of search window and improve the real-time performance of object tracking. The experimental results show that the MOK algorithm can accurately track objects with deformation or with background clutters, exhibiting higher robustness and accuracy on diverse datasets. Also, the MOK algorithm has a good real-time performance with the average frame rate reaching 90.8 fps.

基于CA-FasterR-CNN的甲骨文原始拓片单字分割方法

甲骨文拓片经过长时间的埋藏和侵蚀,变得形态复杂,字体模糊,单字之间缺乏明确的分隔,这给甲骨文识别带来了极大的困难。基于此,本文提出了一种基于坐标注意力机制的快速区域卷积神经网络(Coordinate Attention Mechanism-based Faster Region Convolutional Neural Network,CA-Faster R-CNN)模型以实现对甲骨文拓片图像中的单字分割。通过坐标通道注意力机制的引入,模型能够更加关注甲骨文字形特征,从而提升了对甲骨文图像细节的捕捉能力,最后训练结果框线与标准框线基本重合,证明模型分割效果良好。

结合尺度空间FAST角点检测器和SURF描绘器的图像特征

为了获得能够很好地应用于远距离目标识别且计算快速的图像特征,本文提出了一种结合尺度空间FAST(加速分割试验特征)角点检测器和SURF(加速鲁棒特征)描绘器的新特征算法。SURF算法利用了基于快速海森矩阵的关键点检测算法,容易从图像中快速海森矩阵响应值较高但信息匮乏的边缘区域提取大量关键点,进而导致大量的低独特性特征以及不可忽视的误匹配率;同时,其高斯滤波带来的图像模糊使得算法在远距离目标区域内检测到的关键点数量减少,从而对远距离目标的识别造成困难。针对SURF算法的这些问题,本文方法利用尺度空间FAST算法代替快速海森矩阵,并利用具有良好的独特性的SURF描绘器。该方法能够有效地减少对上述类型的干扰性关键点的提取,对远距离目标的关键点检测的性能相对于快速海森矩阵具有显著优势,且其独特性优于同样使用FAST角点检测器的BRISK特征。实验结果表明,对于带有光照变化、尺度变化和3D视角变化目标,基于本文特征的识别算法的识别正确率高于基于SIFT、SURF和BRISK特征的识别算法;本文特征适用于远程目标识别,同时其计算速度达到了与SURF接近的水平。

基于Fast ICA算法的2种储粮害虫活动声信号识别

利用快速独立分量分析(fast independent component analysis,Fast ICA)算法,对混有高斯噪声的2种储粮害虫玉米象Sitophilus zeamais和赤拟谷盗Tribolium castaneum的活动声信号进行去噪,并使用Fast ICA算法识别和分离了2种储粮害虫爬行与翻身的4种活动声信号,证明了使用Fast ICA算法识别混合信号中每种害虫声信号的有效性和准确性。

基于Fast ICA的多说话人识别系统

针对多人混合语音条件下说话人身份难以识别的问题,提出了一种使用快速独立分量分析(Fast ICA)方法分离各个说话人的语音信号,并采用RBF神经网络方法进行说话人识别的策略.由于不同语音源信号保持相对独立,利用盲信号分离的思想,使用Fast ICA方法用于信号的分离,从而对获得的独立语音数据分别提取说话人特征,采用RBF神经网络模型实现多说话人身份的识别.实验结果表明,该方法能有效地实现混合语音条件下的说话人识别.

DWT和Fast PCA与SVM在人脸识别技术中的应用

采用结合小波变换和改进的Fast PCA算法进行特征提取。人脸识别算法在特征提取阶段,采用离散小波分解和快速主成分分析法相结合的算法进行特征提取;在分类阶段,采用基于改进的二叉树算法的支持向量机进行分类。最后给出人脸识别系统的系统原型。通过在MATLAB 7.10.0(R2010a)软件上对ORL人脸库进行仿真训练测试,验证了本系统算法不仅在识别率上有所提高,而且相对于其他算法具有较快的识别速度。

结合Gabor变换和FastICA的人脸表情识别方法

提出了一种结合Gabor变换和FastICA技术的人脸表情特征提取方法。Gabor小波具有很好的空频局部性和多方向选择性,因此更有利于表情细节信息的提取。FastICA技术能够消除信号间的高阶统计冗余。对图像进行Gabor变换,把得到的系数排列成Gabor特征矢量,用FastICA对Gabor特征矢量进行特征提取,用K-近邻分类器进行分类。JAFFE表情库中的实验证明该方法的有效性。

基于fast PCA和K-CV优化SVM的人脸识别算法研究

为了解决支持向量机(Support Vector Machine,SVM)分类器人脸识别率不高的问题,提出了一种快速主成分分析法(fast Principal Component Analysis,fast PCA)与优化参数支持向量机分类器相结合的人脸识别算法.首先,在传统的PCA算法理论基础上提出一种快速PCA算法,用于人脸图像的降维和特征提取,减少特征提取时间,降低计算量,缩短SVM识别时间;其次,利用K折交叉验证法(K-fold cross-validation method,K-CV)联合改进的网格搜索法对SVM分类器最优参数进行搜索,减少最优参数搜索时间,提高算法人脸识别率和泛化能力.在ORL人脸库实验结果表明:该算法在每类训练样本数大于5时,人脸识别率为100%;在训练样本较少时,仍然保持较高识别率.与一般的SVM算法及PCA算法比较,该算法平均识别率提高了0.61%~8.92%.

Molecular cloning and mRNA expression analysis of myosin heavy chain(MyHC)from fast skeletal muscle of grass carp,Ctenopharyngodon idella

The myosin heavy chain(MyHC)is one of the major structural and contracting proteins of muscle.We have isolated the cDNA clone encoding MyHC of the grass carp,Ctenopharyngodon idella. The sequence comprises 5 934 bp,including a 5 814 bp open reading frame encoding an amino acid sequence of 1 937 residues.The deduced amino acid sequence showed 69%homology to rabbit fast skeletal MyHC and 73%–76%homology to the MyHCs from the mandarin fish,walleye pollack,white croaker,chum salmon,and carp.The putative sequences of subfragment-1 and the light meromyosin region showed 61.4%–80%homology to the corresponding regions of other fish MyHCs.The tissue-specific and developmental stage-specific expressions of the MyHC gene were analyzed by quantitative real-time PCR.The MyHC gene showed the highest expression in the muscles compared with the kidney,spleen and intestine.Developmentally,there was a gradual increase in MyHC mRNA expression from the neural formation stage to the tail bud stage.The highest expression was detected in hatching larva.Our work on the MyHC gene from the grass carp has provided useful information for fish molecular biology and fish genomics.