Tongue image segmentation and tongue color classification based on deep learning

Objective To propose two novel methods based on deep learning for computer-aided tongue diagnosis,including tongue image segmentation and tongue color classification,improving their diagnostic accuracy.Methods LabelMe was used to label the tongue mask and Snake model to optimize the labeling results.A new dataset was constructed for tongue image segmentation.Tongue color was marked to build a classified dataset for network training.In this research,the Inception+Atrous Spatial Pyramid Pooling(ASPP)+UNet(IAUNet)method was proposed for tongue image segmentation,based on the existing UNet,Inception,and atrous convolution.Moreover,the Tongue Color Classification Net(TCCNet)was constructed with reference to ResNet,Inception,and Triple-Loss.Several important measurement indexes were selected to evaluate and compare the effects of the novel and existing methods for tongue segmentation and tongue color classification.IAUNet was compared with existing mainstream methods such as UNet and DeepLabV3+for tongue segmentation.TCCNet for tongue color classification was compared with VGG16 and GoogLeNet.Results IAUNet can accurately segment the tongue from original images.The results showed that the Mean Intersection over Union(MIoU)of IAUNet reached 96.30%,and its Mean Pixel Accuracy(MPA),mean Average Precision(mAP),F1-Score,G-Score,and Area Under Curve(AUC)reached 97.86%,99.18%,96.71%,96.82%,and 99.71%,respectively,suggesting IAUNet produced better segmentation than other methods,with fewer parameters.Triplet-Loss was applied in the proposed TCCNet to separate different embedded colors.The experiment yielded ideal results,with F1-Score and mAP of the TCCNet reached 88.86% and 93.49%,respectively.Conclusion IAUNet based on deep learning for tongue segmentation is better than traditional ones.IAUNet can not only produce ideal tongue segmentation,but have better effects than those of PSPNet,SegNet,UNet,and DeepLabV3+,the traditional networks.As for tongue color classification,the proposed network,TCCNet,had better F1-Score and mAP values as compared with other neural networks such as VGG16 and GoogLeNet.

Performance evaluation of wavelet scattering network in image texture classification in various color spaces

The optimized color space is searched by using the wavelet scattering network in the KTH_TIPS_COL color image database for image texture classification. The effect of choosing the color space on the classification accuracy is investigated by converting red green blue （RGB） color space to various other color spaces. The results show that the classification performance generally changes to a large degree when performing color texture classification in various color spaces, and the opponent RGB-based wavelet scattering network outperforms other color spaces-based wavelet scattering networks. Considering that color spaces can be changed into each other, therefore, when dealing with the problem of color texture classification, converting other color spaces to the opponent RGB color space is recommended before performing the wavelet scattering network.

An Automated Player Detection and Tracking in Basketball Game

Vision-based player recognition is critical in sports applications.Accuracy,efficiency,and Low memory utilization is alluring for ongoing errands,for example,astute communicates and occasion classification.We developed an algorithm that tracks the movements of different players from a video of a basketball game.With their position tracked,we then proceed to map the position of these players onto an image of a basketball court.The purpose of tracking player is to provide the maximum amount of information to basketball coaches and organizations,so that they can better design mechanisms of defence and attack.Overall,our model has a high degree of identification and tracking of the players in the court.We directed investigations on soccer,basketball,ice hockey and pedestrian datasets.The trial comes about an exhibit that our technique can precisely recognize players under testing conditions.Contrasted and CNNs that are adjusted from general question identification systems,for example,Faster-RCNN,our approach accomplishes cutting edge exactness on three sorts of recreations(basketball,soccer and ice hockey)with 1000×fewer parameters.The all-inclusive statement of our technique is additionally shown on a standard passer-by recognition dataset in which our strategy accomplishes aggressive execution contrasted and cutting-edge methods.

Real-time grain breakage sensing for rice combine harvesters using machine vision technology

Breakage rate is one of the most important indicators to evaluate the harvesting performance of a combine harvester.It is affected by operating parameters of a combine such as feeding rate,the peripheral speed of the threshing cylinder and concave clearance,and shows complex non-linear law.Real-time acquisition of the breakage rate is an effective way to find the correlation of them.In addition,real-time monitoring of the breakage rate can help the driver optimize and adjust the operating parameters of a combine harvester to avoid the breakage rate exceeding the standard.In this study,a real-time monitoring method for the grain breakage rate of the rice combine harvester based on machine vision was proposed.The structure of the sampling device was designed to obtain rice kernel images of high quality in the harvesting process.According to the working characteristics of the combine,the illumination and installation of the light source were optimized,and the lateral lighting system was constructed.A two-step method of“color training-verification”was applied to identify the whole and broken kernels.In the first step,the local threshold algorithm was used to get the edge of kernel particles in a few training images with binary transformation,extract the color spectrum of each particle in color-space HSL and output the recognition model file.The second step was to verify the recognition accuracy and the breakage rate monitoring accuracy through grabbing and processing images in the laboratory.The experiments of about 2300 particles showed that the recognition accuracy of 96%was attained,and the monitoring values of breakage rate and the true artificial monitoring values had good trend consistency.The monitoring device of grain breakage rate based on machine vision can provide technical supports for the intellectualization of combine harvester.