Novel algorithm for constructing support vector machine regression ensemble

A novel algorithm for constructing support vector machine regression ensemble is proposed. As to regression prediction, support vector machine regression （SVMR） ensemble is proposed by resampling from given training data sets repeatedly and aggregating several independent SVMRs, each of which is trained to use a replicated training set. After training, several independently trained SVMRs need to be aggregated in an appropriate combination manner. Generally, the linear weighting is usually used like expert weighting score in Boosting Regression and it is without optimization capacity. Three combination techniques are proposed, including simple arithmetic mean, linear least square error weighting and nonlinear hierarchical combining that uses another upper-layer SVMR to combine several lower-layer SVMRs. Finally, simulation experiments demonstrate the accuracy and validity of the presented algorithm.

Identification of various food residuals on denim based on hyperspectral imaging system and combination optimal strategy

As the science and technology develop,crime methods and scenes have become increasingly complex and diverse.Trace evidence analysis has become amore and more important criminal investigation technology and liquid is the main form of trace evidence.Food can provide not only energy,but clues to solve crimes.In this study,we build a hyperspectral imaging system to detect liquid residue traces,including apple juice,coffee,cola,milk and tea,on denims with light,middle and dark colors.The obtained hyperspectral images are first subjected to spectral calibration and hyperspectral data pretreatment.Subsequently,Partial Least Squares(PLS)is applied to select the informative wavelengths from the preprocessed spectra.For modeling phase,the combination optimal strategy,support vector machine(SVM)combined with random forest(RF),is developed to establish classification models.The experimental results demonstrate that the combination optimal model can achieve TPR,FPR,Precision,Recall,F1,and AUC of 83.5%,2.30%,79.7%,83.5%,81.6%,and 94.7%for classifying fabrics contaminated by various food residuals.With respect to the classification of liquid and fabric types,the combination optimalmodel also yields satisfactory classification performance.In future work,wewill expand the types of liquid,and make appropriate adjustment to algorithms for improving the robustness of classification models.This research may play a positive role in the construction of a harmonious society.