基于Deep Forest算法的对虾急性肝胰腺坏死病(AHPND)预警数学模型构建

为预报池塘养殖凡纳对虾(Penaeus vannamei)急性肝胰腺坏死病(AHPND)的发生,自2020年开始,笔者对凡纳对虾养殖区开展了连续监测工作,包括与疾病发生相关的环境理化因子、微生物因子、虾体自身健康状况等18个候选预警因子指标,通过数据标准化处理后分析病原、宿主与环境之间的相关性,对候选预警因子进行筛选,基于Python语言编程结合Deep Forest、Light GBM、XGBoost算法进行数据建模和预测性能评判,仿真环境为Python2.7,以预警因子指标作为输入样本(即警兆),以对虾是否发病指标作为输出结果(即警情),根据输入样本和输出结果各自建立输入数据矩阵和目标数据矩阵,利用原始数据矩阵对输入样本进行初始化,结合函数方程进行拟合,拟合的源代码能利用已知环境、病原及对虾免疫指标数据对目标警情进行预测。最终建立了基于Deep Forest算法的虾体(肝胰腺内)细菌总数、虾体弧菌(Vibrio)占比、水体细菌总数和盐度的4维向量预警预报模型,准确率达89.00%。本研究将人工智能算法应用到对虾AHPND发生的预测预报,相关研究结果为对虾AHPND疾病预警预报建立了预警数学模型,并为对虾健康养殖和疾病防控提供了技术支撑和有力保障。

Fracture identification of carbonate reservoirs by deep forest model:An example from the D oilfield in Zagros Basin

Identifying fractures along a well trajectory is of immense significance in determining the subsurface fracture network distribution.Typically,conventional logs exhibit responses in fracture zones,and almost all wells have such logs.However,detecting fractures through logging responses can be challenging since the log response intensity is weak and complex.To address this problem,we propose a deep learning model for fracture identification using deep forest,which is based on a cascade structure comprising multi-layer random forests.Deep forest can extract complex nonlinear features of fractures in conventional logs through ensemble learning and deep learning.The proposed approach is tested using a dataset from the Oligocene to Miocene tight carbonate reservoirs in D oilfield,Zagros Basin,Middle East,and eight logs are selected to construct the fracture identification model based on sensitivity analysis of logging curves against fractures.The log package includes the gamma-ray,caliper,density,compensated neutron,acoustic transit time,and shallow,deep,and flushed zone resistivity logs.Experiments have shown that the deep forest obtains high recall and accuracy(>92%).In a blind well test,results from the deep forest learning model have a good correlation with fracture observation from cores.Compared to the random forest method,a widely used ensemble learning method,the proposed deep forest model improves accuracy by approximately 4.6%.

User Purchase Intention Prediction Based on Improved Deep Forest

Widely used deep neural networks currently face limitations in achieving optimal performance for purchase intention prediction due to constraints on data volume and hyperparameter selection.To address this issue,based on the deep forest algorithm and further integrating evolutionary ensemble learning methods,this paper proposes a novel Deep Adaptive Evolutionary Ensemble(DAEE)model.This model introduces model diversity into the cascade layer,allowing it to adaptively adjust its structure to accommodate complex and evolving purchasing behavior patterns.Moreover,this paper optimizes the methods of obtaining feature vectors,enhancement vectors,and prediction results within the deep forest algorithm to enhance the model’s predictive accuracy.Results demonstrate that the improved deep forest model not only possesses higher robustness but also shows an increase of 5.02%in AUC value compared to the baseline model.Furthermore,its training runtime speed is 6 times faster than that of deep models,and compared to other improved models,its accuracy has been enhanced by 0.9%.

面向ICS的CGAN-DEEPFOREST入侵检测

随着工业化与信息化的深度融合,工业控制系统(ICS)的安全问题广受关注,ICS领域出现了许多入侵检测模型.但是,现存模型存在局限性,无法同时解决数据不平衡、分类时间长、小样本检测率低和准确率低的问题.因此,本文提出CGAN-DeepForest入侵检测模型解决上述问题.首先,采用改进的条件生成对抗网络(CGAN)定向扩充数据来改善数据的不平衡性.其次,采用随机森林对平衡后的数据集进行特征提取,降低分类模型训练时间和分类时间.再次,采用深度森林(DeepForest)进行分类,提高小样本检测率和整体准确率,输出分类结果.最后,使用数据集Gas验证模型效果.实验结果表明,本文模型与简单深度森林模型相比准确率整体提升3%,小样本数据NMRI、MFCI、Dos的查全率、查准率、F1分别提高至95%、84%、90%;与随机森林模型相比,准确率整体提高6%,小样本NMRI的查全率提升23%;与深度卷积神经网络相比,准确率接近94%时,模型训练时间和分类时间提高约50%.

Deep Forest-Based Fall Detection in Internet of Medical Things Environment

This article introduces a new medical internet of things(IoT)framework for intelligent fall detection system of senior people based on our proposed deep forest model.The cascade multi-layer structure of deep forest classifier allows to generate new features at each level with minimal hyperparameters compared to deep neural networks.Moreover,the optimal number of the deep forest layers is automatically estimated based on the early stopping criteria of validation accuracy value at each generated layer.The suggested forest classifier was successfully tested and evaluated using a public SmartFall dataset,which is acquired from three-axis accelerometer in a smartwatch.It includes 92781 training samples and 91025 testing samples with two labeled classes,namely non-fall and fall.Classification results of our deep forest classifier demonstrated a superior performance with the best accuracy score of 98.0%compared to three machine learning models,i.e.,K-nearest neighbors,decision trees and traditional random forest,and two deep learning models,which are dense neural networks and convolutional neural networks.By considering security and privacy aspects in the future work,our proposed medical IoT framework for fall detection of old people is valid for real-time healthcare application deployment.

Prediction of tree crown width in natural mixed forests using deep learning algorithm

Crown width(CW)is one of the most important tree metrics,but obtaining CW data is laborious and timeconsuming,particularly in natural forests.The Deep Learning(DL)algorithm has been proposed as an alternative to traditional regression,but its performance in predicting CW in natural mixed forests is unclear.The aims of this study were to develop DL models for predicting tree CW of natural spruce-fir-broadleaf mixed forests in northeastern China,to analyse the contribution of tree size,tree species,site quality,stand structure,and competition to tree CW prediction,and to compare DL models with nonlinear mixed effects(NLME)models for their reliability.An amount of total 10,086 individual trees in 192 subplots were employed in this study.The results indicated that all deep neural network(DNN)models were free of overfitting and statistically stable within 10-fold cross-validation,and the best DNN model could explain 69%of the CW variation with no significant heteroskedasticity.In addition to diameter at breast height,stand structure,tree species,and competition showed significant effects on CW.The NLME model(R^(2)=0.63)outperformed the DNN model(R^(2)=0.54)in predicting CW when the six input variables were consistent,but the results were the opposite when the DNN model(R^(2)=0.69)included all 22 input variables.These results demonstrated the great potential of DL in tree CW prediction.

Assessment of China’s forest fi re occurrence with deep learning, geographic information and multisource data

Considerable economic losses and ecological damage can be caused by forest fi res,and compared to suppression,prevention is a much smarter strategy.Accordingly,this study focuses on developing a novel framework to assess forest fi re risks and policy decisions on forest fi re management in China.This framework integrated deep learning algorithms,geographic information,and multisource data.Compared to conventional approaches,our framework featured timesaving,easy implementation,and importantly,the use of deep learning that vividly integrates various factors from the environment and human activities.Information on 96,594 forest fi re points from 2001 to 2019 was collected on Moderate Resolution Imaging Spectroradiometer(MODIS)fi re hotspots from 2001 to 2019 from NASA’s Fire Information Resource Management System.The information was classifi ed into factors such as topography,climate,vegetation,and society.The prediction of forest fi re risk was generated using a fully connected network model,and spatial autocorrelation used to analyze the spatial aggregation correlation of active fi re hotspots in the whole area of China.The results show that high accuracy prediction of fi re risks was achieved(accuracy 87.4%,positive predictive value 87.1%,sensitivity 88.9%,area under curve(AUC)94.1%).Based on this,it was found that Chinese forest fi re risk shows signifi cant autocorrelation and agglomeration both in seasons and regions.For example,forest fi re risk usually raises dramatically in spring and winter,and decreases in autumn and summer.Compared to the national average,Yunnan Province,Guangdong Province,and the Greater Hinggan Mountains region of Heilongjiang Province have higher fi re risks.In contrast,a large region in central China has been recognized as having a long-term,low risk of forest fi res.All forest risks in each region were recorded into the database and could contribute to the forest fi re prevention.The successful assessment of forest fi re risks in this study provides a comprehensive knowledge of fi re risks in China over the last 20 years.Deep learning showed its advantage in integrating multiple factors in predicting forest fi re risks.This technical framework is expected to be a feasible evaluation tool for the occurrence of forest fi res in China.

Dark-Forest:Analysis on the Behavior of Dark Web Traffic via DeepForest and PSO Algorithm

The dark web is a shadow area hidden in the depths of the Internet,which is difficult to access through common search engines.Because of its anonymity,the dark web has gradually become a hotbed for a variety of cyber-crimes.Although some research based on machine learning or deep learning has been shown to be effective in the task of analyzing dark web traffic in recent years,there are still pain points such as low accuracy,insufficient real-time performance,and limited application scenarios.Aiming at the difficulties faced by the existing automated dark web traffic analysis methods,a novel method named Dark-Forest to analyze the behavior of dark web traffic is proposed.In this method,firstly,particle swarm optimization algorithm is used to filter the redundant features of dark web traffic data,which can effectively shorten the training and inference time of the model to meet the realtime requirements of dark web detection task.Then,the selected features of traffic are analyzed and classified using the DeepForest model as a backbone classifier.The comparison experiment with the current mainstream methods shows that Dark-Forest takes into account the advantages of statistical machine learning and deep learning,and achieves an accuracy rate of 87.84%.This method not only outperforms baseline methods such as Random Forest,MLP,CNN,and the original DeepForest in both large-scale and small-scale dataset based learning tasks,but also can detect normal network traffic,tunnel network traffic and anonymous network traffic,which may close the gap between different network traffic analysis tasks.Thus,it has a wider application scenario and higher practical value.

Intelligent Deep Learning Enabled Wild Forest Fire Detection System

The latest advancements in computer vision and deep learning(DL)techniques pave the way to design novel tools for the detection and monitoring of forestfires.In this view,this paper presents an intelligent wild forestfire detec-tion and alarming system using deep learning(IWFFDA-DL)model.The pro-posed IWFFDA-DL technique aims to identify forestfires at earlier stages through integrated sensors.The proposed IWFFDA-DL system includes an Inte-grated sensor system(ISS)combining an array of sensors that acts as the major input source that helps to forecast thefire.Then,the attention based convolution neural network with bidirectional long short term memory(ACNN-BLSTM)model is applied to examine and identify the existence of danger.For hyperpara-meter tuning of the ACNN-BLSTM model,the bacterial foraging optimization(BFO)algorithm is employed and thereby enhances the detection performance.Finally,when thefire is detected,the Global System for Mobiles(GSM)modem transmits messages to the authorities to take required actions.An extensive set of simulations were performed and the results are investigated interms of several aspects.The obtained results highlight the betterment of the IWFFDA-DL techni-que interms of various measures.

Fusion-Based Deep Learning Model for Automated Forest Fire Detection

Earth resource and environmental monitoring are essential areas that can be used to investigate the environmental conditions and natural resources supporting sustainable policy development,regulatory measures,and their implementation elevating the environment.Large-scale forest fire is considered a major harmful hazard that affects climate change and life over the globe.Therefore,the early identification of forest fires using automated tools is essential to avoid the spread of fire to a large extent.Therefore,this paper focuses on the design of automated forest fire detection using a fusion-based deep learning(AFFD-FDL)model for environmental monitoring.The AFFDFDL technique involves the design of an entropy-based fusion model for feature extraction.The combination of the handcrafted features using histogram of gradients(HOG)with deep features using SqueezeNet and Inception v3 models.Besides,an optimal extreme learning machine(ELM)based classifier is used to identify the existence of fire or not.In order to properly tune the parameters of the ELM model,the oppositional glowworm swarm optimization(OGSO)algorithm is employed and thereby improves the forest fire detection performance.A wide range of simulation analyses takes place on a benchmark dataset and the results are inspected under several aspects.The experimental results highlighted the betterment of the AFFD-FDL technique over the recent state of art techniques.

Deep-Ensemble Learning Method for Solar Resource Assessment of Complex Terrain Landscapes

As the global demand for renewable energy grows,solar energy is gaining attention as a clean,sustainable energy source.Accurate assessment of solar energy resources is crucial for the siting and design of photovoltaic power plants.This study proposes an integrated deep learning-based photovoltaic resource assessment method.Ensemble learning and deep learning methods are fused for photovoltaic resource assessment for the first time.The proposed method combines the random forest,gated recurrent unit,and long short-term memory to effectively improve the accuracy and reliability of photovoltaic resource assessment.The proposed method has strong adaptability and high accuracy even in the photovoltaic resource assessment of complex terrain and landscape.The experimental results show that the proposed method outperforms the comparison algorithm in all evaluation indexes,indicating that the proposed method has higher accuracy and reliability in photovoltaic resource assessment with improved generalization performance traditional single algorithm.

Deep Learning-Based Classification of Rotten Fruits and Identification of Shelf Life

The freshness of fruits is considered to be one of the essential characteristics for consumers in determining their quality,flavor and nutritional value.The primary need for identifying rotten fruits is to ensure that only fresh and high-quality fruits are sold to consumers.The impact of rotten fruits can foster harmful bacteria,molds and other microorganisms that can cause food poisoning and other illnesses to the consumers.The overall purpose of the study is to classify rotten fruits,which can affect the taste,texture,and appearance of other fresh fruits,thereby reducing their shelf life.The agriculture and food industries are increasingly adopting computer vision technology to detect rotten fruits and forecast their shelf life.Hence,this research work mainly focuses on the Convolutional Neural Network’s(CNN)deep learning model,which helps in the classification of rotten fruits.The proposed methodology involves real-time analysis of a dataset of various types of fruits,including apples,bananas,oranges,papayas and guavas.Similarly,machine learningmodels such as GaussianNaïve Bayes(GNB)and random forest are used to predict the fruit’s shelf life.The results obtained from the various pre-trained models for rotten fruit detection are analysed based on an accuracy score to determine the best model.In comparison to other pre-trained models,the visual geometry group16(VGG16)obtained a higher accuracy score of 95%.Likewise,the random forest model delivers a better accuracy score of 88% when compared with GNB in forecasting the fruit’s shelf life.By developing an accurate classification model,only fresh and safe fruits reach consumers,reducing the risks associated with contaminated produce.Thereby,the proposed approach will have a significant impact on the food industry for efficient fruit distribution and also benefit customers to purchase fresh fruits.

一种改进Deep Forest算法在保险购买预测场景中的应用研究

为了实现保险场景的精准营销,同时充分利用千万级客户和保单历史成交记录的数据特点,本文经热门算法研究和统计理论分析,提出一种基于XGBoost改造的Deep Forest级联算法。该算法采用XGBoost浅层机器学习算法作为Deep Forest级联构建块,同时用AUC-PR标准作为级联构建深度学习不平衡样本评价的自适应过程,并将此算法分别与原有XGBoost算法和原始Deep Forest算法进行性能比较。经实践,上述算法应用投产于保险购买预测场景中,分别比原有XGBoost算法和原Deep Forest算法提高5.5%和2.8%,效果显著;同时提出的浅层学习向基于Deep Forest深度优化操作流程,也为其他类似应用场景提供了实践参考方向。

WDBM: Weighted Deep Forest Model Based Bearing Fault Diagnosis Method

In the research field of bearing fault diagnosis,classical deep learning models have the problems of too many parameters and high computing cost.In addition,the classical deep learning models are not effective in the scenario of small data.In recent years,deep forest is proposed,which has less hyper parameters and adaptive depth of deep model.In addition,weighted deep forest(WDF)is proposed to further improve deep forest by assigning weights for decisions trees based on the accuracy of each decision tree.In this paper,weighted deep forest model-based bearing fault diagnosis method(WDBM)is proposed.The WDBM is regard as a novel bearing fault diagnosis method,which not only inherits the WDF’s advantages-strong robustness,good generalization,less parameters,faster convergence speed and so on,but also realizes effective diagnosis with high precision and low cost under the condition of small samples.To verify the performance of the WDBM,experiments are carried out on Case Western Reserve University bearing data set(CWRU).Experiments results demonstrate that WDBM can achieve comparative recognition accuracy,with less computational overhead and faster convergence speed.

Research on trend prediction of component stock in fuzzy time series based on deep forest

With the continuous development of machine learning and the increasing complexity of financial data analysis,it is more popular to use models in the field of machine learning to solve the hot and difficult problems in the financial industry.To improve the effectiveness of stock trend prediction and solve the problems in time series data processing,this paper combines the fuzzy affiliation function with stock-related technical indicators to obtain nominal data that can widely reflect the constituent stocks in the case of time series changes by analysing the S&P 500 index.Meanwhile,in order to optimise the current machine learning algorithm in which the setting and adjustment of hyperparameters rely too much on empirical knowledge,this paper combines the deep forest model to train the stock data separately.The experimental results show that(1)the accuracy of the extreme random forest and the accuracy of the multi-grain cascade forest are both higher than that of the gated recurrent unit(GRU)model when the un-fuzzy index-adjusted dataset is used as features for input,(2)the accuracy of the extreme random forest and the accuracy of the multigranular cascade forest are improved by using the fuzzy index-adjusted dataset as features for input,(3)the accuracy of the fuzzy index-adjusted dataset as features for inputting the extreme random forest is improved by 18.89% compared to that of the un-fuzzy index-adjusted dataset as features for inputting the extreme random forest and(4)the average accuracy of the fuzzy index-adjusted dataset as features for inputting multi-grain cascade forest increased by 5.67%.

Evaluation of deep learning algorithms for landslide susceptibility mapping in an alpine-gorge area:a case study in Jiuzhaigou County

With its high mountains,deep valleys,and complex geological formations,the Jiuzhaigou County has the typical characteristics of a disaster-prone mountainous region in southwestern China.On August 8,2017,a strong Ms 7.0 earthquake occurred in this region,causing some of the mountains in the area to become loose and cracked.Therefore,a survey and evaluation of landslides in this area can help to reveal hazards and take effective measures for subsequent disaster management.However,different evaluation models can yield different spatial distributions of landslide susceptibility,and thus,selecting the appropriate model and performing the optimal combination of parameters is the most effective way to improve susceptibility evaluation.In order to construct an evaluation indicator system suitable for Jiuzhaigou County,we extracted 12 factors affecting the occurrence of landslides,including slope,elevation and slope surface,and made samples.At the core of the transformer model is a self-attentive mechanism that enables any two of the features to be interlinked,after which feature extraction is performed via a forward propagation network(FFN).We exploited its coding structure to transform it into a deep learning model that is more suitable for landslide susceptibility evaluation.The results show that the transformer model has the highest accuracy(86.89%),followed by the random forest and support vector machine models(84.47%and 82.52%,respectively),and the logistic regression model achieves the lowest accuracy(79.61%).Accordingly,this deep learning model provides a new tool to achieve more accurate zonation of landslide susceptibility in Jiuzhaigou County.

Intelligent Traffic Surveillance through Multi-Label Semantic Segmentation and Filter-Based Tracking

Road congestion,air pollution,and accident rates have all increased as a result of rising traffic density andworldwide population growth.Over the past ten years,the total number of automobiles has increased significantly over the world.In this paper,a novel method for intelligent traffic surveillance is presented.The proposed model is based on multilabel semantic segmentation using a random forest classifier which classifies the images into five classes.To improve the results,mean-shift clustering was applied to the segmented images.Afterward,the pixels given the label for the vehicle were extracted and blob detection was applied to mark each vehicle.For the validation of each detection,a vehicle verification method based on the structural similarity index is proposed.The tracking of vehicles across the image frames is done using the Identifier(ID)assignment technique and particle filter.Also,vehicle counting in each frame along with trajectory estimation was done for each object.Our proposed system demonstrated a remarkable vehicle detection rate of 0.83 over Vehicle Aerial Imaging from Drone(VAID),0.86 over AU-AIR,and 0.75 over the Unmanned Aerial Vehicle Benchmark Object Detection and Tracking(UAVDT)dataset during the experimental evaluation.The proposed system can be used for several purposes,such as vehicle identification in traffic,traffic density estimation at intersections,and traffic congestion sensing on a road.

DeepRanger:覆盖制导的深度森林测试方法

深度学习软件的结构特征与传统软件存在明显差异,因此即使展开了大量测试,依然无法有效衡量测试数据对深度学习软件的覆盖情况和测试充分性,并造成后续使用过程中依然可能存在大量未知错误.深度森林是一种新型深度学习模型,其克服了深度神经网络存在的一些缺点,例如:需要大量训练数据、需要高算力平台、需要大量超参数.但目前还没有相关工作对深度森林的测试方法进行研究.针对深度森林的结构特点,制定了一组由随机森林结点覆盖率RFNC、随机森林叶子覆盖率RFLC、级联森林类型覆盖率CFCC和级联森林输出覆盖率CFOC组成的测试覆盖率评价指标.在此基础上,基于遗传算法设计了覆盖制导的测试数据自动生成方法DeepRanger,可自动生成能有效提高模型覆盖率的测试数据集.为对所提出覆盖指标的有效性进行验证,在深度森林开源项目gcForest和MNIST数据集上设计并进行了一组实验.实验结果表明,所提出的4种覆盖指标均能有效评价测试数据集对深度森林模型的测试充分性.此外,与基于随机选择的遗传算法相比,使用覆盖信息制导的测试数据生成方法DeepRanger能达到更高的模型覆盖率.

Deep Development of Forest Eco-tourism in Xishan District of Kunming City in China

By taking forest resource in Xishan District of Kunming City as an example,the principles and objectives of deep development have been analyzed based on forest resources endowment,and finally specific planning contents and basic guarantee measures have been proposed.

Deep learning for predictive mechanical properties of hot-rolled strip in complex manufacturing systems

Higher requirements for the accuracy of relevant models are put throughout the transformation and upgrade of the iron and steel sector to intelligent production.It has been difficult to meet the needs of the field with the usual prediction model of mechanical properties of hotrolled strip.Insufficient data and difficult parameter adjustment limit deep learning models based on multi-layer networks in practical applications;besides,the limited discrete process parameters used make it impossible to effectively depict the actual strip processing process.In order to solve these problems,this research proposed a new sampling approach for mechanical characteristics input data of hot-rolled strip based on the multi-grained cascade forest(gcForest)framework.According to the characteristics of complex process flow and abnormal sensitivity of process path and parameters to product quality in the hot-rolled strip production,a three-dimensional continuous time series process data sampling method based on time-temperature-deformation was designed.The basic information of strip steel(chemical composition and typical process parameters)is fused with the local process information collected by multi-grained scanning,so that the next link’s input has both local and global features.Furthermore,in the multi-grained scanning structure,a sub sampling scheme with a variable window was designed,so that input data with different dimensions can get output characteristics of the same dimension after passing through the multi-grained scanning structure,allowing the cascade forest structure to be trained normally.Finally,actual production data of three steel grades was used to conduct the experimental evaluation.The results revealed that the gcForest-based mechanical property prediction model outperforms the competition in terms of comprehensive performance,ease of parameter adjustment,and ability to sustain high prediction accuracy with fewer samples.