The performance of medical image classification has been enhanced by deep convolutional neural networks(CNNs),which are typically trained with cross-entropy(CE)loss.However,when the label presents an intrinsic ordinal...The performance of medical image classification has been enhanced by deep convolutional neural networks(CNNs),which are typically trained with cross-entropy(CE)loss.However,when the label presents an intrinsic ordinal property in nature,e.g.,the development from benign to malignant tumor,CE loss cannot take into account such ordinal information to allow for better generalization.To improve model generalization with ordinal information,we propose a novel meta ordinal regression forest(MORF)method for medical image classification with ordinal labels,which learns the ordinal relationship through the combination of convolutional neural network and differential forest in a meta-learning framework.The merits of the proposed MORF come from the following two components:A tree-wise weighting net(TWW-Net)and a grouped feature selection(GFS)module.First,the TWW-Net assigns each tree in the forest with a specific weight that is mapped from the classification loss of the corresponding tree.Hence,all the trees possess varying weights,which is helpful for alleviating the tree-wise prediction variance.Second,the GFS module enables a dynamic forest rather than a fixed one that was previously used,allowing for random feature perturbation.During training,we alternatively optimize the parameters of the CNN backbone and TWW-Net in the meta-learning framework through calculating the Hessian matrix.Experimental results on two medical image classification datasets with ordinal labels,i.e.,LIDC-IDRI and Breast Ultrasound datasets,demonstrate the superior performances of our MORF method over existing state-of-the-art methods.展开更多
The phenomenon of spontaneous particle percolation under gravity is investigated by means of the discrete element method. Percolation behaviors such as percolation velocity, residence time distribution and radial disp...The phenomenon of spontaneous particle percolation under gravity is investigated by means of the discrete element method. Percolation behaviors such as percolation velocity, residence time distribution and radial dispersion are examined under various conditions. It is shown that the vertical velocity of a percolating particle moving down through a packing of larger particles decreases with increasing the restitution coefficient between particles and diameter ratio of the percolating to packing particles. With the increase of the restitution coefficient, the residence time and radial dispersion of the percolating particles increase. The packing height affects the residence time and radial dispersion. But, the effect can be eliminated in the analysis of the residence time and radial dispersion when they are normalized by the average residence time and the product of the packing height and packing particle diameter, respectively. In addition, the percolation velocity is shown to be related to the vertical acceleration of the percolating particle when an extra constant vertical force is applied. Increasing the feeding rate of percolating particles decreases the dispersion coefficient.展开更多
基金This work was supported in part by the Natural Science Foundation of Shanghai(21ZR1403600)the National Natural Science Foundation of China(62176059)+3 种基金Shanghai Municipal Science and Technology Major Project(2018SHZDZX01)Zhang Jiang Laboratory,Shanghai Sailing Program(21YF1402800)Shanghai Municipal of Science and Technology Project(20JC1419500)Shanghai Center for Brain Science and Brain-inspired Technology.
文摘The performance of medical image classification has been enhanced by deep convolutional neural networks(CNNs),which are typically trained with cross-entropy(CE)loss.However,when the label presents an intrinsic ordinal property in nature,e.g.,the development from benign to malignant tumor,CE loss cannot take into account such ordinal information to allow for better generalization.To improve model generalization with ordinal information,we propose a novel meta ordinal regression forest(MORF)method for medical image classification with ordinal labels,which learns the ordinal relationship through the combination of convolutional neural network and differential forest in a meta-learning framework.The merits of the proposed MORF come from the following two components:A tree-wise weighting net(TWW-Net)and a grouped feature selection(GFS)module.First,the TWW-Net assigns each tree in the forest with a specific weight that is mapped from the classification loss of the corresponding tree.Hence,all the trees possess varying weights,which is helpful for alleviating the tree-wise prediction variance.Second,the GFS module enables a dynamic forest rather than a fixed one that was previously used,allowing for random feature perturbation.During training,we alternatively optimize the parameters of the CNN backbone and TWW-Net in the meta-learning framework through calculating the Hessian matrix.Experimental results on two medical image classification datasets with ordinal labels,i.e.,LIDC-IDRI and Breast Ultrasound datasets,demonstrate the superior performances of our MORF method over existing state-of-the-art methods.
文摘The phenomenon of spontaneous particle percolation under gravity is investigated by means of the discrete element method. Percolation behaviors such as percolation velocity, residence time distribution and radial dispersion are examined under various conditions. It is shown that the vertical velocity of a percolating particle moving down through a packing of larger particles decreases with increasing the restitution coefficient between particles and diameter ratio of the percolating to packing particles. With the increase of the restitution coefficient, the residence time and radial dispersion of the percolating particles increase. The packing height affects the residence time and radial dispersion. But, the effect can be eliminated in the analysis of the residence time and radial dispersion when they are normalized by the average residence time and the product of the packing height and packing particle diameter, respectively. In addition, the percolation velocity is shown to be related to the vertical acceleration of the percolating particle when an extra constant vertical force is applied. Increasing the feeding rate of percolating particles decreases the dispersion coefficient.