In this editorial,we comment on the article by Wang and Long,published in a recent issue of the World Journal of Clinical Cases.The article addresses the challenge of predicting intensive care unit-acquired weakness(I...In this editorial,we comment on the article by Wang and Long,published in a recent issue of the World Journal of Clinical Cases.The article addresses the challenge of predicting intensive care unit-acquired weakness(ICUAW),a neuromuscular disorder affecting critically ill patients,by employing a novel processing strategy based on repeated machine learning.The editorial presents a dataset comprising clinical,demographic,and laboratory variables from intensive care unit(ICU)patients and employs a multilayer perceptron neural network model to predict ICUAW.The authors also performed a feature importance analysis to identify the most relevant risk factors for ICUAW.This editorial contributes to the growing body of literature on predictive modeling in critical care,offering insights into the potential of machine learning approaches to improve patient outcomes and guide clinical decision-making in the ICU setting.展开更多
点击率(CTR)预测通过预测用户对广告或商品的点击概率,实现数字广告精准推荐。针对现有CTR模型存在原始嵌入向量未精化、特征交互方式偏简单的问题,本文提出自注意力深度域嵌入因子分解机(self-attention deep field-embedded factoriza...点击率(CTR)预测通过预测用户对广告或商品的点击概率,实现数字广告精准推荐。针对现有CTR模型存在原始嵌入向量未精化、特征交互方式偏简单的问题,本文提出自注意力深度域嵌入因子分解机(self-attention deep field-embedded factorization machine,Self-AtDFEFM)模型。首先,通过多头自注意力对原始嵌入向量加权,精化出关键低层特征;其次,构建深度域嵌入因子分解机(FEFM)模块,设计域对对称矩阵以提升不同特征域之间的交互强度,为高阶特征交互优选出低阶特征组合;再次,基于低阶特征组合构建深度神经网络(DNN),完成隐式高阶特征交互;然后,围绕精化后的嵌入向量,联合多头自注意力与残差机制堆叠多个显式高阶特征交互层,通过自注意力捕获同一特征在不同子空间上的互补信息,完成显示高阶特征交互;最后,联合显式与隐式高阶特征交互实现点击率预测。在Criteo和Avazu两大公开数据集上,将Self-AtDFEFM模型与主流基线模型在AUC和LogLoss指标上进行对比实验;为Self-AtDFEFM模型调制显式高阶特征交互层层数、注意力头数量、嵌入层维度及隐式高阶特征交互层层数等参数;对Self-AtDFEFM模型进行消融实验。实验结果表明:在两大数据集上,Self-AtDFEFM模型的AUC、LogLoss均优于主流基线模型;Self-AtDFEFM模型的全部参数已调为最佳;各模块形成合力以促使Self-AtDFEFM模型性能达到最优,其中显示高阶特征交互层的作用最大。Self-AtDFEFM模型各模块即插即用,易于构建和部署,且在性能与复杂度之间取得平衡,具备较高实用性。展开更多
In this editorial,we discuss an article titled,“Significant risk factors for intensive care unit-acquired weakness:A processing strategy based on repeated machine learning,”published in a recent issue of the World J...In this editorial,we discuss an article titled,“Significant risk factors for intensive care unit-acquired weakness:A processing strategy based on repeated machine learning,”published in a recent issue of the World Journal of Clinical Cases.Intensive care unit-acquired weakness(ICU-AW)is a debilitating condition that affects critically ill patients,with significant implications for patient outcomes and their quality of life.This study explored the use of artificial intelligence and machine learning techniques to predict ICU-AW occurrence and identify key risk factors.Data from a cohort of 1063 adult intensive care unit(ICU)patients were analyzed,with a particular emphasis on variables such as duration of ICU stay,duration of mechanical ventilation,doses of sedatives and vasopressors,and underlying comorbidities.A multilayer perceptron neural network model was developed,which exhibited a remarkable impressive prediction accuracy of 86.2%on the training set and 85.5%on the test set.The study highlights the importance of early prediction and intervention in mitigating ICU-AW risk and improving patient outcomes.展开更多
Harmonic analysis, the traditional tidal forecasting method, cannot take into account the impact of noncyclical factors, and is also based on the BP neural network tidal prediction model which is easily limited by the...Harmonic analysis, the traditional tidal forecasting method, cannot take into account the impact of noncyclical factors, and is also based on the BP neural network tidal prediction model which is easily limited by the amount of data. According to the movement of celestial bodies, and considering the insufficient tidal characteristics of historical data which are impacted by the nonperiodic weather, a tidal prediction method is designed based on support vector machine （SVM） to carry out the simulation experiment by using tidal data from Xiamen Tide Gauge, Luchaogang Tide Gauge and Weifang Tide Gauge individually. And the results show that the model satisfactorily carries out the tide prediction which is influenced by noncyclical factors. At the same time, it also proves that the proposed prediction method, which when compared with harmonic analysis method and the BP neural network method, has faster modeling speed, higher prediction precision and stronger generalization ability.展开更多
Factorization machine (FM) is an effective model for feature-based recommendation that utilizes inner products to capture second-order feature interactions. However, one of the major drawbacks of FM is that it cannot ...Factorization machine (FM) is an effective model for feature-based recommendation that utilizes inner products to capture second-order feature interactions. However, one of the major drawbacks of FM is that it cannot capture complex high-order interaction signals. A common solution is to change the interaction function, such as stacking deep neural networks on the top level of FM. In this work, we propose an alternative approach to model high-order interaction signals at the embedding level, namely generalized embedding machine (GEM). The embedding used in GEM encodes not only the information from the feature itself but also the information from other correlated features. Under such a situation, the embedding becomes high-order. Then we can incorporate GEM with FM and even its advanced variants to perform feature interactions. More specifically, in this paper, we utilize graph convolution networks (GCN) to generate high-order embeddings. We integrate GEM with several FM-based models and conduct extensive experiments on two real-world datasets. The results demonstrate significant improvement of GEM over the corresponding baselines.展开更多
文摘In this editorial,we comment on the article by Wang and Long,published in a recent issue of the World Journal of Clinical Cases.The article addresses the challenge of predicting intensive care unit-acquired weakness(ICUAW),a neuromuscular disorder affecting critically ill patients,by employing a novel processing strategy based on repeated machine learning.The editorial presents a dataset comprising clinical,demographic,and laboratory variables from intensive care unit(ICU)patients and employs a multilayer perceptron neural network model to predict ICUAW.The authors also performed a feature importance analysis to identify the most relevant risk factors for ICUAW.This editorial contributes to the growing body of literature on predictive modeling in critical care,offering insights into the potential of machine learning approaches to improve patient outcomes and guide clinical decision-making in the ICU setting.
文摘点击率(CTR)预测通过预测用户对广告或商品的点击概率,实现数字广告精准推荐。针对现有CTR模型存在原始嵌入向量未精化、特征交互方式偏简单的问题,本文提出自注意力深度域嵌入因子分解机(self-attention deep field-embedded factorization machine,Self-AtDFEFM)模型。首先,通过多头自注意力对原始嵌入向量加权,精化出关键低层特征;其次,构建深度域嵌入因子分解机(FEFM)模块,设计域对对称矩阵以提升不同特征域之间的交互强度,为高阶特征交互优选出低阶特征组合;再次,基于低阶特征组合构建深度神经网络(DNN),完成隐式高阶特征交互;然后,围绕精化后的嵌入向量,联合多头自注意力与残差机制堆叠多个显式高阶特征交互层,通过自注意力捕获同一特征在不同子空间上的互补信息,完成显示高阶特征交互;最后,联合显式与隐式高阶特征交互实现点击率预测。在Criteo和Avazu两大公开数据集上,将Self-AtDFEFM模型与主流基线模型在AUC和LogLoss指标上进行对比实验;为Self-AtDFEFM模型调制显式高阶特征交互层层数、注意力头数量、嵌入层维度及隐式高阶特征交互层层数等参数;对Self-AtDFEFM模型进行消融实验。实验结果表明:在两大数据集上,Self-AtDFEFM模型的AUC、LogLoss均优于主流基线模型;Self-AtDFEFM模型的全部参数已调为最佳;各模块形成合力以促使Self-AtDFEFM模型性能达到最优,其中显示高阶特征交互层的作用最大。Self-AtDFEFM模型各模块即插即用,易于构建和部署,且在性能与复杂度之间取得平衡,具备较高实用性。
基金Supported by China Medical University,No.CMU111-MF-102.
文摘In this editorial,we discuss an article titled,“Significant risk factors for intensive care unit-acquired weakness:A processing strategy based on repeated machine learning,”published in a recent issue of the World Journal of Clinical Cases.Intensive care unit-acquired weakness(ICU-AW)is a debilitating condition that affects critically ill patients,with significant implications for patient outcomes and their quality of life.This study explored the use of artificial intelligence and machine learning techniques to predict ICU-AW occurrence and identify key risk factors.Data from a cohort of 1063 adult intensive care unit(ICU)patients were analyzed,with a particular emphasis on variables such as duration of ICU stay,duration of mechanical ventilation,doses of sedatives and vasopressors,and underlying comorbidities.A multilayer perceptron neural network model was developed,which exhibited a remarkable impressive prediction accuracy of 86.2%on the training set and 85.5%on the test set.The study highlights the importance of early prediction and intervention in mitigating ICU-AW risk and improving patient outcomes.
基金The Shanghai Committee of Science and Technology of China under contract No. 10510502800the Graduate Student Education Innovation Program Foundation of Shanghai Municipal Education Commission of Chinathe National Key Science Foundation Research "973" Project of the Ministry of Science and Technology of China under contract No. 2012CB316200
文摘Harmonic analysis, the traditional tidal forecasting method, cannot take into account the impact of noncyclical factors, and is also based on the BP neural network tidal prediction model which is easily limited by the amount of data. According to the movement of celestial bodies, and considering the insufficient tidal characteristics of historical data which are impacted by the nonperiodic weather, a tidal prediction method is designed based on support vector machine （SVM） to carry out the simulation experiment by using tidal data from Xiamen Tide Gauge, Luchaogang Tide Gauge and Weifang Tide Gauge individually. And the results show that the model satisfactorily carries out the tide prediction which is influenced by noncyclical factors. At the same time, it also proves that the proposed prediction method, which when compared with harmonic analysis method and the BP neural network method, has faster modeling speed, higher prediction precision and stronger generalization ability.
基金supported by National Natural Science Foundation of China(Nos.62032013 and 61972078)the Fundamental Research Funds for the Central Universities,China(No.N2217004).
文摘Factorization machine (FM) is an effective model for feature-based recommendation that utilizes inner products to capture second-order feature interactions. However, one of the major drawbacks of FM is that it cannot capture complex high-order interaction signals. A common solution is to change the interaction function, such as stacking deep neural networks on the top level of FM. In this work, we propose an alternative approach to model high-order interaction signals at the embedding level, namely generalized embedding machine (GEM). The embedding used in GEM encodes not only the information from the feature itself but also the information from other correlated features. Under such a situation, the embedding becomes high-order. Then we can incorporate GEM with FM and even its advanced variants to perform feature interactions. More specifically, in this paper, we utilize graph convolution networks (GCN) to generate high-order embeddings. We integrate GEM with several FM-based models and conduct extensive experiments on two real-world datasets. The results demonstrate significant improvement of GEM over the corresponding baselines.
