Early identification of stroke through deep learning with multi-modal human speech and movement data

Early identification and treatment of stroke can greatly improve patient outcomes and quality of life.Although clinical tests such as the Cincinnati Pre-hospital Stroke Scale(CPSS)and the Face Arm Speech Test(FAST)are commonly used for stroke screening,accurate administration is dependent on specialized training.In this study,we proposed a novel multimodal deep learning approach,based on the FAST,for assessing suspected stroke patients exhibiting symptoms such as limb weakness,facial paresis,and speech disorders in acute settings.We collected a dataset comprising videos and audio recordings of emergency room patients performing designated limb movements,facial expressions,and speech tests based on the FAST.We compared the constructed deep learning model,which was designed to process multi-modal datasets,with six prior models that achieved good action classification performance,including the I3D,SlowFast,X3D,TPN,TimeSformer,and MViT.We found that the findings of our deep learning model had a higher clinical value compared with the other approaches.Moreover,the multi-modal model outperformed its single-module variants,highlighting the benefit of utilizing multiple types of patient data,such as action videos and speech audio.These results indicate that a multi-modal deep learning model combined with the FAST could greatly improve the accuracy and sensitivity of early stroke identification of stroke,thus providing a practical and powerful tool for assessing stroke patients in an emergency clinical setting.

Deep eutectic solvents for separation and purification applications in critical metal metallurgy:Recent advances and perspectives

Solvent extraction,a separation and purification technology,is crucial in critical metal metallurgy.Organic solvents commonly used in solvent extraction exhibit disadvantages,such as high volatility,high toxicity,and flammability,causing a spectrum of hazards to human health and environmental safety.Neoteric solvents have been recognized as potential alternatives to these harmful organic solvents.In the past two decades,several neoteric solvents have been proposed,including ionic liquids(ILs)and deep eutectic solvents(DESs).DESs have gradually become the focus of green solvents owing to several advantages,namely,low toxicity,degradability,and low cost.In this critical review,their classification,formation mechanisms,preparation methods,characterization technologies,and special physicochemical properties based on the most recent advancements in research have been systematically described.Subsequently,the major separation and purification applications of DESs in critical metal metallurgy were comprehensively summarized.Finally,future opportunities and challenges of DESs were explored in the current research area.In conclusion,this review provides valuable insights for improving our overall understanding of DESs,and it holds important potential for expanding separation and purification applications in critical metal metallurgy.

An Enhanced Lung Cancer Detection Approach Using Dual-Model Deep Learning Technique

Lung cancer continues to be a leading cause of cancer-related deaths worldwide,emphasizing the critical need for improved diagnostic techniques.Early detection of lung tumors significantly increases the chances of successful treatment and survival.However,current diagnostic methods often fail to detect tumors at an early stage or to accurately pinpoint their location within the lung tissue.Single-model deep learning technologies for lung cancer detection,while beneficial,cannot capture the full range of features present in medical imaging data,leading to incomplete or inaccurate detection.Furthermore,it may not be robust enough to handle the wide variability in medical images due to different imaging conditions,patient anatomy,and tumor characteristics.To overcome these disadvantages,dual-model or multi-model approaches can be employed.This research focuses on enhancing the detection of lung cancer by utilizing a combination of two learning models:a Convolutional Neural Network(CNN)for categorization and the You Only Look Once(YOLOv8)architecture for real-time identification and pinpointing of tumors.CNNs automatically learn to extract hierarchical features from raw image data,capturing patterns such as edges,textures,and complex structures that are crucial for identifying lung cancer.YOLOv8 incorporates multiscale feature extraction,enabling the detection of tumors of varying sizes and scales within a single image.This is particularly beneficial for identifying small or irregularly shaped tumors that may be challenging to detect.Furthermore,through the utilization of cutting-edge data augmentation methods,such as Deep Convolutional Generative Adversarial Networks(DCGAN),the suggested approach can handle the issue of limited data and boost the models’ability to learn from diverse and comprehensive datasets.The combined method not only improved accuracy and localization but also ensured efficient real-time processing,which is crucial for practical clinical applications.The CNN achieved an accuracy of 97.67%in classifying lung tissues into healthy and cancerous categories.The YOLOv8 model achieved an Intersection over Union(IoU)score of 0.85 for tumor localization,reflecting high precision in detecting and marking tumor boundaries within the images.Finally,the incorporation of synthetic images generated by DCGAN led to a 10%improvement in both the CNN classification accuracy and YOLOv8 detection performance.

Comparative analysis of empirical and deep learning models for ionospheric sporadic E layer prediction

Sporadic E(Es)layers in the ionosphere are characterized by intense plasma irregularities in the E region at altitudes of 90-130 km.Because they can significantly influence radio communications and navigation systems,accurate forecasting of Es layers is crucial for ensuring the precision and dependability of navigation satellite systems.In this study,we present Es predictions made by an empirical model and by a deep learning model,and analyze their differences comprehensively by comparing the model predictions to satellite RO measurements and ground-based ionosonde observations.The deep learning model exhibited significantly better performance,as indicated by its high coefficient of correlation(r=0.87)with RO observations and predictions,than did the empirical model(r=0.53).This study highlights the importance of integrating artificial intelligence technology into ionosphere modelling generally,and into predicting Es layer occurrences and characteristics,in particular.

Advancements in Liver Tumor Detection:A Comprehensive Review of Various Deep Learning Models

Liver cancer remains a leading cause of mortality worldwide,and precise diagnostic tools are essential for effective treatment planning.Liver Tumors(LTs)vary significantly in size,shape,and location,and can present with tissues of similar intensities,making automatically segmenting and classifying LTs from abdominal tomography images crucial and challenging.This review examines recent advancements in Liver Segmentation(LS)and Tumor Segmentation(TS)algorithms,highlighting their strengths and limitations regarding precision,automation,and resilience.Performance metrics are utilized to assess key detection algorithms and analytical methods,emphasizing their effectiveness and relevance in clinical contexts.The review also addresses ongoing challenges in liver tumor segmentation and identification,such as managing high variability in patient data and ensuring robustness across different imaging conditions.It suggests directions for future research,with insights into technological advancements that can enhance surgical planning and diagnostic accuracy by comparing popular methods.This paper contributes to a comprehensive understanding of current liver tumor detection techniques,provides a roadmap for future innovations,and improves diagnostic and therapeutic outcomes for liver cancer by integrating recent progress with remaining challenges.

Machine learning and deep learning to improve prevention of anastomotic leak after rectal cancer surgery

Anastomotic leakage(AL)is a significant complication following rectal cancer surgery,adversely affecting both quality of life and oncological outcomes.Recent advancements in artificial intelligence(AI),particularly machine learning and deep learning,offer promising avenues for predicting and preventing AL.These technologies can analyze extensive clinical datasets to identify preoperative and perioperative risk factors such as malnutrition,body composition,and radiological features.AI-based models have demonstrated superior predictive power compared to traditional statistical methods,potentially guiding clinical decisionmaking and improving patient outcomes.Additionally,AI can provide surgeons with intraoperative feedback on blood supply and anatomical dissection planes,minimizing the risk of intraoperative complications and reducing the likelihood of AL development.

Physically Constrained Adaptive Deep Learning for Ocean Vertical-Mixing Parameterization

Existing traditional ocean vertical-mixing schemes are empirically developed without a thorough understanding of the physical processes involved,resulting in a discrepancy between the parameterization and forecast results.The uncertainty in ocean-mixing parameterization is primarily responsible for the bias in ocean models.Benefiting from deep-learning technology,we design the Adaptive Fully Connected Module with an Inception module as the baseline to minimize bias.It adaptively extracts the best features through fully connected layers with different widths,and better learns the nonlinear relationship between input variables and parameterization fields.Moreover,to obtain more accurate results,we impose KPP(K-Profile Parameterization)and PP(Pacanowski–Philander)schemes as physical constraints to make the network parameterization process follow the basic physical laws more closely.Since model data are calculated with human experience,lacking some unknown physical processes,which may differ from the actual data,we use a decade-long time record of hydrological and turbulence observations in the tropical Pacific Ocean as training data.Combining physical constraints and a nonlinear activation function,our method catches its nonlinear change and better adapts to the oceanmixing parameterization process.The use of physical constraints can improve the final results.

How Do Deep Learning Forecasting Models Perform for Surface Variables in the South China Sea Compared to Operational Oceanography Forecasting Systems?

It is fundamental and useful to investigate how deep learning forecasting models(DLMs)perform compared to operational oceanography forecast systems(OFSs).However,few studies have intercompared their performances using an identical reference.In this study,three physically reasonable DLMs are implemented for the forecasting of the sea surface temperature(SST),sea level anomaly(SLA),and sea surface velocity in the South China Sea.The DLMs are validated against both the testing dataset and the“OceanPredict”Class 4 dataset.Results show that the DLMs'RMSEs against the latter increase by 44%,245%,302%,and 109%for SST,SLA,current speed,and direction,respectively,compared to those against the former.Therefore,different references have significant influences on the validation,and it is necessary to use an identical and independent reference to intercompare the DLMs and OFSs.Against the Class 4 dataset,the DLMs present significantly better performance for SLA than the OFSs,and slightly better performances for other variables.The error patterns of the DLMs and OFSs show a high degree of similarity,which is reasonable from the viewpoint of predictability,facilitating further applications of the DLMs.For extreme events,the DLMs and OFSs both present large but similar forecast errors for SLA and current speed,while the DLMs are likely to give larger errors for SST and current direction.This study provides an evaluation of the forecast skills of commonly used DLMs and provides an example to objectively intercompare different DLMs.

Optimizing crop yields while minimizing environmental impact through deep placement of nitrogen fertilizer

Nitrogen(N)serves as an essential nutrient for yield formation across diverse crop types.However,agricultural production encounters numerous challenges,notably high N fertilizer rates coupled with low N use efficiency and serious environmental pollution.Deep placement of nitrogen fertilizer(DPNF)is an agronomic measure that shows promise in addressing these issues.This review aims to offer a comprehensive understanding of DPNF,beginning with a succinct overview of its development and methodologies for implementation.Subsequently,the optimal fertilization depth and influencing factors for different crops are analyzed and discussed.Additionally,it investigates the regulation and mechanism underlying the DPNF on crop development,yield,N use efficiency and greenhouse gas emissions.Finally,the review delineates the limitations and challenges of this technology and provides suggestions for its improvement and application.This review provides valuable insight and reference for the promotion and adoption of DPNF in agricultural practice.

基于Deep Forest算法的对虾急性肝胰腺坏死病(AHPND)预警数学模型构建

为预报池塘养殖凡纳对虾(Penaeus vannamei)急性肝胰腺坏死病(AHPND)的发生,自2020年开始,笔者对凡纳对虾养殖区开展了连续监测工作,包括与疾病发生相关的环境理化因子、微生物因子、虾体自身健康状况等18个候选预警因子指标,通过数据标准化处理后分析病原、宿主与环境之间的相关性,对候选预警因子进行筛选,基于Python语言编程结合Deep Forest、Light GBM、XGBoost算法进行数据建模和预测性能评判,仿真环境为Python2.7,以预警因子指标作为输入样本(即警兆),以对虾是否发病指标作为输出结果(即警情),根据输入样本和输出结果各自建立输入数据矩阵和目标数据矩阵,利用原始数据矩阵对输入样本进行初始化,结合函数方程进行拟合,拟合的源代码能利用已知环境、病原及对虾免疫指标数据对目标警情进行预测。最终建立了基于Deep Forest算法的虾体(肝胰腺内)细菌总数、虾体弧菌(Vibrio)占比、水体细菌总数和盐度的4维向量预警预报模型,准确率达89.00%。本研究将人工智能算法应用到对虾AHPND发生的预测预报,相关研究结果为对虾AHPND疾病预警预报建立了预警数学模型,并为对虾健康养殖和疾病防控提供了技术支撑和有力保障。

基于DeepLabv3+的船体结构腐蚀检测方法

利用图像识别方法对无人机、机器人所采集的实时图像开展船体结构腐蚀检测,可有效提高检验检测效率和数字化、智能化水平,具有极大的应用价值和潜力,将改变传统的船体结构检验检测方式。提出一种基于DeepLabv3+的船体结构腐蚀检测模型,通过收集图像样本并进行三种腐蚀类别的分割标注,基于DeepLabv3+语义分割模型进行网络的训练,预测图片中腐蚀的像素点类别和区域,模型在测试集的精准率达到52.92%,证明了使用DeepLabv3+检测船体腐蚀缺陷的可行性。

基于M-DeepLab网络的速度建模技术研究

本文提出了一种适用于速度建模方法的M-DeepLab网络框架,该网络将地震炮集记录作为输入,网络主体使用轻量级MobileNet,以此提升网络训练速度;并在编码环节ASPP模块后添加了Attention模块,且在解码环节将不同网络深度的速度特征进行了融合,既获得了更多的速度特征,又保留了网络浅部的速度信息,防止出现网络退化和过拟合问题。模型测试证明,M-DeepLab网络能够实现智能、精确的速度建模,简单模型、复杂模型以及含有噪声数据复杂模型的智能速度建模,均取得了良好的效果。相较DeepLabV3+网络,本文方法对于速度模型界面处的预测,特别是速度突变区域的预测,具有更高的预测精度,从而验证了该方法精确性、高效性、实用性和抗噪性。

基于改进DeepLabV3+的指针式仪表智能识别方法设计

针对现有仪表识别方法存在的诸如对表盘差异敏感、环境干扰严重以及图像质量依赖性强导致识别准确率不高的问题,提出了一种基于改进DeepLabV3+的指针式仪表智能识别算法。通过引入GhostNetV2作为主干网络进行特征提取,并添加注意力模块CBAM,有效提升了模型在仪表语义分割任务的精度;同时设计了多类仪表的示值识别算法,实现了对多类仪表的指针读数。通过在构建的指针式仪表识别数据集上对算法进行评估,结果表明,仪表智能识别算法能够适应多种仪表类型和复杂环境,识别准确率最高达99.67%,且改进的DeepLabV3+模型平均IoU达79.8%,性能优于原始模型,能够满足实际工业应用需求。

基于DeeplabV3+网络的轻量化语义分割算法

针对传统语义分割模型参数量大、计算速度慢且效率不高等问题,改进一种基于DeeplabV3+网络的轻量化语义分割模型Faster-DeeplabV3+。Faster-DeeplabV3+模型采用轻量级MobilenetV2代替Xception作为主干特征提取网络,大幅减少参数量,提高计算速度;引入深度可分离卷积(deep separable convolution, DSC)与空洞空间金字塔(atrous spatia pyramid pooling, ASPP)中的膨胀卷积设计成新的深度可分离膨胀卷积(depthwise separable dilated convolution, DSD-Conv),即组成深度可分离空洞空间金字塔模块(DP-ASPP),扩大感受野的同时减少原本卷积参数量,提高运算速度;加入改进的双注意力机制模块分别对编码区生成的低级特征图和高级特征图进行处理,增强网络对不同维度特征信息提取的敏感性和准确性;融合使用交叉熵和Dice Loss两种损失函数,为模型提供更全面、更多样的优化。改进模型在PASCAL VOC 2012数据集上进行测试。实验结果表明:平均交并比由76.57%提升至79.07%,分割准确度由91.2%提升至94.3%。改进模型的网络参数量(params)减少了3.86×10~6,浮点计算量(GFLOPs)减少了117.98 G。因此,Faster-DeeplabV3+算法在大幅降低参数量、提高运算速度的同时保持较高语义分割效果。

基于YOLO+DeepSort的出租车检测及交通流影响研究

为了解决出租车与黄色小型车辆外观相似、不易区分的问题,以哈尔滨市出租车为研究对象,以YOLOv5+DeepSort为基本框架,新增交通量与速度检测模块。基于视频采集数据,建立出租车目标检测数据集与出租车图像数据集,采用深度学习方法构建车型识别模型。建立了考虑出租车比例因素的速度影响模型,分析了畅行状态下出租车运行特征。结果表明:结合深度学习的出租车车型识别精确率高达0.88;畅行状态下出租车平均速度比其他车型高5~15 km/h;出租车比例对全局平均速度及速度-流量曲线增长趋势存在一定影响;考虑出租车比例的速度影响模型在继承传统BPR模型优点的同时,精度提升了20%左右。

基于Deep-Semi-NMF的苹果斑点落叶病检测方法

[目的/意义]苹果斑点落叶病易导致苹果树叶过早脱落,从而影响苹果品质和产量。因此,如何准确检测此病一直是苹果树病害精准防治的热点问题。由于逆光等因素影响,传统基于图像分割的病斑检测方法难以在复杂背景下准确检测病斑区域边界,亟需发展苹果斑点落叶病检测新方法,助力苹果树病害精准防治。[方法]针对上述问题,本研究从图像异常检测的角度出发,考虑复杂背景干扰,采用深度半非负矩阵分解理论,结合鲁棒性好的马氏距离度量,提出一种新的深度半非负矩阵分解的马氏距离异常检测方法(Deep Semi-Non-Negative Ma⁃trix Factorization-Based Mahalanobis Distance-Anomaly Detector,DSNMFMAD)。该方法首先利用深度非负矩阵分解(Deep Semi-Non-Negative Matrix Factorization,DSNMF)提取图像中低秩的背景部分和稀疏的异常部分。然后采用基于奇异值分解特征子空间的马氏距离构建病斑检测器,检测器通过计算异常部分每个像元的异常度来标记病斑。最后,分别构建了实验室和自然条件下的两个苹果斑点落叶病数据集,用以验证提出方法的有效性。[结果和讨论]DSNMFMAD在实验室条件和自然条件下对苹果斑点落叶病的识别准确率分别达到了99.8%和87.8%;平均检测速度为0.087和0.091 s/幅。相较于4种经典的异常检测方法和1种深度学习模型,本研究所提出方法的检测准确率在实验室条件下分别提高了0.2%、37.9%、10.3%、0.4%和24.5%;在自然条件下分别提高了2.5%、32.7%、5%、14.8%和3.5%。[结论]本研究提出的DSNMFMAD能够通过DSNMF有效地将图像中的异常部分提取出来,并利用构建的病斑检测器准确地将苹果斑点落叶病位置检测出来。即使在复杂背景条件下,该方法亦获得了比对比方法更高的检测准确度,展现出了优异的病斑检测性能,为苹果斑点落叶病的检测与防治提供了技术参考依据。

基于注意力机制改进的DeepLabV3+遥感图像分割算法

DeepLabV3+分割算法具有高效的编解码结构,常用在图像分割任务中。针对DeepLabV3+高分辨率遥感图像语义分割中存在的分割目标边缘不精确和孔洞缺陷问题,提出了一种基于注意力机制改进的DeepLabV3+遥感图像分割算法。构建ECBA(Efficient Convolutional Block Attention Module)注意力机制,将ECBA添加至DeepLabV3+主干网络Xception,增强其特征提取能力,得到注意力加权的高层特征。同时,将ECBA添加至编码器和解码器的连接支路,得到注意力加权后的低层特征。解码器将两种特征进行特征融合,以增强网络对不同分割目标的边缘以及同一目标内部的感知。实验结果表明,改进后的算法在ISPRS Potsdam数据集上的平均交并比(mean Intersection over Union,mIoU)和F1指数分别达到了79.80%和75.88%,比DeepLabV3+算法提高了11.06%和6.32%。

Deep Learning Hybrid Model for Lithium-Ion Battery Aging Estimation and Prediction

The degradation process of lithium-ion batteries is intricately linked to their entire lifecycle as power sources and energy storage devices,encompassing aspects such as performance delivery and cycling utilization.Consequently,the accurate and expedient estimation or prediction of the aging state of lithium-ion batteries has garnered extensive attention.Nonetheless,prevailing research predominantly concentrates on either aging estimation or prediction,neglecting the dynamic fusion of both facets.This paper proposes a hybrid model for capacity aging estimation and prediction based on deep learning,wherein salient features highly pertinent to aging are extracted from charge and discharge relaxation processes.By amalgamating historical capacity decay data,the model dynamically furnishes estimations of the present capacity and forecasts of future capacity for lithium-ion batteries.Our approach is validated against a novel dataset involving charge and discharge cycles at varying rates.Specifically,under a charging condition of 0.25 C,a mean absolute percentage error(MAPE)of 0.29%is achieved.This outcome underscores the model's adeptness in harnessing relaxation processes commonly encountered in the real world and synergizing with historical capacity records within battery management systems(BMS),thereby affording estimations and prognostications of capacity decline with heightened precision.

Dendritic Deep Learning for Medical Segmentation

Dear Editor,This letter presents a novel segmentation approach that leverages dendritic neurons to tackle the challenges of medical imaging segmentation.In this study,we enhance the segmentation accuracy based on a SegNet variant including an encoder-decoder structure,an upsampling index,and a deep supervision method.Furthermore,we introduce a dendritic neuron-based convolutional block to enable nonlinear feature mapping,thereby further improving the effectiveness of our approach.

Deep learning-based inpainting of saturation artifacts in optical coherence tomography images

Limited by the dynamic range of the detector,saturation artifacts usually occur in optical coherence tomography(OCT)imaging for high scattering media.The available methods are difficult to remove saturation artifacts and restore texture completely in OCT images.We proposed a deep learning-based inpainting method of saturation artifacts in this paper.The generation mechanism of saturation artifacts was analyzed,and experimental and simulated datasets were built based on the mechanism.Enhanced super-resolution generative adversarial networks were trained by the clear–saturated phantom image pairs.The perfect reconstructed results of experimental zebrafish and thyroid OCT images proved its feasibility,strong generalization,and robustness.