Early identification of stroke through deep learning with multi-modal human speech and movement data

Early identification and treatment of stroke can greatly improve patient outcomes and quality of life.Although clinical tests such as the Cincinnati Pre-hospital Stroke Scale(CPSS)and the Face Arm Speech Test(FAST)are commonly used for stroke screening,accurate administration is dependent on specialized training.In this study,we proposed a novel multimodal deep learning approach,based on the FAST,for assessing suspected stroke patients exhibiting symptoms such as limb weakness,facial paresis,and speech disorders in acute settings.We collected a dataset comprising videos and audio recordings of emergency room patients performing designated limb movements,facial expressions,and speech tests based on the FAST.We compared the constructed deep learning model,which was designed to process multi-modal datasets,with six prior models that achieved good action classification performance,including the I3D,SlowFast,X3D,TPN,TimeSformer,and MViT.We found that the findings of our deep learning model had a higher clinical value compared with the other approaches.Moreover,the multi-modal model outperformed its single-module variants,highlighting the benefit of utilizing multiple types of patient data,such as action videos and speech audio.These results indicate that a multi-modal deep learning model combined with the FAST could greatly improve the accuracy and sensitivity of early stroke identification of stroke,thus providing a practical and powerful tool for assessing stroke patients in an emergency clinical setting.

Deep eutectic solvents for separation and purification applications in critical metal metallurgy:Recent advances and perspectives

Solvent extraction,a separation and purification technology,is crucial in critical metal metallurgy.Organic solvents commonly used in solvent extraction exhibit disadvantages,such as high volatility,high toxicity,and flammability,causing a spectrum of hazards to human health and environmental safety.Neoteric solvents have been recognized as potential alternatives to these harmful organic solvents.In the past two decades,several neoteric solvents have been proposed,including ionic liquids(ILs)and deep eutectic solvents(DESs).DESs have gradually become the focus of green solvents owing to several advantages,namely,low toxicity,degradability,and low cost.In this critical review,their classification,formation mechanisms,preparation methods,characterization technologies,and special physicochemical properties based on the most recent advancements in research have been systematically described.Subsequently,the major separation and purification applications of DESs in critical metal metallurgy were comprehensively summarized.Finally,future opportunities and challenges of DESs were explored in the current research area.In conclusion,this review provides valuable insights for improving our overall understanding of DESs,and it holds important potential for expanding separation and purification applications in critical metal metallurgy.

基于Deep Forest算法的对虾急性肝胰腺坏死病(AHPND)预警数学模型构建

为预报池塘养殖凡纳对虾(Penaeus vannamei)急性肝胰腺坏死病(AHPND)的发生,自2020年开始,笔者对凡纳对虾养殖区开展了连续监测工作,包括与疾病发生相关的环境理化因子、微生物因子、虾体自身健康状况等18个候选预警因子指标,通过数据标准化处理后分析病原、宿主与环境之间的相关性,对候选预警因子进行筛选,基于Python语言编程结合Deep Forest、Light GBM、XGBoost算法进行数据建模和预测性能评判,仿真环境为Python2.7,以预警因子指标作为输入样本(即警兆),以对虾是否发病指标作为输出结果(即警情),根据输入样本和输出结果各自建立输入数据矩阵和目标数据矩阵,利用原始数据矩阵对输入样本进行初始化,结合函数方程进行拟合,拟合的源代码能利用已知环境、病原及对虾免疫指标数据对目标警情进行预测。最终建立了基于Deep Forest算法的虾体(肝胰腺内)细菌总数、虾体弧菌(Vibrio)占比、水体细菌总数和盐度的4维向量预警预报模型,准确率达89.00%。本研究将人工智能算法应用到对虾AHPND发生的预测预报,相关研究结果为对虾AHPND疾病预警预报建立了预警数学模型,并为对虾健康养殖和疾病防控提供了技术支撑和有力保障。

Enhanced visible-light photo-oxidation of nitric oxide using bismuth-coupled graphitic carbon nitride composite heterostructures

Pure bismuth（Bi） metal-modified graphitic carbon nitride（g-C3N4） composites（Bi-CN） with a pomegranate-like structure were prepared by an in situ method.The Bi-CN composites were used as photocatalysts for the oxidation of nitric oxide（NO） under visible-light irradiation.The inclusion of pure Bi metal in the g-C3N4 layers markedly improved the light absorption of the Bi-CN composites from the ultraviolet to the near-infrared region because of the typical surface plasmon resonance of Bi metal.The separation and transfer of photogenerated charge carriers were greatly accelerated by the presence of built-in Mott-Schottky effects at the interface between Bi metal and g-C3N4.As a result,the Bi-CN composite photocatalysts exhibited considerably enhanced efficiency in the photocatalytic removal of NO compared with that of Bi metal or g-C3N4 alone.The pomegranate-like structure of the Bi-CN composites and an explanation for their improved photocatalytic activity were proposed.This work not only provides a design for highly efficient g-C3N4-based photocatalysts through modification with Bi metal,but also offers new insights into the mechanistic understanding of g-C3N4-based photo catalysis.

Kinetics and Mechanism of the Photo-oxidation of Thiophene by O_2 Adsorbed on Molecular Sieves

Photochemical oxidation of thiophene in n-octane/water extraction system using O2 as oxidant was studied. The reaction mechanism ofthiophene oxidation was proposed. Results obtained here can be used as the reference for the oxidative desulfurization of gasoline because thiophene is one of the main components containing sulfur in fluid catalytic cracking gasoline. Thiophene dissolved in n-octane was photodecomposed and removed into the water phase at ambient temperature and atmospheric pressure. A 500 W high-pressure mercury lamp （main wave length 365 nm, 0.22 kW/m） was used as light source for irradiation, and air was introduced by a gas pump to supply O2. Thiophene can be photo-oxidized to sulfone, oxalic acid, SO4^2-, and CO2. The desulfurization yield of thiophene in n-octane is 58.9% under photo-irradiation for 5 h under the conditions of air flow at 150 mL/min and V（water）：V（n-octane）=1：1. It can be improved to 92.3% by adding 0.15 g zeoliteartificial into 100 mL reaction system, which is the adsorbent for O2 and thiophene. And under such conditions, the photo-oxidation kinetics of thiophene with O2/zeoliteartificial is first-order with an apparent rate constant of 0.5047 h^-1 and a half-time of 1.37 h. The sulfur content can be depressed from 800 μL/L to less than 62 μL/L.

EFFECTS OF ORGANIC COLORANTS ON PHOTO-INITIATED CROSSLINKING AND PHOTO-OXIDATION DEGRADATION OF POLYETHYLENE AND RELATED MECHANISM

The effects of three organic colorants on photo-initiated crosslinking and photo-oxidation degradation of polyethylene (PE) samples irradiated by microwave excited (MWE) UV lamp in the melt and the related mechanism have been studied by gel content and thermal extension rate determinations,X-ray photoelectron spectroscopy (XPS),mechanical property tests,UV spectroscopy,and light microscope.The data from the gel content and thermal extension rate determinations of photo-crosslinked polyethylene (XLPE) sample...

基于DeepLabv3+的船体结构腐蚀检测方法

利用图像识别方法对无人机、机器人所采集的实时图像开展船体结构腐蚀检测,可有效提高检验检测效率和数字化、智能化水平,具有极大的应用价值和潜力,将改变传统的船体结构检验检测方式。提出一种基于DeepLabv3+的船体结构腐蚀检测模型,通过收集图像样本并进行三种腐蚀类别的分割标注,基于DeepLabv3+语义分割模型进行网络的训练,预测图片中腐蚀的像素点类别和区域,模型在测试集的精准率达到52.92%,证明了使用DeepLabv3+检测船体腐蚀缺陷的可行性。

基于M-DeepLab网络的速度建模技术研究

本文提出了一种适用于速度建模方法的M-DeepLab网络框架,该网络将地震炮集记录作为输入,网络主体使用轻量级MobileNet,以此提升网络训练速度;并在编码环节ASPP模块后添加了Attention模块,且在解码环节将不同网络深度的速度特征进行了融合,既获得了更多的速度特征,又保留了网络浅部的速度信息,防止出现网络退化和过拟合问题。模型测试证明,M-DeepLab网络能够实现智能、精确的速度建模,简单模型、复杂模型以及含有噪声数据复杂模型的智能速度建模,均取得了良好的效果。相较DeepLabV3+网络,本文方法对于速度模型界面处的预测,特别是速度突变区域的预测,具有更高的预测精度,从而验证了该方法精确性、高效性、实用性和抗噪性。

基于改进DeepLabV3+的指针式仪表智能识别方法设计

针对现有仪表识别方法存在的诸如对表盘差异敏感、环境干扰严重以及图像质量依赖性强导致识别准确率不高的问题,提出了一种基于改进DeepLabV3+的指针式仪表智能识别算法。通过引入GhostNetV2作为主干网络进行特征提取,并添加注意力模块CBAM,有效提升了模型在仪表语义分割任务的精度;同时设计了多类仪表的示值识别算法,实现了对多类仪表的指针读数。通过在构建的指针式仪表识别数据集上对算法进行评估,结果表明,仪表智能识别算法能够适应多种仪表类型和复杂环境,识别准确率最高达99.67%,且改进的DeepLabV3+模型平均IoU达79.8%,性能优于原始模型,能够满足实际工业应用需求。

基于DeeplabV3+网络的轻量化语义分割算法

针对传统语义分割模型参数量大、计算速度慢且效率不高等问题,改进一种基于DeeplabV3+网络的轻量化语义分割模型Faster-DeeplabV3+。Faster-DeeplabV3+模型采用轻量级MobilenetV2代替Xception作为主干特征提取网络,大幅减少参数量,提高计算速度;引入深度可分离卷积(deep separable convolution, DSC)与空洞空间金字塔(atrous spatia pyramid pooling, ASPP)中的膨胀卷积设计成新的深度可分离膨胀卷积(depthwise separable dilated convolution, DSD-Conv),即组成深度可分离空洞空间金字塔模块(DP-ASPP),扩大感受野的同时减少原本卷积参数量,提高运算速度;加入改进的双注意力机制模块分别对编码区生成的低级特征图和高级特征图进行处理,增强网络对不同维度特征信息提取的敏感性和准确性;融合使用交叉熵和Dice Loss两种损失函数,为模型提供更全面、更多样的优化。改进模型在PASCAL VOC 2012数据集上进行测试。实验结果表明:平均交并比由76.57%提升至79.07%,分割准确度由91.2%提升至94.3%。改进模型的网络参数量(params)减少了3.86×10~6,浮点计算量(GFLOPs)减少了117.98 G。因此,Faster-DeeplabV3+算法在大幅降低参数量、提高运算速度的同时保持较高语义分割效果。

基于YOLO+DeepSort的出租车检测及交通流影响研究

为了解决出租车与黄色小型车辆外观相似、不易区分的问题,以哈尔滨市出租车为研究对象,以YOLOv5+DeepSort为基本框架,新增交通量与速度检测模块。基于视频采集数据,建立出租车目标检测数据集与出租车图像数据集,采用深度学习方法构建车型识别模型。建立了考虑出租车比例因素的速度影响模型,分析了畅行状态下出租车运行特征。结果表明:结合深度学习的出租车车型识别精确率高达0.88;畅行状态下出租车平均速度比其他车型高5~15 km/h;出租车比例对全局平均速度及速度-流量曲线增长趋势存在一定影响;考虑出租车比例的速度影响模型在继承传统BPR模型优点的同时,精度提升了20%左右。

基于注意力机制改进的DeepLabV3+遥感图像分割算法

DeepLabV3+分割算法具有高效的编解码结构,常用在图像分割任务中。针对DeepLabV3+高分辨率遥感图像语义分割中存在的分割目标边缘不精确和孔洞缺陷问题,提出了一种基于注意力机制改进的DeepLabV3+遥感图像分割算法。构建ECBA(Efficient Convolutional Block Attention Module)注意力机制,将ECBA添加至DeepLabV3+主干网络Xception,增强其特征提取能力,得到注意力加权的高层特征。同时,将ECBA添加至编码器和解码器的连接支路,得到注意力加权后的低层特征。解码器将两种特征进行特征融合,以增强网络对不同分割目标的边缘以及同一目标内部的感知。实验结果表明,改进后的算法在ISPRS Potsdam数据集上的平均交并比(mean Intersection over Union,mIoU)和F1指数分别达到了79.80%和75.88%,比DeepLabV3+算法提高了11.06%和6.32%。

Dendritic Deep Learning for Medical Segmentation

Dear Editor,This letter presents a novel segmentation approach that leverages dendritic neurons to tackle the challenges of medical imaging segmentation.In this study,we enhance the segmentation accuracy based on a SegNet variant including an encoder-decoder structure,an upsampling index,and a deep supervision method.Furthermore,we introduce a dendritic neuron-based convolutional block to enable nonlinear feature mapping,thereby further improving the effectiveness of our approach.

Deep learning-based inpainting of saturation artifacts in optical coherence tomography images

Limited by the dynamic range of the detector,saturation artifacts usually occur in optical coherence tomography(OCT)imaging for high scattering media.The available methods are difficult to remove saturation artifacts and restore texture completely in OCT images.We proposed a deep learning-based inpainting method of saturation artifacts in this paper.The generation mechanism of saturation artifacts was analyzed,and experimental and simulated datasets were built based on the mechanism.Enhanced super-resolution generative adversarial networks were trained by the clear–saturated phantom image pairs.The perfect reconstructed results of experimental zebrafish and thyroid OCT images proved its feasibility,strong generalization,and robustness.

240 nm AlGaN-based deep ultraviolet micro-LEDs:size effect versus edge effect

240 nm AlGaN-based micro-LEDs with different sizes are designed and fabricated.Then,the external quantum efficiency(EQE)and light extraction efficiency(LEE)are systematically investigated by comparing size and edge effects.Here,it is revealed that the peak optical output power increases by 81.83%with the size shrinking from 50.0 to 25.0μm.Thereinto,the LEE increases by 26.21%and the LEE enhancement mainly comes from the sidewall light extraction.Most notably,transversemagnetic(TM)mode light intensifies faster as the size shrinks due to the tilted mesa side-wall and Al reflector design.However,when it turns to 12.5μm sized micro-LEDs,the output power is lower than 25.0μm sized ones.The underlying mechanism is that even though protected by SiO2 passivation,the edge effect which leads to current leakage and Shockley-Read-Hall(SRH)recombination deteriorates rapidly with the size further shrinking.Moreover,the ratio of the p-contact area to mesa area is much lower,which deteriorates the p-type current spreading at the mesa edge.These findings show a role of thumb for the design of high efficiency micro-LEDs with wavelength below 250 nm,which will pave the way for wide applications of deep ultraviolet(DUV)micro-LEDs.

ST-LSTM-SA:A New Ocean Sound Velocity Field Prediction Model Based on Deep Learning

The scarcity of in-situ ocean observations poses a challenge for real-time information acquisition in the ocean.Among the crucial hydroacoustic environmental parameters,ocean sound velocity exhibits significant spatial and temporal variability and it is highly relevant to oceanic research.In this study,we propose a new data-driven approach,leveraging deep learning techniques,for the prediction of sound velocity fields(SVFs).Our novel spatiotemporal prediction model,STLSTM-SA,combines Spatiotemporal Long Short-Term Memory(ST-LSTM) with a self-attention mechanism to enable accurate and real-time prediction of SVFs.To circumvent the limited amount of observational data,we employ transfer learning by first training the model using reanalysis datasets,followed by fine-tuning it using in-situ analysis data to obtain the final prediction model.By utilizing the historical 12-month SVFs as input,our model predicts the SVFs for the subsequent three months.We compare the performance of five models:Artificial Neural Networks(ANN),Long ShortTerm Memory(LSTM),Convolutional LSTM(ConvLSTM),ST-LSTM,and our proposed ST-LSTM-SA model in a test experiment spanning 2019 to 2022.Our results demonstrate that the ST-LSTM-SA model significantly improves the prediction accuracy and stability of sound velocity in both temporal and spatial dimensions.The ST-LSTM-SA model not only accurately predicts the ocean sound velocity field(SVF),but also provides valuable insights for spatiotemporal prediction of other oceanic environmental variables.

UAV-Assisted Dynamic Avatar Task Migration for Vehicular Metaverse Services: A Multi-Agent Deep Reinforcement Learning Approach

Avatars, as promising digital representations and service assistants of users in Metaverses, can enable drivers and passengers to immerse themselves in 3D virtual services and spaces of UAV-assisted vehicular Metaverses. However, avatar tasks include a multitude of human-to-avatar and avatar-to-avatar interactive applications, e.g., augmented reality navigation,which consumes intensive computing resources. It is inefficient and impractical for vehicles to process avatar tasks locally. Fortunately, migrating avatar tasks to the nearest roadside units(RSU)or unmanned aerial vehicles(UAV) for execution is a promising solution to decrease computation overhead and reduce task processing latency, while the high mobility of vehicles brings challenges for vehicles to independently perform avatar migration decisions depending on current and future vehicle status. To address these challenges, in this paper, we propose a novel avatar task migration system based on multi-agent deep reinforcement learning(MADRL) to execute immersive vehicular avatar tasks dynamically. Specifically, we first formulate the problem of avatar task migration from vehicles to RSUs/UAVs as a partially observable Markov decision process that can be solved by MADRL algorithms. We then design the multi-agent proximal policy optimization(MAPPO) approach as the MADRL algorithm for the avatar task migration problem. To overcome slow convergence resulting from the curse of dimensionality and non-stationary issues caused by shared parameters in MAPPO, we further propose a transformer-based MAPPO approach via sequential decision-making models for the efficient representation of relationships among agents. Finally, to motivate terrestrial or non-terrestrial edge servers(e.g., RSUs or UAVs) to share computation resources and ensure traceability of the sharing records, we apply smart contracts and blockchain technologies to achieve secure sharing management. Numerical results demonstrate that the proposed approach outperforms the MAPPO approach by around 2% and effectively reduces approximately 20% of the latency of avatar task execution in UAV-assisted vehicular Metaverses.

基于改进DeeplabV3+的水面多类型漂浮物分割方法研究

【目的】为解决传统图像处理方法鲁棒性差、常用深度学习检测方法无法准确识别大片漂浮物的边界等问题,【方法】提出一种基于改进DeeplabV3+的水面多类型漂浮物识别的语义分割方法,提高水面漂浮的识别能力。对所收集实际水面漂浮物进行分类,采用自制数据集进行对比试验。算法选择xception网络作为主干网络以获得初步漂浮物特征,在加强特征提取网络部分引入注意力机制以强调有效特征信息,在后处理阶段加入全连接条件随机场模型,将单个像素点的局部信息与全局语义信息融合。【结果】对比图像分割性能指标,改进后的算法mPA(Mean Pixel Accuracy)提升了5.73%,mIOU(Mean Intersection Over Union)提升了4.37%。【结论】相比于其他算法模型,改进后的DeeplabV3+算法对漂浮物特征的获取能力更强,同时能获得丰富的细节信息以更精准地识别多类型水面漂浮物的边界与较难分类的漂浮物,在对多个水库场景测试后满足实际水域环境中漂浮物检测的需求。

Deep neural network-enabled battery open-circuit voltage estimation based on partial charging data

Battery management systems(BMSs) play a vital role in ensuring efficient and reliable operations of lithium-ion batteries.The main function of the BMSs is to estimate battery states and diagnose battery health using battery open-circuit voltage(OCV).However,acquiring the complete OCV data online can be a challenging endeavor due to the time-consuming measurement process or the need for specific operating conditions required by OCV estimation models.In addressing these concerns,this study introduces a deep neural network-combined framework for accurate and robust OCV estimation,utilizing partial daily charging data.We incorporate a generative deep learning model to extract aging-related features from data and generate high-fidelity OCV curves.Correlation analysis is employed to identify the optimal partial charging data,optimizing the OCV estimation precision while preserving exceptional flexibility.The validation results,using data from nickel-cobalt-magnesium(NCM) batteries,illustrate the accurate estimation of the complete OCV-capacity curve,with an average root mean square errors(RMSE) of less than 3 mAh.Achieving this level of precision for OCV estimation requires only around 50 s collection of partial charging data.Further validations on diverse battery types operating under various conditions confirm the effectiveness of our proposed method.Additional cases of precise health diagnosis based on OCV highlight the significance of conducting online OCV estimation.Our method provides a flexible approach to achieve complete OCV estimation and holds promise for generalization to other tasks in BMSs.

A review of reservoir damage during hydraulic fracturing of deep and ultra-deep reservoirs

Deep and ultra-deep reservoirs have gradually become the primary focus of hydrocarbon exploration as a result of a series of significant discoveries in deep hydrocarbon exploration worldwide.These reservoirs present unique challenges due to their deep burial depth(4500-8882 m),low matrix permeability,complex crustal stress conditions,high temperature and pressure(HTHP,150-200℃,105-155 MPa),coupled with high salinity of formation water.Consequently,the costs associated with their exploitation and development are exceptionally high.In deep and ultra-deep reservoirs,hydraulic fracturing is commonly used to achieve high and stable production.During hydraulic fracturing,a substantial volume of fluid is injected into the reservoir.However,statistical analysis reveals that the flowback rate is typically less than 30%,leaving the majority of the fluid trapped within the reservoir.Therefore,hydraulic fracturing in deep reservoirs not only enhances the reservoir permeability by creating artificial fractures but also damages reservoirs due to the fracturing fluids involved.The challenging“three-high”environment of a deep reservoir,characterized by high temperature,high pressure,and high salinity,exacerbates conventional forms of damage,including water sensitivity,retention of fracturing fluids,rock creep,and proppant breakage.In addition,specific damage mechanisms come into play,such as fracturing fluid decomposition at elevated temperatures and proppant diagenetic reactions at HTHP conditions.Presently,the foremost concern in deep oil and gas development lies in effectively assessing the damage inflicted on these reservoirs by hydraulic fracturing,comprehending the underlying mechanisms,and selecting appropriate solutions.It's noteworthy that the majority of existing studies on reservoir damage primarily focus on conventional reservoirs,with limited attention given to deep reservoirs and a lack of systematic summaries.In light of this,our approach entails initially summarizing the current knowledge pertaining to the types of fracturing fluids employed in deep and ultra-deep reservoirs.Subsequently,we delve into a systematic examination of the damage processes and mechanisms caused by fracturing fluids within the context of hydraulic fracturing in deep reservoirs,taking into account the unique reservoir characteristics of high temperature,high pressure,and high in-situ stress.In addition,we provide an overview of research progress related to high-temperature deep reservoir fracturing fluid and the damage of aqueous fracturing fluids to rock matrix,both artificial and natural fractures,and sand-packed fractures.We conclude by offering a summary of current research advancements and future directions,which hold significant potential for facilitating the efficient development of deep oil and gas reservoirs while effectively mitigating reservoir damage.