Machine Learning Techniques Using Deep Instinctive Encoder-Based Feature Extraction for Optimized Breast Cancer Detection

Breast cancer(BC)is one of the leading causes of death among women worldwide,as it has emerged as the most commonly diagnosed malignancy in women.Early detection and effective treatment of BC can help save women’s lives.Developing an efficient technology-based detection system can lead to non-destructive and preliminary cancer detection techniques.This paper proposes a comprehensive framework that can effectively diagnose cancerous cells from benign cells using the Curated Breast Imaging Subset of the Digital Database for Screening Mammography(CBIS-DDSM)data set.The novelty of the proposed framework lies in the integration of various techniques,where the fusion of deep learning(DL),traditional machine learning(ML)techniques,and enhanced classification models have been deployed using the curated dataset.The analysis outcome proves that the proposed enhanced RF(ERF),enhanced DT(EDT)and enhanced LR(ELR)models for BC detection outperformed most of the existing models with impressive results.

Insight into the experiment and extraction mechanism for separating carbazole from anthracene oil with quaternary ammonium-based deep eutectic solvents

Carbazole is an irreplaceable basic organic chemical raw material and intermediate in industry.The separation of carbazole from anthracene oil by environmental benign solvents is important but still a challenge in chemical engineering.Deep eutectic solvents (DESs) as a sustainable green separation solvent have been proposed for the separation of carbazole from model anthracene oil.In this research,three quaternary ammonium-based DESs were prepared using ethylene glycol (EG) as hydrogen bond donor and tetrabutylammonium chloride (TBAC),tetrabutylammonium bromide or choline chloride as hydrogen bond acceptors.To explore their extraction performance of carbazole,the conductor-like screening model for real solvents (COSMO-RS) model was used to predict the activity coefficient at infinite dilution (γ^(∞)) of carbazole in DESs,and the result indicated TBAC:EG (1:2) had the stronger extraction ability for carbazole due to the higher capacity at infinite dilution (C^(∞)) value.Then,the separation performance of these three DESs was evaluated by experiments,and the experimental results were in good agreement with the COSMO-RS prediction results.The TBAC:EG (1:2) was determined as the most promising solvent.Additionally,the extraction conditions of TBAC:EG (1:2) were optimized,and the extraction efficiency,distribution coefficient and selectivity of carbazole could reach up to 85.74%,30.18 and 66.10%,respectively.Moreover,the TBAC:EG (1:2) could be recycled by using environmentally friendly water as antisolvent.In addition,the separation performance of TBAC:EG (1:2) was also evaluated by real crude anthracene,the carbazole was obtained with purity and yield of 85.32%,60.27%,respectively.Lastly,the extraction mechanism was elucidated byσ-profiles and interaction energy analysis.Theoretical calculation results showed that the main driving force for the extraction process was the hydrogen bonding ((N–H...Cl) and van der Waals interactions (C–H...O and C–H...π),which corresponding to the blue and green isosurfaces in IGMH analysis.This work presented a novel method for separating carbazole from crude anthracene oil,and will provide an important reference for the separation of other high value-added products from coal tar.

ConvNeXt-UperNet-Based Deep Learning Model for Road Extraction from High-Resolution Remote Sensing Images

When existing deep learning models are used for road extraction tasks from high-resolution images,they are easily affected by noise factors such as tree and building occlusion and complex backgrounds,resulting in incomplete road extraction and low accuracy.We propose the introduction of spatial and channel attention modules to the convolutional neural network ConvNeXt.Then,ConvNeXt is used as the backbone network,which cooperates with the perceptual analysis network UPerNet,retains the detection head of the semantic segmentation,and builds a new model ConvNeXt-UPerNet to suppress noise interference.Training on the open-source DeepGlobe and CHN6-CUG datasets and introducing the DiceLoss on the basis of CrossEntropyLoss solves the problem of positive and negative sample imbalance.Experimental results show that the new network model can achieve the following performance on the DeepGlobe dataset:79.40%for precision(Pre),97.93% for accuracy(Acc),69.28% for intersection over union(IoU),and 83.56% for mean intersection over union(MIoU).On the CHN6-CUG dataset,the model achieves the respective values of 78.17%for Pre,97.63%for Acc,65.4% for IoU,and 81.46% for MIoU.Compared with other network models,the fused ConvNeXt-UPerNet model can extract road information better when faced with the influence of noise contained in high-resolution remote sensing images.It also achieves multiscale image feature information with unified perception,ultimately improving the generalization ability of deep learning technology in extracting complex roads from high-resolution remote sensing images.

Study on the green extraction of corncob xylan by deep eutectic solvent

Corn as one of the world's major food crops,its by-product corn cob is also rich in resources.However,the unreasonable utilization of corn cob often causes the environmental pollution,waste of resources and other problems.As one of the most abundant polymers in nature,xylan is widely used in food,medicine,materials and other fields.Corn cob is rich in xylan,which is an ideal raw material for extracting xylan.However,the intractable lignin is covalently linked to xylan,which increases the difficulty of xylan extraction.It has been reported that the deep eutectic solvent(DES)could preferentially dissolve lignin in biomass,thereby dissolving the xylan.Then,the xylan in the extract was separated by ethanol precipitation method.The xylan precipitate was obtained after centrifugation,while the supernatant was retained.The components of the supernatant after ethanol precipitation were separated by the rotary evaporator.The ethanol,water and DES were collected for the subsequent extraction of corn cob xylan.In this study,a novel way was provided for the green production of corn cob xylan.The DES was used to extract xylan from corn cob which was used as the raw material.The effects of solid-liquid ratio,reaction time,reaction temperature and water content of DES on the extraction rate of corn cob xylan were investigated by the single factor test.Furthermore,the orthogonal test was designed to optimize the xylan extraction process.The structure of corn cob xylan was analyzed and verified.The results showed that the optimum extraction conditions of corn cob xylan were as follows:the ratio of corn cob to DES was 1:15(g:mL),the extraction time was 3 h,the extraction temperature was 60℃,and the water content of DES was 70%.Under these conditions,the extraction rate of xylan was 16.46%.The extracted corn cob xylan was distinctive triple helix of polysaccharide,which was similar to the structure of commercially available xylan.Xylan was effectively and workably extracted from corn cob by the DES method.This study provided a new approach for high value conversion of corn cob and the clean production of xylan.

Research Progress of Deep Eutectic Solvents in Extraction of Plant Flavonoids

As a new type of green solvents,deep eutectic solvents(DESs)have the advantages of strong extraction ability,designability,simple preparation,low price,recoverability and biodegradation,and show great application potential in the field of plant flavonoid extraction.In this paper,the definition,classification and preparation methods of DESs were introduced.The effects of DES composition,molar ratio of DES components,water content of DES systems,liquid-material ratio,extraction temperature,extraction time and extraction auxiliary techniques on the extraction yield of plant flavonoids were expounded.The recycling methods of DESs were summarized.Existing problems of DESs in the field of plant flavonoids extraction were pointed out,and further research direction and trend were analyzed and prospected.

基于Deep Forest算法的对虾急性肝胰腺坏死病(AHPND)预警数学模型构建

为预报池塘养殖凡纳对虾(Penaeus vannamei)急性肝胰腺坏死病(AHPND)的发生,自2020年开始,笔者对凡纳对虾养殖区开展了连续监测工作,包括与疾病发生相关的环境理化因子、微生物因子、虾体自身健康状况等18个候选预警因子指标,通过数据标准化处理后分析病原、宿主与环境之间的相关性,对候选预警因子进行筛选,基于Python语言编程结合Deep Forest、Light GBM、XGBoost算法进行数据建模和预测性能评判,仿真环境为Python2.7,以预警因子指标作为输入样本(即警兆),以对虾是否发病指标作为输出结果(即警情),根据输入样本和输出结果各自建立输入数据矩阵和目标数据矩阵,利用原始数据矩阵对输入样本进行初始化,结合函数方程进行拟合,拟合的源代码能利用已知环境、病原及对虾免疫指标数据对目标警情进行预测。最终建立了基于Deep Forest算法的虾体(肝胰腺内)细菌总数、虾体弧菌(Vibrio)占比、水体细菌总数和盐度的4维向量预警预报模型,准确率达89.00%。本研究将人工智能算法应用到对虾AHPND发生的预测预报,相关研究结果为对虾AHPND疾病预警预报建立了预警数学模型,并为对虾健康养殖和疾病防控提供了技术支撑和有力保障。

基于DeepLabv3+的船体结构腐蚀检测方法

利用图像识别方法对无人机、机器人所采集的实时图像开展船体结构腐蚀检测,可有效提高检验检测效率和数字化、智能化水平,具有极大的应用价值和潜力,将改变传统的船体结构检验检测方式。提出一种基于DeepLabv3+的船体结构腐蚀检测模型,通过收集图像样本并进行三种腐蚀类别的分割标注,基于DeepLabv3+语义分割模型进行网络的训练,预测图片中腐蚀的像素点类别和区域,模型在测试集的精准率达到52.92%,证明了使用DeepLabv3+检测船体腐蚀缺陷的可行性。

基于M-DeepLab网络的速度建模技术研究

本文提出了一种适用于速度建模方法的M-DeepLab网络框架,该网络将地震炮集记录作为输入,网络主体使用轻量级MobileNet,以此提升网络训练速度;并在编码环节ASPP模块后添加了Attention模块,且在解码环节将不同网络深度的速度特征进行了融合,既获得了更多的速度特征,又保留了网络浅部的速度信息,防止出现网络退化和过拟合问题。模型测试证明,M-DeepLab网络能够实现智能、精确的速度建模,简单模型、复杂模型以及含有噪声数据复杂模型的智能速度建模,均取得了良好的效果。相较DeepLabV3+网络,本文方法对于速度模型界面处的预测,特别是速度突变区域的预测,具有更高的预测精度,从而验证了该方法精确性、高效性、实用性和抗噪性。

基于DeeplabV3+网络的轻量化语义分割算法

针对传统语义分割模型参数量大、计算速度慢且效率不高等问题,改进一种基于DeeplabV3+网络的轻量化语义分割模型Faster-DeeplabV3+。Faster-DeeplabV3+模型采用轻量级MobilenetV2代替Xception作为主干特征提取网络,大幅减少参数量,提高计算速度;引入深度可分离卷积(deep separable convolution, DSC)与空洞空间金字塔(atrous spatia pyramid pooling, ASPP)中的膨胀卷积设计成新的深度可分离膨胀卷积(depthwise separable dilated convolution, DSD-Conv),即组成深度可分离空洞空间金字塔模块(DP-ASPP),扩大感受野的同时减少原本卷积参数量,提高运算速度;加入改进的双注意力机制模块分别对编码区生成的低级特征图和高级特征图进行处理,增强网络对不同维度特征信息提取的敏感性和准确性;融合使用交叉熵和Dice Loss两种损失函数,为模型提供更全面、更多样的优化。改进模型在PASCAL VOC 2012数据集上进行测试。实验结果表明:平均交并比由76.57%提升至79.07%,分割准确度由91.2%提升至94.3%。改进模型的网络参数量(params)减少了3.86×10~6,浮点计算量(GFLOPs)减少了117.98 G。因此,Faster-DeeplabV3+算法在大幅降低参数量、提高运算速度的同时保持较高语义分割效果。

Deep Learning-Based Semantic Feature Extraction:A Literature Review and Future Directions

Semantic communication,as a critical component of artificial intelligence(AI),has gained increasing attention in recent years due to its significant impact on various fields.In this paper,we focus on the applications of semantic feature extraction,a key step in the semantic communication,in several areas of artificial intelligence,including natural language processing,medical imaging,remote sensing,autonomous driving,and other image-related applications.Specifically,we discuss how semantic feature extraction can enhance the accuracy and efficiency of natural language processing tasks,such as text classification,sentiment analysis,and topic modeling.In the medical imaging field,we explore how semantic feature extraction can be used for disease diagnosis,drug development,and treatment planning.In addition,we investigate the applications of semantic feature extraction in remote sensing and autonomous driving,where it can facilitate object detection,scene understanding,and other tasks.By providing an overview of the applications of semantic feature extraction in various fields,this paper aims to provide insights into the potential of this technology to advance the development of artificial intelligence.

基于注意力机制改进的DeepLabV3+遥感图像分割算法

DeepLabV3+分割算法具有高效的编解码结构,常用在图像分割任务中。针对DeepLabV3+高分辨率遥感图像语义分割中存在的分割目标边缘不精确和孔洞缺陷问题,提出了一种基于注意力机制改进的DeepLabV3+遥感图像分割算法。构建ECBA(Efficient Convolutional Block Attention Module)注意力机制,将ECBA添加至DeepLabV3+主干网络Xception,增强其特征提取能力,得到注意力加权的高层特征。同时,将ECBA添加至编码器和解码器的连接支路,得到注意力加权后的低层特征。解码器将两种特征进行特征融合,以增强网络对不同分割目标的边缘以及同一目标内部的感知。实验结果表明,改进后的算法在ISPRS Potsdam数据集上的平均交并比(mean Intersection over Union,mIoU)和F1指数分别达到了79.80%和75.88%,比DeepLabV3+算法提高了11.06%和6.32%。

Dendritic Deep Learning for Medical Segmentation

Dear Editor,This letter presents a novel segmentation approach that leverages dendritic neurons to tackle the challenges of medical imaging segmentation.In this study,we enhance the segmentation accuracy based on a SegNet variant including an encoder-decoder structure,an upsampling index,and a deep supervision method.Furthermore,we introduce a dendritic neuron-based convolutional block to enable nonlinear feature mapping,thereby further improving the effectiveness of our approach.

Deep learning-based inpainting of saturation artifacts in optical coherence tomography images

Limited by the dynamic range of the detector,saturation artifacts usually occur in optical coherence tomography(OCT)imaging for high scattering media.The available methods are difficult to remove saturation artifacts and restore texture completely in OCT images.We proposed a deep learning-based inpainting method of saturation artifacts in this paper.The generation mechanism of saturation artifacts was analyzed,and experimental and simulated datasets were built based on the mechanism.Enhanced super-resolution generative adversarial networks were trained by the clear–saturated phantom image pairs.The perfect reconstructed results of experimental zebrafish and thyroid OCT images proved its feasibility,strong generalization,and robustness.

ST-LSTM-SA:A New Ocean Sound Velocity Field Prediction Model Based on Deep Learning

The scarcity of in-situ ocean observations poses a challenge for real-time information acquisition in the ocean.Among the crucial hydroacoustic environmental parameters,ocean sound velocity exhibits significant spatial and temporal variability and it is highly relevant to oceanic research.In this study,we propose a new data-driven approach,leveraging deep learning techniques,for the prediction of sound velocity fields(SVFs).Our novel spatiotemporal prediction model,STLSTM-SA,combines Spatiotemporal Long Short-Term Memory(ST-LSTM) with a self-attention mechanism to enable accurate and real-time prediction of SVFs.To circumvent the limited amount of observational data,we employ transfer learning by first training the model using reanalysis datasets,followed by fine-tuning it using in-situ analysis data to obtain the final prediction model.By utilizing the historical 12-month SVFs as input,our model predicts the SVFs for the subsequent three months.We compare the performance of five models:Artificial Neural Networks(ANN),Long ShortTerm Memory(LSTM),Convolutional LSTM(ConvLSTM),ST-LSTM,and our proposed ST-LSTM-SA model in a test experiment spanning 2019 to 2022.Our results demonstrate that the ST-LSTM-SA model significantly improves the prediction accuracy and stability of sound velocity in both temporal and spatial dimensions.The ST-LSTM-SA model not only accurately predicts the ocean sound velocity field(SVF),but also provides valuable insights for spatiotemporal prediction of other oceanic environmental variables.

UAV-Assisted Dynamic Avatar Task Migration for Vehicular Metaverse Services: A Multi-Agent Deep Reinforcement Learning Approach

Avatars, as promising digital representations and service assistants of users in Metaverses, can enable drivers and passengers to immerse themselves in 3D virtual services and spaces of UAV-assisted vehicular Metaverses. However, avatar tasks include a multitude of human-to-avatar and avatar-to-avatar interactive applications, e.g., augmented reality navigation,which consumes intensive computing resources. It is inefficient and impractical for vehicles to process avatar tasks locally. Fortunately, migrating avatar tasks to the nearest roadside units(RSU)or unmanned aerial vehicles(UAV) for execution is a promising solution to decrease computation overhead and reduce task processing latency, while the high mobility of vehicles brings challenges for vehicles to independently perform avatar migration decisions depending on current and future vehicle status. To address these challenges, in this paper, we propose a novel avatar task migration system based on multi-agent deep reinforcement learning(MADRL) to execute immersive vehicular avatar tasks dynamically. Specifically, we first formulate the problem of avatar task migration from vehicles to RSUs/UAVs as a partially observable Markov decision process that can be solved by MADRL algorithms. We then design the multi-agent proximal policy optimization(MAPPO) approach as the MADRL algorithm for the avatar task migration problem. To overcome slow convergence resulting from the curse of dimensionality and non-stationary issues caused by shared parameters in MAPPO, we further propose a transformer-based MAPPO approach via sequential decision-making models for the efficient representation of relationships among agents. Finally, to motivate terrestrial or non-terrestrial edge servers(e.g., RSUs or UAVs) to share computation resources and ensure traceability of the sharing records, we apply smart contracts and blockchain technologies to achieve secure sharing management. Numerical results demonstrate that the proposed approach outperforms the MAPPO approach by around 2% and effectively reduces approximately 20% of the latency of avatar task execution in UAV-assisted vehicular Metaverses.

基于改进DeeplabV3+的水面多类型漂浮物分割方法研究

【目的】为解决传统图像处理方法鲁棒性差、常用深度学习检测方法无法准确识别大片漂浮物的边界等问题,【方法】提出一种基于改进DeeplabV3+的水面多类型漂浮物识别的语义分割方法,提高水面漂浮的识别能力。对所收集实际水面漂浮物进行分类,采用自制数据集进行对比试验。算法选择xception网络作为主干网络以获得初步漂浮物特征,在加强特征提取网络部分引入注意力机制以强调有效特征信息,在后处理阶段加入全连接条件随机场模型,将单个像素点的局部信息与全局语义信息融合。【结果】对比图像分割性能指标,改进后的算法mPA(Mean Pixel Accuracy)提升了5.73%,mIOU(Mean Intersection Over Union)提升了4.37%。【结论】相比于其他算法模型,改进后的DeeplabV3+算法对漂浮物特征的获取能力更强,同时能获得丰富的细节信息以更精准地识别多类型水面漂浮物的边界与较难分类的漂浮物,在对多个水库场景测试后满足实际水域环境中漂浮物检测的需求。

Deep neural network-enabled battery open-circuit voltage estimation based on partial charging data

Battery management systems(BMSs) play a vital role in ensuring efficient and reliable operations of lithium-ion batteries.The main function of the BMSs is to estimate battery states and diagnose battery health using battery open-circuit voltage(OCV).However,acquiring the complete OCV data online can be a challenging endeavor due to the time-consuming measurement process or the need for specific operating conditions required by OCV estimation models.In addressing these concerns,this study introduces a deep neural network-combined framework for accurate and robust OCV estimation,utilizing partial daily charging data.We incorporate a generative deep learning model to extract aging-related features from data and generate high-fidelity OCV curves.Correlation analysis is employed to identify the optimal partial charging data,optimizing the OCV estimation precision while preserving exceptional flexibility.The validation results,using data from nickel-cobalt-magnesium(NCM) batteries,illustrate the accurate estimation of the complete OCV-capacity curve,with an average root mean square errors(RMSE) of less than 3 mAh.Achieving this level of precision for OCV estimation requires only around 50 s collection of partial charging data.Further validations on diverse battery types operating under various conditions confirm the effectiveness of our proposed method.Additional cases of precise health diagnosis based on OCV highlight the significance of conducting online OCV estimation.Our method provides a flexible approach to achieve complete OCV estimation and holds promise for generalization to other tasks in BMSs.

A review of reservoir damage during hydraulic fracturing of deep and ultra-deep reservoirs

Deep and ultra-deep reservoirs have gradually become the primary focus of hydrocarbon exploration as a result of a series of significant discoveries in deep hydrocarbon exploration worldwide.These reservoirs present unique challenges due to their deep burial depth(4500-8882 m),low matrix permeability,complex crustal stress conditions,high temperature and pressure(HTHP,150-200℃,105-155 MPa),coupled with high salinity of formation water.Consequently,the costs associated with their exploitation and development are exceptionally high.In deep and ultra-deep reservoirs,hydraulic fracturing is commonly used to achieve high and stable production.During hydraulic fracturing,a substantial volume of fluid is injected into the reservoir.However,statistical analysis reveals that the flowback rate is typically less than 30%,leaving the majority of the fluid trapped within the reservoir.Therefore,hydraulic fracturing in deep reservoirs not only enhances the reservoir permeability by creating artificial fractures but also damages reservoirs due to the fracturing fluids involved.The challenging“three-high”environment of a deep reservoir,characterized by high temperature,high pressure,and high salinity,exacerbates conventional forms of damage,including water sensitivity,retention of fracturing fluids,rock creep,and proppant breakage.In addition,specific damage mechanisms come into play,such as fracturing fluid decomposition at elevated temperatures and proppant diagenetic reactions at HTHP conditions.Presently,the foremost concern in deep oil and gas development lies in effectively assessing the damage inflicted on these reservoirs by hydraulic fracturing,comprehending the underlying mechanisms,and selecting appropriate solutions.It's noteworthy that the majority of existing studies on reservoir damage primarily focus on conventional reservoirs,with limited attention given to deep reservoirs and a lack of systematic summaries.In light of this,our approach entails initially summarizing the current knowledge pertaining to the types of fracturing fluids employed in deep and ultra-deep reservoirs.Subsequently,we delve into a systematic examination of the damage processes and mechanisms caused by fracturing fluids within the context of hydraulic fracturing in deep reservoirs,taking into account the unique reservoir characteristics of high temperature,high pressure,and high in-situ stress.In addition,we provide an overview of research progress related to high-temperature deep reservoir fracturing fluid and the damage of aqueous fracturing fluids to rock matrix,both artificial and natural fractures,and sand-packed fractures.We conclude by offering a summary of current research advancements and future directions,which hold significant potential for facilitating the efficient development of deep oil and gas reservoirs while effectively mitigating reservoir damage.

Deep learning for joint channel estimation and feedback in massive MIMO systems

The great potentials of massive Multiple-Input Multiple-Output(MIMO)in Frequency Division Duplex(FDD)mode can be fully exploited when the downlink Channel State Information(CSI)is available at base stations.However,the accurate CsI is difficult to obtain due to the large amount of feedback overhead caused by massive antennas.In this paper,we propose a deep learning based joint channel estimation and feedback framework,which comprehensively realizes the estimation,compression,and reconstruction of downlink channels in FDD massive MIMO systems.Two networks are constructed to perform estimation and feedback explicitly and implicitly.The explicit network adopts a multi-Signal-to-Noise-Ratios(SNRs)technique to obtain a single trained channel estimation subnet that works well with different SNRs and employs a deep residual network to reconstruct the channels,while the implicit network directly compresses pilots and sends them back to reduce network parameters.Quantization module is also designed to generate data-bearing bitstreams.Simulation results show that the two proposed networks exhibit excellent performance of reconstruction and are robust to different environments and quantization errors.

Enhancing Deep Learning Soil Moisture Forecasting Models by Integrating Physics-based Models

Accurate soil moisture(SM)prediction is critical for understanding hydrological processes.Physics-based(PB)models exhibit large uncertainties in SM predictions arising from uncertain parameterizations and insufficient representation of land-surface processes.In addition to PB models,deep learning(DL)models have been widely used in SM predictions recently.However,few pure DL models have notably high success rates due to lacking physical information.Thus,we developed hybrid models to effectively integrate the outputs of PB models into DL models to improve SM predictions.To this end,we first developed a hybrid model based on the attention mechanism to take advantage of PB models at each forecast time scale(attention model).We further built an ensemble model that combined the advantages of different hybrid schemes(ensemble model).We utilized SM forecasts from the Global Forecast System to enhance the convolutional long short-term memory(ConvLSTM)model for 1–16 days of SM predictions.The performances of the proposed hybrid models were investigated and compared with two existing hybrid models.The results showed that the attention model could leverage benefits of PB models and achieved the best predictability of drought events among the different hybrid models.Moreover,the ensemble model performed best among all hybrid models at all forecast time scales and different soil conditions.It is highlighted that the ensemble model outperformed the pure DL model over 79.5%of in situ stations for 16-day predictions.These findings suggest that our proposed hybrid models can adequately exploit the benefits of PB model outputs to aid DL models in making SM predictions.