Data preprocessing and preliminary results of the Moon-based Ultraviolet Telescope on the CE-3 lander

The Moon-based Ultraviolet Telescope （MUVT） is one of the payloads on the Chang＇e-3 （CE-3） lunar lander. Because of the advantages of having no at- mospheric disturbances and the slow rotation of the Moon, we can make long-term continuous observations of a series of important celestial objects in the near ultra- violet band （245-340 nm）, and perform a sky survey of selected areas, which can- not be completed on Earth. We can find characteristic changes in celestial brightness with time by analyzing image data from the MUVT, and deduce the radiation mech- anism and physical properties of these celestial objects after comparing with a phys- ical model. In order to explain the scientific purposes of MUVT, this article analyzes the preprocessing of MUVT image data and makes a preliminary evaluation of data quality. The results demonstrate that the methods used for data collection and prepro- cessing are effective, and the Level 2A and 2B image data satisfy the requirements of follow-up scientific researches.

Diabetes Type 2: Poincaré Data Preprocessing for Quantum Machine Learning

Quantum Machine Learning(QML)techniques have been recently attracting massive interest.However reported applications usually employ synthetic or well-known datasets.One of these techniques based on using a hybrid approach combining quantum and classic devices is the Variational Quantum Classifier(VQC),which development seems promising.Albeit being largely studied,VQC implementations for“real-world”datasets are still challenging on Noisy Intermediate Scale Quantum devices(NISQ).In this paper we propose a preprocessing pipeline based on Stokes parameters for data mapping.This pipeline enhances the prediction rates when applying VQC techniques,improving the feasibility of solving classification problems using NISQ devices.By including feature selection techniques and geometrical transformations,enhanced quantum state preparation is achieved.Also,a representation based on the Stokes parameters in the PoincaréSphere is possible for visualizing the data.Our results show that by using the proposed techniques we improve the classification score for the incidence of acute comorbid diseases in Type 2 Diabetes Mellitus patients.We used the implemented version of VQC available on IBM’s framework Qiskit,and obtained with two and three qubits an accuracy of 70%and 72%respectively.

DATA PREPROCESSING AND RE KERNEL CLUSTERING FOR LETTER

Many classifiers and methods are proposed to deal with letter recognition problem. Among them, clustering is a widely used method. But only one time for clustering is not adequately. Here, we adopt data preprocessing and a re kernel clustering method to tackle the letter recognition problem. In order to validate effectiveness and efficiency of proposed method, we introduce re kernel clustering into Kernel Nearest Neighbor classification(KNN), Radial Basis Function Neural Network(RBFNN), and Support Vector Machine(SVM). Furthermore, we compare the difference between re kernel clustering and one time kernel clustering which is denoted as kernel clustering for short. Experimental results validate that re kernel clustering forms fewer and more feasible kernels and attain higher classification accuracy.

Power Data Preprocessing Method of Mountain Wind Farm Based on POT-DBSCAN

Due to the frequent changes of wind speed and wind direction,the accuracy of wind turbine(WT)power prediction using traditional data preprocessing method is low.This paper proposes a data preprocessing method which combines POT with DBSCAN(POT-DBSCAN)to improve the prediction efficiency of wind power prediction model.Firstly,according to the data of WT in the normal operation condition,the power prediction model ofWT is established based on the Particle Swarm Optimization(PSO)Arithmetic which is combined with the BP Neural Network(PSO-BP).Secondly,the wind-power data obtained from the supervisory control and data acquisition(SCADA)system is preprocessed by the POT-DBSCAN method.Then,the power prediction of the preprocessed data is carried out by PSO-BP model.Finally,the necessity of preprocessing is verified by the indexes.This case analysis shows that the prediction result of POT-DBSCAN preprocessing is better than that of the Quartile method.Therefore,the accuracy of data and prediction model can be improved by using this method.

D-IMPACT: A Data Preprocessing Algorithm to Improve the Performance of Clustering

In this study, we propose a data preprocessing algorithm called D-IMPACT inspired by the IMPACT clustering algorithm. D-IMPACT iteratively moves data points based on attraction and density to detect and remove noise and outliers, and separate clusters. Our experimental results on two-dimensional datasets and practical datasets show that this algorithm can produce new datasets such that the performance of the clustering algorithm is improved.

Untargeted LC–MS Data Preprocessing in Metabolomics

Liquid chromatography–mass spectrometry(LC–MS)has enabled the detection of thousands of metabolite features from a single biological sample that produces large and complex datasets.One of the key issues in LC–MS-based metabolomics is comprehensive and accurate analysis of enormous amount of data.Many free data preprocessing tools,such as XCMS,MZmine,MAVEN,and MetaboAnalyst,as well as commercial software,have been developed to facilitate data processing.However,researchers are challenged by the inevitable and unconquerable yields of numerous false-positive peaks,and human errors while manually removing such false peaks.Even with continuous improvements of data processing tools,there can still be many mistakes generated during data preprocessing.In addition,many data preprocessing software exist,and every tool has its own advantages and disadvantages.Thereby,a researcher needs to judge what kind of software or tools to choose that most suit their vendor proprietary formats and goal of downstream analysis.Here,we provided a brief introduction of the general steps of raw MS data processing,and properties of automated data processing tools.Then,characteristics of mainly free data preprocessing software were summarized for researchers’consideration in conducting metabolomics study.

Short-Term Mosques Load Forecast Using Machine Learning and Meteorological Data

The tendency toward achieving more sustainable and green buildings turned several passive buildings into more dynamic ones.Mosques are the type of buildings that have a unique energy usage pattern.Nevertheless,these types of buildings have minimal consideration in the ongoing energy efficiency applications.This is due to the unpredictability in the electrical consumption of the mosques affecting the stability of the distribution networks.Therefore,this study addresses this issue by developing a framework for a short-term electricity load forecast for a mosque load located in Riyadh,Saudi Arabia.In this study,and by harvesting the load consumption of the mosque and meteorological datasets,the performance of four forecasting algorithms is investigated,namely Artificial Neural Network and Support Vector Regression(SVR)based on three kernel functions:Radial Basis(RB),Polynomial,and Linear.In addition,this research work examines the impact of 13 different combinations of input attributes since selecting the optimal features has a major influence on yielding precise forecasting outcomes.For the mosque load,the(SVR-RB)with eleven features appeared to be the best forecasting model with the lowest forecasting errors metrics giving RMSE,nRMSE,MAE,and nMAE values of 4.207 kW,2.522%,2.938 kW,and 1.761%,respectively.

基于CWT-RES34的风电机组叶片裂纹状态评估

为有效进行风电机组叶片运行时的裂纹状态评估,提出一种基于连续小波变换(Continue Wavelet Transform,CWT)和残差神经网络(Residual Networks,ResNet)结合的叶片裂纹状态评估方法。首先对叶片加速度振动信号做CWT后生成二维彩色时频图像,然后将图像分别作为训练集和测试集,使用34层ResNet进行训练和诊断,最后选取天津某风电场提供的1.5 MW风力发电机作为研究对象,根据其样本数据将叶片故障程度按照裂纹长度和宽度分为健康、轻微、中等、严重、危险5种状态,评估平均准确率高达98.23%,方法的有效性和可行性得到验证。

基于GA-BP神经网络的大型客机气流角估计方法

为了解决硬件冗余难以克服的气流角传感器共因故障问题,进一步提高飞机气流角信号的可靠性,研究了基于GABP神经网络的气流角估计方法。通过BP神经网络融合姿态角、加速度、风速等参数来实现不依赖气流角传感器的气流角估计;引入遗传算法对神经网络权值和阈值进行全局优化,提高估计精度;对某大型客机的试飞数据预处理后用于模型的训练和测试。仿真结果表明,训练完成的GA-BP神经网络模型对气流角的估计值贴近实际值,稳定性和精度明显高于BP神经网络。上述方法给飞机增加一个余度的气流角信号,可用于传感器故障时为飞机提供可靠的气流角信号。

引入神经网络极限学习机的关键数据查询模型

网络空间数据的结构具有较高相似性,海量数据的不断增量更新,导致关键数据查询结果存在冗余和偏离问题。因此提出基于神经网络极限学习机的关键数据查询方法。建模描述关键数据查询问题。基于此引入神经网络极限学习机,建立关键数据查询模型。预处理数据库中无用数据和重复数据做,通过输出权值范数的最小二乘解,避免算法陷入局部最优。结合输出矩阵,训练查询模型,输出结果结果即为关键数据查询结果。为证明上述方法的性能优势,设计对比实验,结果表明提出的方法应用于关键数据查询的均方根误差不超过1.2,平均绝对百分比误差最高为4.1%,关系数F可达0.6,网络节点的使用率低于20%。以上实验数据验证了上述方法数据查询精度较高,可应用性更强。

Predicting 3D Radiotherapy Dose-Volume Based on Deep Learning

Cancer is one of the most dangerous diseaseswith highmortality.One of the principal treatments is radiotherapy by using radiation beams to destroy cancer cells and this workflow requires a lot of experience and skill from doctors and technicians.In our study,we focused on the 3D dose prediction problem in radiotherapy by applying the deeplearning approach to computed tomography(CT)images of cancer patients.Medical image data has more complex characteristics than normal image data,and this research aims to explore the effectiveness of data preprocessing and augmentation in the context of the 3D dose prediction problem.We proposed four strategies to clarify our hypothesis in different aspects of applying data preprocessing and augmentation.In strategies,we trained our custom convolutional neural network model which has a structure inspired by the U-net,and residual blocks were also applied to the architecture.The output of the network is added with a rectified linear unit(Re-Lu)function for each pixel to ensure there are no negative values,which are absurd with radiation doses.Our experiments were conducted on the dataset of the Open Knowledge-Based Planning Challenge which was collected from head and neck cancer patients treatedwith radiation therapy.The results of four strategies showthat our hypothesis is rational by evaluating metrics in terms of the Dose-score and the Dose-volume histogram score(DVH-score).In the best training cases,the Dose-score is 3.08 and the DVH-score is 1.78.In addition,we also conducted a comparison with the results of another study in the same context of using the loss function.

基于机器学习的不平衡数据下个人信用评分预测模型研究

文章介绍了个人信用评分的基本概念,以及不平衡数据及其处理方法和机器学习算法在信用评分中的应用。然后,通过数据预处理,包括数据来源与特性、数据清洗与整理、数据不平衡分析、数据增强方法和效果评估,为后续模型构建提供基础。最后,使用实际数据集进行模型训练和测试,并评估模型的性能。实验结果表明,基于机器学习的不平衡数据下个人信用评分预测模型能够有效地预测个人信用风险,对于金融机构的风险管理和信贷决策具有重要意义。

卡尔曼滤波在海洋浮标数据预处理中的应用

【目的】优化自动化数据预处理方法,以提高海洋浮标数据质量。【方法】结合海洋浮标数据特征,提出了一种改进的自适应卡尔曼滤波自动化数据预处理方法,该方法通过箱型图进行异常值的检测,并采用方差受限的方法解决测量噪声导致的滤波发散问题。【结果与结论】海上工程应用和仿真实验结果表明,改进的算法计算开销低且不影响浮标系统的正常采集和数据融合工作,浮标数据采集率达100%,云数据中心数据接收率达97%。浮标采集的原始数据经过异常值修正和滤波降噪处理后,数据曲线更为平滑且符合随时间序列变化的规律,数据预处理效果良好。

基于深度学习的浮选回收率预测建模研究

针对现有浮选回收率预测模型拟合度不高、预测误差大等问题,以某铜矿实际工况数据为基础,利用箱图和滤波算法对数据进行预处理,采用传统机器学习算法(DT、SVR和RF算法)和深度学习算法(DNN和CNN算法)构建相应浮选回收率预测模型。对5种回收率预测模型的拟合效果、预测效果进行了对比分析,并采用现场数据进行验证。结果表明:传统机器学习算法模型中RF预测精度最佳,±2%误差区域命中率为80.1%,±4%误差区域命中率为93.0%;深度学习模型预测效果均优于传统机器学习算法模型,DNN和CNN预测模型的R~2分别为0.854、0.907,±2%误差区域命中率分别为91.6%、90.6%,±4%误差区域命中率分别为96.6%、98.1%。CNN模型略优于DNN模型,但训练耗时较长,深度学习算法模型中首选DNN模型。研究结果可为浮选回收率实时预测及浮选过程协同优化提供技术支持。

基于数据预处理和计算机VMD-LSTM-GPR的储能系统离子电池剩余寿命预测

离子电池剩余寿命影响储能系统运行能力,准确预测电池寿命,有助于判断系统的实时运行状态,为获得较为可靠的预测结果,提出基于数据预处理和计算机VMD-LSTM-GPR的储能系统离子电池剩余寿命预测方法。针对储能系统离子电池剩余寿命预测的相关理论问题进行研究,并联合储能数据预处理标准与计算机VMDLSTM-GPR模型,计算锂离子电池的容量退化能力,从而评估剩余电池寿命,实现基于数据预处理和计算机VMD-LSTM-GPR的储能系统离子电池剩余寿命预测。

Data Matrix二维条形码解码器图像预处理研究

DM码是一种常见的二维条形码,图像预处理是DM码解码器自动识别过程中的重要步骤。提出一种实用的DM码识别图像预处理方法。它没有使用传统的边缘检测和直线检测手段,因此受背景噪声、几何失真的影响较小。此外,使用了校正铁路线坐标,并按区域取样生成码流,显著提高了DM码的识别速度和识别率。实验结果表明,该算法可以克服DM码识别过程中易受噪声干扰、光照不均和几何失真等影响的问题。

纺机车间多源异构数据生产管理系统设计

针对纺织机械制造企业生产过程中的多源异构数据集成、传递和共享问题,结合企业实际生产情况,搭建面向企业业务流程模型,建立车间制造过程数据管理模型,对生产数据进行异常纠正、时间配准、时序数据补足等数据预处理;并采用基于本体的异构数据集成方法,实现纺织机械制造车间智能生产的数据集成与共享,为数字孪生平台、仿真优化决策提供数据支撑;设计和开发了数字化车间数据集成管理系统,通过融合SAP、SCADA等系统数据,实现生产进度跟踪、设备运行监控及生产相关的数据统计分析,并结合三维模型进行三维可视化,满足车间的数据管理需求。

面向喷浆机械臂电液比例控制系统的降噪处理研究

考虑到系统辨识数据的预处理能够提高喷浆机械臂电液比例控制系统的建模精度,采用小波变换滤波算法对采集的传感器数据进行滤波降噪处理。应用表明,在以sym5为小波基函数时,信噪比数值最大且均方根误差最小,降噪效果最好。滤波降噪结果能够为电液比例控制系统数学模型的精确辨识奠定基础。

基于NLMS和Autoformer的滚动轴承RUL预测

准确预测滚动轴承剩余使用寿命(Remaining Useful Life,RUL)对维护建筑机械设备稳定运行、保障生产安全具有重要的现实需求和应用价值。为提升滚动轴承RUL预测准确率,提出一种基于归一化最小均方(Normalized Least Mean Square,NLMS)自适应滤波器和Autoformer长序列预测模型的滚动轴承RUL预测新方法。使用NLMS自适应滤波器对滚动轴承原始振动信号进行降噪,从降噪振动信号中分段提取初始时域特征,采用Spearman相关系数进行特征筛选,经归一化后形成多维特征集;利用Autoformer模型中序列分解模块与自相关机制建立多维特征集与滚动轴承RUL之间的分段非线性映射,实现滚动轴承RUL预测;在PHM 2012数据集与XJTU-SY数据集上进行对比实验,结果表明该方法与已有方法相比可取得最低预测误差,均方根误差(Root Mean Squared Error,RMSE)与平均绝对误差(Mean Absolute Error,MAE)分别提升24.4%与47.2%,证明了该方法在滚动轴承RUL预测的有效性。

高空台液压加载系统试验智能运行技术研究

为了满足航空发动机高空模拟试验智能化需求,以高空台液压加载系统为研究对象,研究其试验智能运行的关键技术。通过深入分析液压加载系统设备组成及试验智能化存在的传感器数据利用不充分、控制精度不高和数据可视化展示不直观等问题,提出基于层次分析法的数据分组关联架构,设计数据融合架构对传感器数据进行预处理并对数据进行数据层、特征层和决策层融合。针对控制精度不高且须满足快速性的要求,提出一种基于设备特性与加载谱的智能复合控制框架用于智能化控制。针对液压加载系统子设备众多且易发生故障并存在性能退化的问题,提出基于深度学习的故障诊断方法与基于支持向量机的健康预测方法。同时,提出一种基于WebGL框架下的液压加载系统工艺流程可视化展示方法并建立了三维可视化模型,实现液压加载系统动态模拟的运行状态显示。