一种基于特征加权的K Nearest Neighbor算法

传统的KNN算法一般采用欧式距离公式度量两样本间的距离.由于在实际样本数据集合中每一个属性对样本的贡献作用是不尽相同的,通常采用加权欧式距离公式.笔者提出一种计算权重的方法,即基于特征加权KNN算法.经实验证明,该算法与经典的赋权算法相比具有较好的分类效果.

Empirical Mode Decomposition-k Nearest Neighbor Models for Wind Speed Forecasting

Hybrid model is a popular forecasting model in renewable energy related forecasting applications. Wind speed forecasting, as a common application, requires fast and accurate forecasting models. This paper introduces an Empirical Mode Decomposition (EMD) followed by a k Nearest Neighbor (kNN) hybrid model for wind speed forecasting. Two configurations of EMD-kNN are discussed in details: an EMD-kNN-P that applies kNN on each decomposed intrinsic mode function (IMF) and residue for separate modelling and forecasting followed by summation and an EMD-kNN-M that forms a feature vector set from all IMFs and residue followed by a single kNN modelling and forecasting. These two configurations are compared with the persistent model and the conventional kNN model on a wind speed time series dataset from Singapore. The results show that the two EMD-kNN hybrid models have good performance for longer term forecasting and EMD-kNN-M has better performance than EMD-kNN-P for shorter term forecasting.

基于K-Nearest Neighbor和神经网络的糖尿病分类研究

为实现糖尿病的早期筛查,提高对糖尿病分类的准确度,在研究有关糖尿病危险因素的基础上,增加糖化血红蛋白作为糖尿病早期筛查的特征之一。研究中选取与人类最为相似的食蟹猴作为研究对象,利用年龄、血压、腹围、BMI、糖化血红蛋白以及空腹血糖作为特征输入,将正常、糖尿病前期和糖尿病作为类别输出,利用K-Nearest Neighbor(KNN)和神经网络两种方法对其分类。发现在增加糖化血红蛋白作为分类特征之一时,KNN(K=3)和神经网络的分类准确率分别为81.8%和92.6%,明显高于没有这一特征时的准确率(68.1%和89.7%),KNN和神经网络都可以对食蟹猴数据进行分类和识别,起到早期筛查作用。

基于组合加权k近邻分类的无线传感网络节点复制攻击检测方法

无线传感网络节点体积小,隐蔽性强,节点复制攻击检测的难度较大,为此提出一种基于组合加权k近邻分类的无线传感网络节点复制攻击检测方法。通过信标节点的空间位置数据与相距跳数得出各节点之间的相似程度,结合高斯径向基核函数求解未知节点的横轴、纵轴的空间坐标,确定各网络节点的空间位置;根据网络节点的属性特征与投票机制建立节点复制攻击模型,凭借组合加权k近邻分类法划分节点类型,并将结果传送至簇头节点,由簇头节点做出最后的仲裁,识别出节点复制攻击行为。仿真结果表明,所提方法的节点复制攻击检测率最大值为99.5%,最小值为97.9%,对节点复制攻击检测的耗时为5.41 s,通信开销数据包数量最大值为209个,最小值为81个。

基于数字孪生与k-近邻算法的车间设备运行状态预测研究

由于传统车间设备运行状态预测不能有效利用历史数据进行学习,实时响应能力有限,难以在复杂调度环境中取得良好效果,因此文章提出一种数字孪生与k-近邻算法相结合的车间设备运行状态预测模型。构建车间设备实体在信息空间的数字孪生模型,并建立设备实体与模型之间的映射关系,从而获取实时特征数据,即设备的运行状态特征数据。运用k-近邻算法计算实时特征数据与历史数据之间的欧几里得距离,即计算设备当前运行状态与历史已知状态的相似度,最终通过前k个距离所对应的设备历史运行状态数据,预测设备的当前运行状态。该模型的本质是通过数字孪生的实时数据采集,获取指定设备运行状态特征数据,运用k-近邻算法预测设备的实时运行状态。相较以往研究,本研究贡献在于提高设备实时运行状态预测的准确率。如果将数字孪生、k-近邻算法与具备自我学习能力的相关算法相结合,模型的预测效果会更好。

基于不规则区域划分方法的k-Nearest Neighbor查询算法

随着越来越多的数据累积,对数据处理能力和分析能力的要求也越来越高.传统k-Nearest Neighbor(k NN)查询算法由于其容易导致计算负载整体不均衡的规则区域划分方法及其单个进程或单台计算机运行环境的较低数据处理能力.本文提出并详细介绍了一种基于不规则区域划分方法的改进型k NN查询算法,并利用对大规模数据集进行分布式并行计算的模型Map Reduce对该算法加以实现.实验结果与分析表明,Map Reduce框架下基于不规则区域划分方法的k NN查询算法可以获得较高的数据处理效率,并可以较好的支持大数据环境下数据的高效查询.

应用非线性KNN数据搜索的三维叠前自由表面多次波预测

自由表面多次波预测(SRMP)是自由表面多次波消除(SRME)以及成像的重要环节。SRME技术尽管有效,但理论上需要规则而密集的地震数据采集方式。然而实际炮点、检波点空间分布稀疏,地震数据不能满足SRME理论要求,常规的做法是在SRME之前将地震数据规则化。为了避免数据规则化环节,首先建立索引数据树管理三维叠前地震数据,并采用基于树形数据结构的非线性K近邻算法(KNN)从地震数据中实时搜索两道近似地震数据;然后利用动校—反动校消除实时搜索得到的近似地震道与实际地震道之间的旅行时误差;由以上两步获得单道孔径内任意向下反射点(DRP)所需要的两道地震数据用于SRMP。单道孔径内任意DRP均可由SRMP预测对应的多次波模型道,叠加所有DRP对应的预测结果可获得该道稳定的多次波模型数据。将该方法用于扩展的三维Pluto模型数据,结果表明该方法能有效预测三维自由表面多次波,从而保证高质量的自由表面多次波衰减结果。实际地震数据的应用证明了方法的实用性。

基于密文KNN检索的室内定位隐私保护算法

在定位请求服务中,如何保护用户的位置隐私和位置服务提供商(Localization service provider,LSP)的数据隐私是关系到WiFi指纹定位应用的一个具有挑战性的问题。基于密文域的K-近邻(K-nearest neighbors,KNN)检索,本文提出了一种适用于三方的定位隐私保护算法,能有效提升对LSP指纹信息隐私的保护强度并降低计算开销。服务器和用户分别完成对指纹信息和定位请求的加密,而第三方则基于加密指纹库和加密定位请求,在隐私状态下完成对用户的位置估计。所提算法把各参考点的位置信息随机嵌入指纹,可避免恶意用户获取各参考点的具体位置;进一步利用布隆滤波器在隐藏接入点信息的情况下,第三方可完成参考点的在线匹配,实现对用户隐私状态下的粗定位,可与定位算法结合降低计算开销。在公共数据集和实验室数据集中,对两种算法的安全、开销和定位性能进行了全面的评估。与同类加密算法比较,在不降低定位精度的情况下,进一步增强了对数据隐私的保护。

基于非线性定向降维的k近邻致密砂岩储层含气性预测方法

本文提出利用全连接人工神经网络(FANN)进行非线性定向降维并结合k近邻方法分类的致密砂岩储层含气性预测方法。k近邻方法能够依据样本间相似性,针对性地选取对应的部分训练样本建立局部模型,但缺乏含气敏感属性的提取能力,并面临“维度灾难”问题。由于样本中的含气性特征虽然是重要特征,但不一定是主要特征。线性降维方法难以准确提取这些特征。我们通过训练一个合理搭建的FANN并输出其中间低维特征实现对训练样本和待预测样本的非线性定向降维。这种做法既能够增加样本的可分性,同时避免了通过样本低维空间中的最大差异实现降维而改变样本固有分布特征的问题。另外,k近邻方法对降维数据进行分类,还等效于用k近邻方法替代FANN中具有线性分类作用的深层结构,有利于白化FANN的黑箱问题。本方法在具体的物理场景中挖掘机器学习算法的物理内涵,提高了智能方法的可解释性。将本方法应用在实际数据中,预测结果显示本方法能够一定程度上挖掘局部波形属性中蕴含的含气敏感信息,实现小范围的致密砂岩储层精确刻画。

基于K-近邻算法改进粒子群-反向传播算法的织物质量预测技术

为解决现有下机织物质量差异性较大且传统验布环节时间较长等问题,提出基于K-近邻(KNN)算法改进粒子群-反向传播(PSO-BP)算法的织物质量等级预测方法。首先分析织物质量预测模型,整理织物疵点类型与织物质量等级分类,并根据织物疵点特征将疵点划分为6类;其次选取14种影响织物质量的因子作为模型输入量;然后详细介绍依据KNN与PSO原理进行织物质量预测流程;最后以浙江兰溪某纺织厂近3个月16186条织物生产数据为例,建立织物质量预测模型。结果显示:该技术对织物质量预测的准确率达到98.054%,且训练时长仅需4.8 s,在保证织物质量预测准确性的同时,极大缩短了检测时间,提高了织造车间生产效率。

支持K-近邻搜索的区块链泛用型数据隐私保护方法

随着区块链泛用型数据应用场景的不断扩大,其涉及的数据隐私越来越多,数据隐私泄露可能导致个人信用受损,带来财产损失甚至身份盗用等.合理高效地进行用户身份信息及数据隐私保护是确保区块链泛用型数据安全的关键问题.为此,本文提出了支持K-近邻搜索的区块链泛用型数据隐私保护方法,采集区块链泛用型数据,利用k-prototypes算法,聚类区块链泛用型数据,并控制分类属性和数值属性.在此基础上,本文支持K-近邻搜索,建立区块链泛用型数据系统模型,确定区块链泛用型数据敏感区域,实现区块链泛用型数据隐私保护.实验结果表明,本文所提方法具有较好的区块链泛用型数据隐私保护效果,能够有效提高区块链泛用型数据隐私保护安全性,缩短区块链泛用型数据隐私保护时间.

坝肩岩体质量LDA-KNN分类模型

工程岩体质量分级评价对工程的安全、设计、经济效益等有重要影响。针对当前岩级划分方法中存在不确定性,人为因素干扰和忽视了传统定性分级中对岩体质量评价的重要性等问题,本文通过在工程实际中搜集样本建立数据库,从工程的实际需求出发,选择岩体完整性系数(K v)、结构面间距(D)、岩石质量指标(RQD)等合适的评价指标,通过引入LDA(Linear Discriminant Analysis)降维方法和K近邻分析(K-Nearest-Neighbor,KNN)相结合的多分类模型,实现了岩体的非线性分级预测。通过定性定量相结合实现了岩体多因素,多指标的综合分级,并解决了多指标判断时信息冗余,复杂程度高的问题。与其他判别方案相比较,模型得出的结果准确率高,符合工程实际,减少了人为因素的影响,体现出较强的预测判别能力。该研究为水电站大坝坝肩处的平硐岩体质量划分提出了一种可行的预测方案。

基于AKNN异常检验与ADPC聚类的低压台区拓扑识别方法

低压台区拓扑信息的准确记录是进行台区线损分析、三相不平衡治理等工作的基础。针对目前拓扑档案排查成本高且效率低的问题,提出一种基于自适应k近邻(adaptive k nearest neighbor,AKNN)异常检验和自适应密度峰值(adaptive density peaks clustering,ADPC)聚类的低压台区拓扑识别方法。该方法利用动态时间弯曲(dynamic time warping,DTW)距离度量低压台区用户间电压序列的相似性,通过AKNN异常检验算法检验并校正异常的用户与变压器之间的关系(简称“户变关系”),在得到正确户变关系的基础上,采用ADPC聚类算法对台区内用户进行相位识别;最后,通过实际台区算例分析验证了该方法不需要人为设置参数,能有效实现低压台区的拓扑识别,具有较高的适用性与准确性。

融合动态K近邻Slope_One的协同过滤推荐算法

传统协同过滤推荐算法存在数据稀疏的问题,这会导致算法精确度不足。Slope_One算法简单高效,可以预测用户对某个物品的评分。因此,论文提出融合动态K近邻Slope_One的协同过滤推荐算法,提高推荐算法的精确度。首先利用改进余弦相似度公式计算用户相似度,筛选出K个近邻用户进行平均评分偏差计算,利用Slope_One算法预测相应的用户评分并对评分矩阵进行有效填充,然后在新的评分矩阵上,利用基于物品的协同过滤算法进行推荐。

基于IKNN和LOF的变压器回复电压数据清洗方法研究

基于回复电压极化谱提取特征参量是目前广泛应用的变压器油纸绝缘状态评估方法,但极化谱易受工况干扰、人工失误等因素影响而出现特征数据异常的情况,严重降低评估准确性。针对上述问题,该文提出了一种基于局部离群因子(LOF)和改进K最近邻(IKNN)的回复电压数据清洗方法。首先,选取回复电压极化谱的回复电压极大值Urmax、初始斜率Sr与主时间常数tcdom作为老化特征参量,并基于LOF算法对非标准极化谱中的异常特征量数据进行识别与筛除。其次,利用模糊C均值(FCM)聚类算法减小噪声点对KNN算法的干扰,并通过加权欧氏距离标度突出各特征量间的关联性,进而构建出基于IKNN的数据填补模型架构以实现特征缺失数据的填补。最后,代入多组实测数据验证所提数据清洗方法的实效性。结果表明,数据清洗后的状态评估准确率相较于原有数据上升了50%左右,有效提高了变压器回复电压数据质量,为准确感知变压器运行状况奠定坚实的基础。

Real-Time Spreading Thickness Monitoring of High-core Rockfill Dam Based on K-nearest Neighbor Algorithm

During the storehouse surface rolling construction of a core rockfilldam, the spreading thickness of dam face is an important factor that affects the construction quality of the dam storehouse' rolling surface and the overallquality of the entire dam. Currently, the method used to monitor and controlspreading thickness during the dam construction process is artificialsampling check after spreading, which makes it difficult to monitor the entire dam storehouse surface. In this paper, we present an in-depth study based on real-time monitoring and controltheory of storehouse surface rolling construction and obtain the rolling compaction thickness by analyzing the construction track of the rolling machine. Comparatively, the traditionalmethod can only analyze the rolling thickness of the dam storehouse surface after it has been compacted and cannot determine the thickness of the dam storehouse surface in realtime. To solve these problems, our system monitors the construction progress of the leveling machine and employs a real-time spreading thickness monitoring modelbased on the K-nearest neighbor algorithm. Taking the LHK core rockfilldam in Southwest China as an example, we performed real-time monitoring for the spreading thickness and conducted real-time interactive queries regarding the spreading thickness. This approach provides a new method for controlling the spreading thickness of the core rockfilldam storehouse surface.

Mapping aboveground biomass by integrating geospatial and forest inventory data through a k-nearest neighbor strategy in North Central Mexico

As climate change negotiations progress,monitoring biomass and carbon stocks is becoming an important part of the current forest research.Therefore,national governments are interested in developing forest-monitoring strategies using geospatial technology.Among statistical methods for mapping biomass,there is a nonparametric approach called k-nearest neighbor(kNN).We compared four variations of distance metrics of the kNN for the spatially-explicit estimation of aboveground biomass in a portion of the Mexican north border of the intertropical zone.Satellite derived,climatic,and topographic predictor variables were combined with the Mexican National Forest Inventory(NFI)data to accomplish the purpose.Performance of distance metrics applied into the kNN algorithm was evaluated using a cross validation leave-one-out technique.The results indicate that the Most Similar Neighbor(MSN)approach maximizes the correlation between predictor and response variables(r=0.9).Our results are in agreement with those reported in the literature.These findings confirm the predictive potential of the MSN approach for mapping forest variables at pixel level under the policy of Reducing Emission from Deforestation and Forest Degradation(REDD+).

Support Vector Machine-Based Fault Diagnosis of Power Transformer Using k Nearest-Neighbor Imputed DGA Dataset

Missing values are prevalent in real-world datasets and they may reduce predictive performance of a learning algorithm. Dissolved Gas Analysis (DGA), one of the most deployable methods for detecting and predicting incipient faults in power transformers is one of the casualties. Thus, this paper proposes filling-in the missing values found in a DGA dataset using the k-nearest neighbor imputation method with two different distance metrics: Euclidean and Cityblock. Thereafter, using these imputed datasets as inputs, this study applies Support Vector Machine (SVM) to built models which are used to classify transformer faults. Experimental results are provided to show the effectiveness of the proposed approach.

Pruned fuzzy K-nearest neighbor classifier for beat classification

Arrhythmia beat classification is an active area of research in ECG based clinical decision support systems. In this paper, Pruned Fuzzy K-nearest neighbor (PFKNN) classifier is proposed to classify six types of beats present in the MIT-BIH Arrhythmia database. We have tested our classifier on ~ 103100 beats for six beat types present in the database. Fuzzy KNN (FKNN) can be implemented very easily but large number of training examples used for classification can be very time consuming and requires large storage space. Hence, we have proposed a time efficient Arif-Fayyaz pruning algorithm especially suitable for FKNN which can maintain good classification accuracy with appropriate retained ratio of training data. By using Arif-Fayyaz pruning algorithm with Fuzzy KNN, we have achieved a beat classification accuracy of 97% and geometric mean of sensitivity of 94.5% with only 19% of the total training examples. The accuracy and sensitivity is comparable to FKNN when all the training data is used. Principal Component Analysis is used to further reduce the dimension of feature space from eleven to six without compromising the accuracy and sensitivity. PFKNN was found to robust against noise present in the ECG data.

A Short-Term Traffic Flow Forecasting Method Based on a Three-Layer K-Nearest Neighbor Non-Parametric Regression Algorithm

Short-term traffic flow is one of the core technologies to realize traffic flow guidance. In this article, in view of the characteristics that the traffic flow changes repeatedly, a short-term traffic flow forecasting method based on a three-layer K-nearest neighbor non-parametric regression algorithm is proposed. Specifically, two screening layers based on shape similarity were introduced in K-nearest neighbor non-parametric regression method, and the forecasting results were output using the weighted averaging on the reciprocal values of the shape similarity distances and the most-similar-point distance adjustment method. According to the experimental results, the proposed algorithm has improved the predictive ability of the traditional K-nearest neighbor non-parametric regression method, and greatly enhanced the accuracy and real-time performance of short-term traffic flow forecasting.