Spark计算框架在敏感地理信息检测中的应用研究

Research on the Application of Spark Computing Framework in Sensitive Geographic Information Detection

针对互联网地理信息涉密与安全问题,提出一种以Spark技术框架为基础的敏感地理信息检测算法,该算法与现有的检测算法相比,由于Spark算法不仅考虑了特征词与敏感词之间的直接匹配度,而且还考虑了两者之间的相似性敏感信息以及特征词在文本中的位置属性和权值情况等对种情况,使其具有更高的准确率、召回率以及F度量值,经并行化处理后,其运行效率明显高于单机模式,同时不影响其检测精度,可大大提升数据信息的处理速度和效率,值得在地理信息安全领域推广运用。

To ensure the security of internet geographic information,a sensitive geographic information detection algorithm based on spark technology framework is proposed.Compared with the existing algorithm,this algorithm considers both the direct matching degree between the feature words and the sensitive words,and the similarity between the sensitive information and the location of the feature words in the text attribute and weight condition,which results in higher accuracy,recall rate and F-measure.After parallel processing,its operation efficiency is significantly higher than that of the single machine mode,and the detection accuracy is not affected.This algorithm greatly improves the processing speed and efficiency of data information,which is worth popularizing in the field of geographic information security.