Filtering of Airborne Lidar Point Clouds for Complex Cityscapes

A novel filtering algorithm for Lidar point clouds is presented, which can work well for complex cityscapes. Its main features are filtering based on raw Lidar point clouds without previous triangulation or rasterization. 3D topological relations among points are used to search edge points at the top of discontinuities, which are key information to recognize the bare earth points and building points. Experiment results show that the proposed algorithm can preserve discontinuous features in the bare earth and has no impact of size and shape of buildings.

EFFECTS OF A CLOUD FILTERING METHOD FOR FENGYUN-3C MICROWAVE HUMIDITY AND TEMPERATURE SOUNDER MEASUREMENTS OVER OCEAN ON RETRIEVALS OF TEMPERATURE AND HUMIDITY

For Microwave Humidity and Temperature sounder(MWHTS) measurements over the ocean, a cloud filtering method is presented to filter out cloud-and precipitation-affected observations by analyzing the sensitivity of the simulated brightness temperatures of MWHTS to cloud liquid water, and using the root mean square error(RMSE)between observation and simulation in clear sky as a reference standard. The atmospheric temperature and humidity profiles are retrieved using MWHTS measurements with and without filtering by multiple linear regression(MLR),artificial neural networks(ANN) and one-dimensional variational(1DVAR) retrieval methods, respectively, and the effects of the filtering method on the retrieval accuracies are analyzed. The numerical results show that the filtering method can improve the retrieval accuracies of the MLR and the 1DVAR retrieval methods, but have little influence on that of the ANN. In addition, the dependencies of the retrieval methods upon the testing samples of brightness temperature are studied, and the results show that the 1DVAR retrieval method has great stability due to that the testing samples have great impact on the retrieval accuracies of the MLR and the ANN, but have little impact on that of the 1DVAR.

Recommendation algorithm of cloud computing system based on random walk algorithm and collaborative filtering model

The traditional collaborative filtering recommendation technology has some shortcomings in the large data environment. To solve this problem, a personalized recommendation method based on cloud computing technology is proposed. The large data set and recommendation computation are decomposed into parallel processing on multiple computers. A parallel recommendation engine based on Hadoop open source framework is established, and the effectiveness of the system is validated by learning recommendation on an English training platform. The experimental results show that the scalability of the recommender system can be greatly improved by using cloud computing technology to handle massive data in the cluster. On the basis of the comparison of traditional recommendation algorithms, combined with the advantages of cloud computing, a personalized recommendation system based on cloud computing is proposed.

Comparative Analysis of the Digital Terrain Models Extracted from Airborne LiDAR Point Clouds Using Different Filtering Approaches in Residential Landscapes

Light Detection And Ranging (LiDAR) is a well-established active remote sensing technology that can provide accurate digital elevation measurements for the terrain and non-ground objects such as vegetations and buildings, etc. Non-ground objects need to be removed for creation of a Digital Terrain Model (DTM) which is a continuous surface representing only ground surface points. This study aimed at comparative analysis of three main filtering approaches for stripping off non-ground objects namely;Gaussian low pass filter, focal analysis mean filter and DTM slope-based filter of varying window sizes in creation of a reliable DTM from airborne LiDAR point clouds. A sample of LiDAR data provided by the ISPRS WG III/4 captured at Vaihingen in Germany over a pure residential area has been used in the analysis. Visual analysis has indicated that Gaussian low pass filter has given blurred DTMs of attenuated high-frequency objects and emphasized low-frequency objects while it has achieved improved removal of non-ground object at larger window sizes. Focal analysis mean filter has shown better removal of nonground objects compared to Gaussian low pass filter especially at large window sizes where details of non-ground objects almost have diminished in the DTMs from window sizes of 25 × 25 and greater. DTM slope-based filter has created bare earth models that have been full of gabs at the positions of the non-ground objects where the sizes and numbers of that gabs have increased with increasing the window sizes of filter. Those gaps have been closed through exploitation of the spline interpolation method in order to get continuous surface representing bare earth landscape. Comparative analysis has shown that the minimum elevations of the DTMs increase with increasing the filter widow sizes till 21 × 21 and 31 × 31 for the Gaussian low pass filter and the focal analysis mean filter respectively. On the other hand, the DTM slope-based filter has kept the minimum elevation of the original data, that could be due to noise in the LiDAR data unchanged. Alternatively, the three approaches have produced DTMs of decreasing maximum elevation values and consequently decreasing ranges of elevations due to increases in the filter window sizes. Moreover, the standard deviations of the created DTMs from the three filters have decreased with increasing the filter window sizes however, the decreases have been continuous and steady in the cases of the Gaussian low pass filter and the focal analysis mean filters while in the case of the DTM slope-based filter the standard deviations of the created DTMs have decreased with high rates till window size of 31 × 31 then they have kept unchanged due to more increases in the filter window sizes.

MODEL RECONSTRUCTION FROM CLOUD DATA FOR RAPID PROTOTYPE MANUFACTURING

Model reconstruction from points scanned on existing physical objects is much important in a variety of situations such as reverse engineering for mechanical products, computer vision and recovery of biological shapes from two dimensional contours. With the development of measuring equipment, cloud points that contain more details of the object can be obtained conveniently. On the other hand, large quantity of sampled points brings difficulties to model reconstruction method. This paper first presents an algorithm to automatically reduce the number of cloud points under given tolerance. Triangle mesh surface from the simplified data set is reconstructed by the marching cubes algorithm. For various reasons, reconstructed mesh usually contains unwanted holes. An approach to create new triangles is proposed with optimized shape for covering the unexpected holes in triangle meshes. After hole filling, watertight triangle mesh can be directly output in STL format, which is widely used in rapid prototype manufacturing. Practical examples are included to demonstrate the method.

An Efficient Adaptive Failure Detection Mechanism for Cloud Platform Based on Volterra Series

Failure detection module is one of important components in fault-tolerant distributed systems,especially cloud platform.However,to achieve fast and accurate detection of failure becomes more and more difficult especially when network and other resources' status keep changing.This study presented an efficient adaptive failure detection mechanism based on volterra series,which can use a small amount of data for predicting.The mechanism uses a volterra filter for time series prediction and a decision tree for decision making.Major contributions are applying volterra filter in cloud failure prediction,and introducing a user factor for different QoS requirements in different modules and levels of IaaS.Detailed implementation is proposed,and an evaluation is performed in Beijing and Guangzhou experiment environment.

基于Bloom Filtering检测的安全重复数据删除技术分析

数据的不断增长推动了云计算、云存储的发展,大量数据被存储到云端,数据的不断积累占据了太多存储空间.为了节省空间,重复数据删除技术被提出并广泛使用.在原始信息锁加密的基础上进行改进,引入布隆过滤器来实现重复检测,继而完成安全存储.对方案性能进行分析后发现,可以实现基本的安全机密性,并降低了计算开销.

Implementation and Validation of the Optimized Deduplication Strategy in Federated Cloud Environment

Cloud computing technology is the culmination of technical advancements in computer networks,hardware and software capabilities that collectively gave rise to computing as a utility.It offers a plethora of utilities to its clients worldwide in a very cost-effective way and this feature is enticing users/companies to migrate their infrastructure to cloud platform.Swayed by its gigantic capacity and easy access clients are uploading replicated data on cloud resulting in an unnecessary crunch of storage in datacenters.Many data compression techniques came to rescue but none could serve the purpose for the capacity as large as a cloud,hence,researches were made to de-duplicate the data and harvest the space from exiting storage capacity which was going in vain due to duplicacy of data.For providing better cloud services through scalable provisioning of resources,interoperability has brought many Cloud Service Providers(CSPs)under one umbrella and termed it as Cloud Federation.Many policies have been devised for private and public cloud deployment models for searching/eradicating replicated copies using hashing techniques.Whereas the exploration for duplicate copies is not restricted to any one type of CSP but to a set of public or private CSPs contributing to the federation.It was found that even in advanced deduplication techniques for federated clouds,due to the different nature of CSPs,a single file is stored at private as well as public group in the same cloud federation which can be handled if an optimized deduplication strategy be rendered for addressing this issue.Therefore,this study has been aimed to further optimize a deduplication strategy for federated cloud environment and suggested a central management agent for the federation.It was perceived that work relevant to this is not existing,hence,in this paper,the concept of federation agent has been implemented and deduplication technique following file level has been used for the accomplishment of this approach.

A New Virtual Disk Mapping Method for the Cloud Desktop Storage Client

Integration of the cloud desktop and cloud storage platform is urgent for enterprises. However, current proposals for cloud disk are not satisfactory in terms of the decoupling of virtual computing and business data storage in the cloud desktop environment. In this paper, we present a new virtual disk mapping method for cloud desktop storage. In Windows, compared with virtual hard disk method of popular cloud disks, the proposed implementation of client based on the virtual disk driver and the file system filter driver is available for widespread desktop environments, especially for the cloud desktop with limited storage resources. Further more, our method supports customizable local cache storage, resulting in userfriendly experience for thinclients of the cloud desktop. The evaluation results show that our virtual disk mapping method performs well in the readwrite throughput of different scale files.

Illegal Access Detection in the Cloud Computing Environment

In this paper detection method for the illegal access to the cloud infrastructure is proposed. Detection process is based on the collaborative filtering algorithm constructed on the cloud model. Here, first of all, the normal behavior of the user is formed in the shape of a cloud model, then these models are compared with each other by using the cosine similarity method and by applying the collaborative filtering method the deviations from the normal behavior are evaluated. If the deviation value is above than the threshold, the user who gained access to the system is evaluated as illegal, otherwise he is evaluated as a real user.

基于云平台的铁路无线电信号DOA跟踪算法

在高速铁路场景下,准确估计和跟踪无线电信号的波达方向(Direction of Arrival, DOA)能够有效提升无线通信服务质量.然而,高速移动的无线信道具有快速时变特性,对信号处理的速度和准确性提出了更高的挑战.针对传统的基于信号子空间的DOA估计算法,由于巨大的计算量而无法应用于高速铁路快速时变系统中进行DOA跟踪的问题,提出了基于卡尔曼滤波和正交压缩近似投影子空间跟踪(Kalman Filter-Orthonormal Projection Approximation and Subspace Tracking of deflation, K-OPASTd)的DOA算法.首先,搭建基于云平台的铁路信号动态测向系统;然后,建立列车接收信号模型,提出K-OPASTd算法对DOA进行动态跟踪;最后,将本文提出的算法与OPASTd算法所得到的估计角度的均方根误差进行仿真对比实验.研究结果表明:信噪比均为10dB时,本文所提算法的均方根误差比OPASTd算法低约60%;阵元均为20时,K-OPASTd算法的均方根误差比OPASTd算法低约80%.

基于多平面分割和矩阵变换的航摄边坡点云滤波算法

点云滤波是实现地面点与非地面点分离,获取最真实地面点云的重要处理手段,是进行公路边坡点云灾害识别的基础.为了克服传统点云滤波算法在边坡场景下处理速度慢、结果精度低和误差大等问题,提出了基于多平面分割和矩阵变换的航摄边坡点云滤波算法.该方法首先利用基于曲率的区域生长算法对边坡进行多平面分割,得到多个边坡子点云;其次拟合得到边坡子点云平面模型,再利用旋转矩阵将边坡子点云进行空间转换至水平面;然后通过模拟布料下沉并设置距离阈值分离出非地面点;最后再次利用旋转矩阵的逆矩阵进行空间位置还原,进而得到滤波后的边坡点云.利用精细贴近仿地航线设计方法获取高精度点云模型以在不同的边坡场景下进行算法测试,并与其他传统滤波算法结果进行对比,结果表明:在所有的试验中,本文算法的总误差分别为7.11%、4.15%、1.45%、4.41%,在所有测试算法中最小;Kappa系数分别为0.77、0.90、0.96、0.90,在所有测试算法中最大.本文提出的算法在面对地形和植被情况复杂的边坡情景下,有着较高的准确性以及较强的适用性,为公路边坡点云滤波提供了新的解决方案.

基于多传感融合的巷道三维空间映射

针对我国煤矿掘进工作面智能感知能力不足的问题,提出了一种基于多传感融合的煤矿巷道三维空间映射方法。该方法利用激光雷达等3D传感器预览煤矿巷道环境信息,并构建实时自主映射模型,为大型煤机装备提供空间感知信息。基于姿态感知理论的多传感融合技术,对扩展卡尔曼滤波器算法进行优化,通过局部误差状态滤波估计和全局状态迭代估计,提出了一种基于距离残差的空间映射方法,实现了在几何退化的巷道环境下全局地图的快速更新和映射的高精度。其主要贡献在于将多传感器数据进行融合,构建出高精度的地下三维地图,并提高了巷道环境的智能感知能力和自主操作水平。首先,采用先进的激光雷达(LiDAR)传感器获取巷道内部的点云数据,提取点云特征,并建立帧间特征映射模型,从而构建出厘米级别的地下三维地图。同时,通过迭代误差状态的卡尔曼滤波器实现激光雷达与惯性导航的数据融合,提高了系统的鲁棒性,确保了地下三维地图的准确性和稳定性。此外,还考虑了井下粉尘和水雾等因素对巷道三维空间映射精度的影响,优化卡尔曼滤波增益调节激光雷达里程计权重,增强了低质量浓度粉尘条件下三维空间映射的环境适应性。实验结果表明,相较于LeGO-LOAM和LINS,笔者提出的三维空间映射方法在轨迹估计准确度、映射地图的点云数量以及点云密度等方面均表现更优。笔者所提出的方法可用于高精度、快速更新三维地图的自主掘进装备,提高煤矿掘进工作面的智能化水平,为巷道环境的智能化感知和自主作业提供了数据支持。

基于点云反射特性的前方道路附着系数估计方法研究

路面附着系数是影响自动驾驶系统决策控制策略的重要因素。为实现对道路附着系数前瞻性的高精度感知,本文基于车载激光雷达设计了一种新的路面附着系数估计方法。首先采集了干燥柏油路面、混凝土路面、湿滑柏油路面、结冰路面和积雪路面构建道路数据集;基于使用布料模拟滤波和RANSAC算法进行了道路点云提取、基于高斯滤波去除反射率异常噪点;根据点云反射率随距离和入射角变化的规律将路面划分为不同区域分别提取特征;基于深度神经网络构建了道路识别模型,并基于采集数据集进行了训练,最后基于路面材质和峰值附着系数的统计经验确定了前方道路的附着系数。测试结果表明,本文提出的算法道路类型辨识精度超过99.3%,算法平均运行周期55ms,可实现实时高精度的路面峰值附着系数估计。

矿区沉陷DEM多重滤波方法研究

针对传统地表移动监测方法周期较长、工作量大的问题,通过无人机LiDAR和点云滤波获取地面点云,并构建沉陷DEM,实现地表沉陷监测的方法具有快速、高效的优势;由于现有点云滤波和插值算法构建的沉陷DEM模型仍会包含噪声,限制了该技术在矿区的普及,因此,进一步研究了沉陷DEM噪声的去除方法,对比分析了多重滤波与经典滤波方法。实验分析结果表明:在几种去噪方法中,中值滤波组合维纳滤波的去噪效果最好,保留了下沉盆地的细节特征,能够满足矿区地表形变监测的基本要求。

面向室内场景三维重建的分区联合双边滤波方法

基于RGB-D传感器的三维重建在高精度制图中应用广泛,然而深度相机采集的图像存在深度值缺失和噪声等问题,影响了三维点云建图的准确度。针对此问题,提出分区联合双边滤波算法。该算法依据深度图像和灰度图像的左右差异分析像素置信度,并对深度图像中缺失像素做插值处理,实现了对图像基于置信度的分区联合双边滤波。采用Middbur标准数据库和Fast Sensor Motion Dataset数据集进行定性分析和定量对比,证明分区联合双边滤波算法有效平滑了噪声。将该算法应用于三维重建,实验结果表明该算法有效修复了深度图像,提高了三维点云建图和位姿估计的精度。

基于筛选策略的动态环境下激光SLAM算法

现有的同步定位与建图(SLAM)方法在理想条件下运行稳定,但在动态环境中会因移动物体特征点云的误匹配导致定位误差增大。为解决此问题,提出了一种动态点云检测算法。首先利用惯性测量装置信息对点云数据预处理,包含去畸变等操作;然后剔除地面点云,采用弯曲体素结构对非地面点云进行聚类;接着,通过匈牙利算法关联和匹配两帧之间的聚类,同时利用惯性信息统一坐标系;最后设计一种筛选策略,先用边界框交并比和质心速度粗略筛选动态聚类,再用z轴(高度)分布相似性进行精细筛选。实验结果表明,所提算法能够识别并滤除实验环境中的大部分动态点云聚类;与LIO-SAM算法相比,四种场景下的定位均方根误差平均降低了17.75%;平均精确率和召回率相比Removert分别提升14.81%和5.90%。

基于三维激光点云的序列运动图像点目标快速跟踪方法

由于现有方法未充分考虑小目标和遮挡目标检测的问题,导致目标跟踪效果不佳,由此针对点目标跟踪较为困难的问题,提出基于三维激光点云的序列运动图像点目标快速跟踪方法。首先下采样序列运动图像三维激光点云并去除其中的地面数据,通过动态阈值改进欧式聚类方法,分割图像为目标和背景,然后改进SECOND算法,在目标检测阶段融入自适应空间特征融合模块和二维卷积神经网络,同时采用3D DIoU替代Smooth L1作为损失函数,提升SECOND算法的目标检测性能,最后在激光雷达坐标系中构建各点目标的三维中心,利用3D卡尔曼滤波器连续跟踪目标,以交并比和欧式距离为度量标准,通过贪婪算法匹配最近邻目标,实现序列运动图像点目标快速跟踪。实验结果表明,所提方法IoU值更高,可达到0.971,且对目标的跟踪更理想。

一种DEM辅助下的LiDAR点云PTD滤波改进算法

针对传统渐进加密不规则三角网(PTD)滤波算法在复杂地形环境下需要反复调试地面点判断参数才能获得较好结果的局限性,以往期DEM数据提取的地形高程和地形梯度为辅助,改进PTD中初始地面种子点的选取方法,优化地面点判断参数,并对往期DEM数据和现势LiDAR点云数据之间的地形变化进行检测和处理,适用于不同坡度地形条件的复杂地形,滤波效果较好。对比分析实验数据精度可知,该算法能有效降低I类与II类误差,且样本分类精度均在90%以上,说明DEM辅助可切实提高PTD滤波算法的精度。

无人机LiDAR点云与无人机影像匹配点云分析比较

随着无人机技术的不断发展,无人机数码航测技术和无人机LiDAR技术在测量领域的应用越来越广泛。为分析无人机LiDAR点云和无人机影像匹配点云2种点云的差异,该文通过对西南某铁路一个测区在同一飞行高度的情况下同时进行无人机数码航摄及无人机LiDAR航摄2种方式航摄。对2种不同的摄影方式获取的点云进行比较,分析出2种方法获取点云在形态表现、滤波分类,以及利用2种点云制作DEM高程精度方面的差异,为实际工程航飞方式的选择提供一个参考。