Multiple Pedestrian Detection and Tracking in Night Vision Surveillance Systems

Pedestrian detection and tracking are vital elements of today’s surveillance systems,which make daily life safe for humans.Thus,human detection and visualization have become essential inventions in the field of computer vision.Hence,developing a surveillance system with multiple object recognition and tracking,especially in low light and night-time,is still challenging.Therefore,we propose a novel system based on machine learning and image processing to provide an efficient surveillance system for pedestrian detection and tracking at night.In particular,we propose a system that tackles a two-fold problem by detecting multiple pedestrians in infrared(IR)images using machine learning and tracking them using particle filters.Moreover,a random forest classifier is adopted for image segmentation to identify pedestrians in an image.The result of detection is investigated by particle filter to solve pedestrian tracking.Through the extensive experiment,our system shows 93%segmentation accuracy using a random forest algorithm that demonstrates high accuracy for background and roof classes.Moreover,the system achieved a detection accuracy of 90%usingmultiple templatematching techniques and 81%accuracy for pedestrian tracking.Furthermore,our system can identify that the detected object is a human.Hence,our system provided the best results compared to the state-ofart systems,which proves the effectiveness of the techniques used for image segmentation,classification,and tracking.The presented method is applicable for human detection/tracking,crowd analysis,and monitoring pedestrians in IR video surveillance.

Tracking Pedestrians Under Occlusion in Parking Space

Many traffic accidents occur in parking lots.One of the serious safety risks is vehicle-pedestrian conflict.Moreover,with the increasing development of automatic driving and parking technology,parking safety has received significant attention from vehicle safety analysts.However,pedestrian protection in parking lots still faces many challenges.For example,the physical structure of a parking lot may be complex,and dead corners would occur when the vehicle density is high.These lead to pedestrians’sudden appearance in the vehicle’s path from an unexpected position,resulting in collision accidents in the parking lot.We advocate that besides vehicular sensing data,high-precision digital map of the parking lot,pedestrians’smart device’s sensing data,and attribute information of pedestrians can be used to detect the position of pedestrians in the parking lot.However,this subject has not been studied and explored in existing studies.Tofill this void,this paper proposes a pedestrian tracking framework integrating multiple information sources to provide pedestrian position and status information for vehicles and protect pedestrians in parking spaces.We also evaluate the proposed method through real-world experiments.The experimental results show that the proposed framework has its advantage in pedestrian attribute information extraction and positioning accuracy.It can also be used for pedestrian tracking in parking spaces.

Segmentation Based Real Time Anomaly Detection and Tracking Model for Pedestrian Walkways

Presently,video surveillance is commonly employed to ensure security in public places such as traffic signals,malls,railway stations,etc.A major chal-lenge in video surveillance is the identification of anomalies that exist in it such as crimes,thefts,and so on.Besides,the anomaly detection in pedestrian walkways has gained significant attention among the computer vision communities to enhance pedestrian safety.The recent advances of Deep Learning(DL)models have received considerable attention in different processes such as object detec-tion,image classification,etc.In this aspect,this article designs a new Panoptic Feature Pyramid Network based Anomaly Detection and Tracking(PFPN-ADT)model for pedestrian walkways.The proposed model majorly aims to the recognition and classification of different anomalies present in the pedestrian walkway like vehicles,skaters,etc.The proposed model involves panoptic seg-mentation model,called Panoptic Feature Pyramid Network(PFPN)is employed for the object recognition process.For object classification,Compact Bat Algo-rithm(CBA)with Stacked Auto Encoder(SAE)is applied for the classification of recognized objects.For ensuring the enhanced results better anomaly detection performance of the PFPN-ADT technique,a comparison study is made using Uni-versity of California San Diego(UCSD)Anomaly data and other benchmark data-sets(such as Cityscapes,ADE20K,COCO),and the outcomes are compared with the Mask Recurrent Convolutional Neural Network(RCNN)and Faster Convolu-tional Neural Network(CNN)models.The simulation outcome demonstrated the enhanced performance of the PFPN-ADT technique over the other methods.

Strong Tracking Particle Filter Based on the Chi-Square Test for Indoor Positioning

In recent years,a number of wireless indoor positioning(WIP),such as Bluetooth,Wi-Fi,and Ultra-Wideband(UWB)technologies,are emerging.However,the indoor environment is complex and changeable.Walls,pillars,and even pedestrians may block wireless signals and produce non-line-of-sight(NLOS)deviations,resulting in decreased positioning accuracy and the inability to provide people with real-time continuous indoor positioning.This work proposed a strong tracking particle filter based on the chi-square test(SPFC)for indoor positioning.SPFC can fuse indoor wireless signals and the information of the inertial sensing unit(IMU)in the smartphone and detect the NLOS deviation through the chi-square test to avoid the influence of the NLOS deviation on the final positioning result.Simulation experiment results show that the proposed SPFC can reduce the positioning error by 15.1%and 12.3% compared with existing fusion positioning systems in the LOS and NLOS environment.

A robust system for real-time pedestrian detection and tracking

A real-time pedestrian detection and tracking system using a single video camera was developed to monitor pedestrians. This system contained six modules: video flow capture, pre-processing, movement detection, shadow removal, tracking, and object classification. The Gaussian mixture model was utilized to extract the moving object from an image sequence segmented by the mean-shift technique in the pre-processing module. Shadow removal was used to alleviate the negative impact of the shadow to the detected objects. A model-free method was adopted to identify pedestrians. The maximum and minimum integration methods were developed to integrate multiple cues into the mean-shift algorithm and the initial tracking iteration with the competent integrated probability distribution map for object tracking. A simple but effective algorithm was proposed to handle full occlusion cases. The system was tested using real traffic videos from different sites. The results of the test confirm that the system is reliable and has an overall accuracy of over 85%.

A novel method for tracking pedestrians from real-time video

This novel method of Pedestrian Tracking using Support Vector (PTSV) proposed for a video surveillance instrument combines the Support Vector Machine (SVM) classifier into an optic-flow based tracker. The traditional method using optical flow tracks objects by minimizing an intensity difference function between successive frames, while PTSV tracks objects by maximizing the SVM classification score. As the SVM classifier for object and non-object is pre-trained, there is need only to classify an image block as object or non-ob-ject without having to compare the pixel region of the tracked object in the previous frame. To account for large motions between successive frames we build pyramids from the support vectors and use a coarse-to-fine scan in the classification stage. To accelerate the training of SVM, a Sequential Minimal Optimization Method (SMO) is adopted. The results of using a kernel-PTSV for pedestrian tracking from real time video are shown at the end. Comparative experimental results showed that PTSV improves the reliability of tracking compared to that of traditional tracking method using optical flow.

Anti-occlusion pedestrian tracking algorithm based on location prediction and deep feature rematch

Aiming to the problem of pedestrian tracking with frequent or long-term occlusion in complex scenes,an anti-occlusion pedestrian tracking algorithm based on location prediction and deep feature rematch is proposed.Firstly,the occlusion judgment is realized by extracting and utilizing deep feature of pedestrian’s appearance,and then the scale adaptive kernelized correlation filter is introduced to implement pedestrian tracking without occlusion.Secondly,Karman filter is introduced to predict the location of occluded pedestrian position.Finally,the deep feature is used to the rematch of pedestrian in the reappearance process.Simulation experiment and analysis show that the proposed algorithm can effectively detect and rematch pedestrian under the condition of frequent or long-term occlusion.

Bounding box based on probability density for the pedestrian tracking

This paper proposes a pedestrian tracking approach using bounding box based on probability densities.It is generally a difficult task to track features like corner points in outdoor images due to complex environment.To solve this problem,the feature points are projected along X and Y direction separately,and a histogram is constructed for each projection,with horizontal axis as positions and vertical axis as the number of feature points that lie on each position.Finally,the vertical axis is normalized for expression as probability.After histogram is constructed,the probability of each feature point is checked with a threshold.A feature point will be ignored if its probability is lower than a threshold,while the remaining feature points are grouped,based on which a bounding box is made.Kanade-Lucas Tomasi(KLT)algorithm is adopted as the tracking algorithm because it is able to track local features in images robustly.The efficiency of the tracking results using this method is verified in real environment test.

An Automated Player Detection and Tracking in Basketball Game

Vision-based player recognition is critical in sports applications.Accuracy,efficiency,and Low memory utilization is alluring for ongoing errands,for example,astute communicates and occasion classification.We developed an algorithm that tracks the movements of different players from a video of a basketball game.With their position tracked,we then proceed to map the position of these players onto an image of a basketball court.The purpose of tracking player is to provide the maximum amount of information to basketball coaches and organizations,so that they can better design mechanisms of defence and attack.Overall,our model has a high degree of identification and tracking of the players in the court.We directed investigations on soccer,basketball,ice hockey and pedestrian datasets.The trial comes about an exhibit that our technique can precisely recognize players under testing conditions.Contrasted and CNNs that are adjusted from general question identification systems,for example,Faster-RCNN,our approach accomplishes cutting edge exactness on three sorts of recreations(basketball,soccer and ice hockey)with 1000×fewer parameters.The all-inclusive statement of our technique is additionally shown on a standard passer-by recognition dataset in which our strategy accomplishes aggressive execution contrasted and cutting-edge methods.

基于扩展卡尔曼滤波的交互式多模型跟踪算法研究

在辅助驾驶系统中,行人轨迹跟踪一直是一项有挑战性的任务,因为行人的回波信号中往往存在着许多干扰噪声。此外,行人在运动过程中可能会做出突然转身或其他改变方向的行为,这将直接导致行人运动轨迹呈现出非线性特征。针对上述问题,文中提出一种基于扩展卡尔曼滤波的交互式多模型跟踪(IMM-EKF)方法,适用于毫米波雷达对行人进行轨迹跟踪。首先,在扩展卡尔曼滤波算法(EKF)的基础上重构状态预测协方差矩阵,来补偿EKF非线性化过程中引入的误差;然后将改进的EKF作为交互式多模型算法(IMM)中的滤波器,根据行人运动特性选择匀速模型和协调转弯模型作为跟踪模型,利用所提出的IMM-EKF算法进行轨迹跟踪。实验结果表明,所提出的滤波算法较典型的EKF和改进的EKF算法,在跟踪滤波精度方面均有所提升,同时具备更优的跟踪鲁棒性。

基于YOLOv8和DeepSort的多区域行人追踪算法研究

针对多摄像头重叠场景中行人追踪容易发生身份丢失、切换的问题,本文提出了一种基于YOLOv8和DeepSort的多摄像头跟踪算法.在检测阶段,利用无参注意力机制增强网络对行人特征的提取能力,提高了检测器的性能.在追踪阶段,通过提取两个摄像头的视角关键点,并计算出两个视角的单应性矩阵,实现了不同视角图像的拼接.通过利用目标间的单应性关系,在DeepSort算法中完成目标匹配.并在MOT15数据集中,对所改进的算法进行了测试.实验结果表明,本文提出的基于YOLOv8和DeepSort的改进算法的平均跟踪精确度为63.5%,比原始算法提升了3.4%.改进算法在行人身份切换次数方面减少了52次,比原始算法减少了6.5%.

基于检测和重识别的无人机行人跟踪算法

将智能检测跟踪算法与无人机(UAV)的灵活性相结合是UAV应用的研究热点。针对UAV的视角及运动导致目标滑移和遮挡的问题,提出一种基于检测和重识别的UAV行人跟踪算法。对训练好的YOLOv5进行TensorRT加速,解决UAV计算资源有限的问题;以量化加速的目标检测算法与重识别算法为基础,构建行人跟踪算法框架;设计判定行人匹配度,完成行人匹配系统设计。仿真试验表明:训练后的YOLOv5和OSNet具备一定的精度,采用TensorRT加速后的YOLOv5网络在保证精度的情况下,帧率有了近50%的提升。飞行试验表明:所提算法在行人穿插及障碍物遮挡的情况下,可以实现对目标的稳定跟踪,具备一定的实用性和有效性。

基于行为轨迹的中庭式酒店COVID-19感染概率研究

中庭式酒店建筑因中庭空间人员密集、气流波动大,属呼吸道传染疾病高感染概率区域,建筑高大公共空间的传染概率有待研究.以某中庭式酒店为研究对象,基于该酒店人流状况、行为轨迹的实测,通过回归分析,得到该酒店人流密度的分布规律;运用Anylogic软件,结合Wells-Riley感染概率计算模型,对不同类型人员感染后的酒店人群感染概率进行模拟.通过模拟可知,住宿人群、就餐人群、商务会议三类人群中单一人群感染时,感染概率分别为29.3%,17.9%,36.4%;当三类人员及后勤人员共同耦合感染时,感染概率增加至42.6%.通过对污染物颗粒的时空分布规律的分析发现三层、标准层污染物颗粒较多;人员交叉与感染概率呈正相关;流线交叉较多的就餐空间、滞留时间较长休闲空间、竖向交通空间等应重点考虑设计措施以降低其感染概率;该研究为人员行为轨迹下的酒店空间的布局优化提供研究思路,为疫情背景下寒冷地区中庭式酒店平疫结合酒店空间布局设计研究提供理论依据.

基于自监督部位感知的行人重识别模型及其在铁路客运站的应用

铁路客运站环境复杂,客流密集,一旦发生涉及旅客安全、影响站区运营等重要事件时,客运工作人员亟需快速掌握相关旅客的站内轨迹。为此,设计了一种基于自监督部位感知的行人重识别模型,基于该模型可实现对铁路客运站重点旅客的实时跟踪。从自监督部位感知预训练和行人重识别迁移学习两个方面详细阐述了模型的架构。试验表明,该模型在各类尤其是存在严重遮挡的行人重识别数据集上的性能均超越了通用的行人重识别模型。在中国铁路兰州局集团有限公司白银南站的现场试用表明,该模型可有效跟踪重点旅客在铁路客运站内的行进轨迹,为客运相关工作提供技术支持。

基于改进KCF的移动机器人视觉行人跟踪系统

针对视觉跟踪机器人在跟踪目标被大面积遮挡和短暂丢失的场景下容易跟踪失败的问题,提出了一种基于改进核相关滤波(kernelized correlation filter,KCF)的移动机器人视觉行人跟踪系统。在传统KCF算法的基础上引入平均峰值相关能量(average peak correla-tion energy,APCE),结合APCE响应值和最大响应值判断目标丢失情况,并加入了两级重检测机制。在OTB2013数据集的目标丢失(out of view,OV)场景中,改进算法的成功率和精度分别达到0.626和0.592像素,比传统KCF算法分别提升了8.7%和10.9%,有效提高了算法在目标遮挡和短暂丢失场景下的跟踪鲁棒性。在有行人干扰的场景中进行跟踪实验,实验结果表明所提视觉行人跟踪系统能够稳定跟踪目标行人。

基于双重注意力机制、轨迹预测与无人机遥感技术的人车流量检测方法

人、车流量的精确检测统计对于公共安全和资源管理有重要意义。针对现有检测统计方法设备投入大、维护成本高、检测区域受限、易受环境因素影响等问题,提出一种基于双重注意力机制、轨迹预测与无人机遥感技术的人车流量检测方法。该方法在RefineDet网络的基础上加以改进,通过引入双重注意力机制、使用特征融合RNN替换TCB模块等方式增强对小目标的识别能力。同时通过自适应卡尔曼滤波预测轨迹,实现了对运动目标的实时跟踪,避免了因目标距离过远、行动方式特殊导致的错误统计。自建数据集训练网络模型,并在不同场景下进行测试。实验结果表明,所提改进模型相较对照模型的MOTA提高了2.3%~3.3%,在精度接近最新模型的同时检测速度更快,基本达到实时性需求;在多种场景下的综合评价指标F值均能达到95%以上,在多种实际场景检测中的误检率均低于0.3%。

Simulation of High Density Pedestrian Flow: A Microscopic Model

In recent years, modelling crowd and evacuation dynamics has become very important, with increasing huge numbers of people gathering around the world for many reasons and events. The fact that our global population grows dramatically every year and the current public transport systems are able to transport large amounts of people heightens the risk of crowd panic or crush. Pedestrian models are based on macroscopic or microscopic behaviour. In this paper, we are interested in developing models that can be used for evacuation control strategies. This model will be based on microscopic pedestrian simulation models, and its evolution and design requires a lot of information and data. The people stream will be simulated, based on mathematical models derived from empirical data about pedestrian flows. This model is developed from image data bases, so called empirical data, taken from a video camera or data obtained using human detectors. We consider the individuals as autonomous particles interacting through social and physical forces, which is an approach that has been used to simulate crowd behaviour. The target of this work is to describe a comprehensive approach to model a huge number of pedestrians and to simulate high density crowd behaviour in overcrowding places, e.g. sport, concert and pilgrimage places, and to assist engineering in the resolution of complicated problems through integrating a number of models from different research domains.

基于遮挡感知的行人检测与跟踪算法

针对行人遮挡以及跟踪过程中ID频繁切换的问题,提出一种基于遮挡感知的行人检测与跟踪算法。利用遮挡感知算法提高遮挡情况下的行人检测精度;为提高遮挡情况下的跟踪准确度,融合时变运动特征和梯度方向直方图(HOG)特征为一个新的度量匹配信息,对上下帧的行人多目标进行匹配。实验结果表明:该行人多目标检测算法较基准算法在CrowdHuman测试集上准确率提高了7.49%,召回率提高了9.26%。跟踪算法在MOT数据集上具有较好的鲁棒性和跟踪准确度,相较于近年来流行的YOLOv3-DeepSort,SSD-Sort,MOTA分别提高了5.39%,8.17%。

融合Mask R-CNN的在线多目标行人跟踪方法

在计算机视觉领域中,行人目标检测与跟踪是备受关注的焦点。提出一种改进的多目标行人跟踪模型,改进Deep SORT基础框架,融合Mask R-CNN实现行人的检测、跟踪和姿态估计功能。采用更符合行人目标宽高比的锚框替代区域预测网络中的锚框,在不增加计算量的情况下提高模型的性能。在深度残差网络中引入注意力机制,采用轻量级的SKNet自适应地选取最佳的卷积核,提高对检测目标的特征表示能力。采用融合了颜色信息的梯度直方图特征取代卷积特征,提高Deep SORT模型中外观信息特征关联匹配的成功率。通过消融研究验证各种改进对模型性能的影响,将改进的模型与当前主流的行人检测跟踪模型进行对比,实验结果表明改进的模型是有效的,在MOT16跟踪数据集上比NSH的MOTA性能提高了6%,在公开数据集上的测试性能优于几种对比模型的,当背景移动或行人目标被遮挡时,仍能实现有效跟踪。