Cast shadow detection for moving objects based on binocular stereo vision

A novel cast shadow detection approach was proposed.A stereo vision system was used to capture images instead of traditional single camera.It was based on an assumption that cast shadows were on a special plane.The image obtained from one camera was inversely projected to the plane and then transformed to the view from another camera.The points on the plane shared the same position between original image and the transformed image.As a result,the cast shadows can be detected.In order to improve the efficiency of cast shadow detection and decrease computational complexity,the obvious object areas in CIELAB color space were removed and the potential shadow areas were obtained.Experimental results demonstrate that the proposed approach can detect cast shadows accurately even under various illuminations.

Moving object detection in framework of compressive sampling

Compressive sensing is a revolutionary idea proposed recently to achieve much lower sampling rate for signals.In the image application with limited resources the camera data can be stored and processed in compressed form.An algorithm for moving object and region detection in video using a compressive sampling is developed.The algorithm estimates motion information of the moving object and regions in the video from the compressive measurements of the current image and background scene.The algorithm does not perform inverse compressive operation to obtain the actual pixels of the current image nor the estimated background.This leads to a computationally efficient method and a system compared with the existing motion estimation methods.The experimental results show that the sampling rate can reduce to 25% without sacrificing performance.

Algorithm Research on Moving Object Detection of Surveillance Video Sequence

In video surveillance, there are many interference factors such as target changes, complex scenes, and target deformation in the moving object tracking. In order to resolve this issue, based on the comparative analysis of several common moving object detection methods, a moving object detection and recognition algorithm combined frame difference with background subtraction is presented in this paper. In the algorithm, we first calculate the average of the values of the gray of the continuous multi-frame image in the dynamic image, and then get background image obtained by the statistical average of the continuous image sequence, that is, the continuous interception of the N-frame images are summed, and find the average. In this case, weight of object information has been increasing, and also restrains the static background. Eventually the motion detection image contains both the target contour and more target information of the target contour point from the background image, so as to achieve separating the moving target from the image. The simulation results show the effectiveness of the proposed algorithm.

Hardware Design of Moving Object Detection on Reconfigurable System

Moving object detection including background subtraction and morphological processing is a critical research topic for video surveillance because of its high computational loading and power consumption. This paper proposes a hardware design to accelerate the computation of background subtraction with low power consumption. A real-time background subtraction method is designed with a frame-buffer scheme and function partition to improve throughput, and implemented using Verilog HDL on FPGA. The design parallelizes the computations of background update and subtraction with a seven-stage pipeline. A stripe-based morphological processing and accounting for the completion of detected objects is devised. Simulation results for videos of VGA resolutions on a low-end FPGA device show 368 fps throughput for only the real-time background subtraction module, and 51 fps for the whole system, including off-chip memory access. Real-time efficiency with low power consumption and low resource utilization is thus demonstrated.

COLLISION DETECTION AMONG MOVING OBJECTSIN MACHINING PROCESS SIMULATION

This paper describes an algorithm of collision detection between moving objects in machin-ing process simulation. Graphical simulation of machining has been recognized to be useful for NCprogram verification , since the programmer of the machining operator can easily find some faults inthe NC program visually. But it is difficult to visually detect collisions arnong moving objects such ascutting tools , workpieces and fixtures, a data structure to represent moving objects and an algorithmof collision detection between moving objects are proposed. A moving object can be represented by ahierarchical sphere octree and its motion can be described by a quadratic function of time. A collisionoccurs in the case that the distance between any two sphere centers in the respective two moving ob-jects is equal to the sum of the radii of these two spheres, and the radii of these two spheres are lessthan a given precision. By solving the equations that satisfy the conditions of collision between thespheres recursively , we obtain the time and the position of the collision between these two moving ob-Jects.

Real-time moving object detection for video monitoring systems

Moving object detection is one of the challenging problems in video monitoring systems, especially when the illumination changes and shadow exists. Amethod for real-time moving object detection is described. Anew background model is proposed to handle the illumination varition problem. With optical flow technology and background subtraction, a moving object is extracted quickly and accurately. An effective shadow elimination algorithm based on color features is used to refine the moving obj ects. Experimental results demonstrate that the proposed method can update the background exactly and quickly along with the varition of illumination, and the shadow can be eliminated effectively. The proposed algorithm is a real-time one which the foundation for further object recognition and understanding of video mum＇toting systems.

Multi-features Based Approach for Moving Shadow Detection

In the video-based surveillance application, moving shadows can affect the correct localization and detection of moving objects. This paper aims to present a method for shadow detection and suppression used for moving visual object detection. The major novelty of the shadow suppression is the integration of several features including photometric invariant color feature, motion edge feature, and spatial feature etc. By modifying process for false shadow detected, the averaging detection rate of moving object reaches above 90% in the test of Hall-Monitor sequence.

Moving object detection method based on complementary multi resolution background models

A novel moving object detection method was proposed in order to adapt the difficulties caused by intermittent object motion,thermal and dynamic background sequences.Two groups of complementary Gaussian mixture models were used.The ghost and real static object could be classified by comparing the similarity of the edge images further.In each group,the multi resolution Gaussian mixture models were used and dual thresholds were applied in every resolution in order to get a complete object mask without much noise.The computational color model was also used to depress illustration variations and light shadows.The proposed method was verified by the public test sequences provided by the IEEE Change Detection Workshop and compared with three state-of-the-art methods.Experimental results demonstrate that the proposed method is better than others for all of the evaluation parameters in intermittent object motion sequences.Four and two in the seven evaluation parameters are better than the others in thermal and dynamic background sequences,respectively.The proposed method shows a relatively good performance,especially for the intermittent object motion sequences.

An Improved Moving Object Detection Algorithm Based on Gaussian Mixture Models

Aiming at the problems that the classical Gaussian mixture model is unable to detect the complete moving object, and is sensitive to the light mutation scenes and so on, an improved algorithm is proposed for moving object detection based on Gaussian mixture model and three-frame difference method. In the process of extracting the moving region, the improved three-frame difference method uses the dynamic segmentation threshold and edge detection technology, and it is first used to solve the problems such as the illumination mutation and the discontinuity of the target edge. Then, a new adaptive selection strategy of the number of Gaussian distributions is introduced to reduce the processing time and improve accuracy of detection. Finally, HSV color space is used to remove shadow regions, and the whole moving object is detected. Experimental results show that the proposed algorithm can detect moving objects in various situations effectively.

GSM-MRF based classification approach for real-time moving object detection

Statistical and contextual information are typically used to detect moving regions in image sequences for a fixed camera.In this paper,we propose a fast and stable linear discriminant approach based on Gaussian Single Model(GSM)and Markov Random Field(MRF).The performance of GSM is analyzed first,and then two main improvements corresponding to the drawbacks of GSM are proposed:the latest filtered data based update scheme of the background model and the linear classification judgment rule based on spatial-temporal feature specified by MRF.Experimental results show that the proposed method runs more rapidly and accurately when compared with other methods.

Design and Implementation of the Image Interactive System Based on Human-Computer Interaction

Based on the traditional Human-Computer Interaction method which is mainly touch input system, the way of capturing the movement of people by using cameras is proposed. This is a convenient technique which can provide users more experience. In the article, a new way of detecting moving things is given on the basis of development of the image processing technique. The system architecture decides that the communication should be used between two different applications. After considered, named pipe is selected from many ways of communication to make sure that video is keeping in step with the movement from the analysis of the people moving. According to a large amount of data and principal knowledge, thinking of the need of actual project, a detailed system design and realization is finished. The system consists of three important modules: detecting of the people's movement, information transition between applications and video showing in step with people's movement. The article introduces the idea of each module and technique.

Energy efficient indoor localisation for narrowband internet of things

There are an increasing number of Narrow Band IoT devices being manufactured as the technology behind them develops quickly.The high co‐channel interference and signal attenuation seen in edge Narrow Band IoT devices make it challenging to guarantee the service quality of these devices.To maximise the data rate fairness of Narrow Band IoT devices,a multi‐dimensional indoor localisation model is devised,consisting of transmission power,data scheduling,and time slot scheduling,based on a network model that employs non‐orthogonal multiple access via a relay.Based on this network model,the optimisation goal of Narrow Band IoT device data rate ratio fairness is first established by the authors,while taking into account the Narrow Band IoT network:The multidimensional indoor localisation optimisation model of equipment tends to minimize data rate,energy constraints and EH relay energy and data buffer constraints,data scheduling and time slot scheduling.As a result,each Narrow Band IoT device's data rate needs are met while the network's overall performance is optimised.We investigate the model's potential for convex optimisation and offer an algorithm for optimising the distribution of multiple resources using the KKT criterion.The current work primarily considers the NOMA Narrow Band IoT network under a single EH relay.However,the growth of Narrow Band IoT devices also leads to a rise in co‐channel interference,which impacts NOMA's performance enhancement.Through simulation,the proposed approach is successfully shown.These improvements have boosted the network's energy efficiency by 44.1%,data rate proportional fairness by 11.9%,and spectrum efficiency by 55.4%.

SDDNet:Infrared small and dim target detection network

This study focuses on developing deep learning methods for small and dim target detection.We model infrared images as the union of the target region and background region.Based on this model,the target detection problem is considered a two‐class segmentation problem that divides an image into the target and background.Therefore,a neural network called SDDNet for single‐frame images is constructed.The network yields target extraction results according to the original images.For multiframe images,a network called IC‐SDDNet,a combination of SDDNet and an interframe correlation network module is constructed.SDDNet and IC‐SDDNet achieve target detection rates close to 1 on typical datasets with very low false positives,thereby performing significantly better than current methods.Both models can be executed end to end,so both are very convenient to use,and their implementation efficiency is very high.Average speeds of 540+/230+FPS and 170+/60+FPS are achieved with SDDNet and IC‐SDDNet on a single Tesla V100 graphics processing unit and a single Jetson TX2 embedded module respectively.Additionally,neither network needs to use future information,so both networks can be directly used in real‐time systems.The well‐trained models and codes used in this study are available at https://github.com/LittlePieces/ObjectDetection.

一种基于PandaBoard的运动物体检测系统设计

设计了一种基于PandaBoard的运动物体检测系统。该系统的主要组成模块及其功能简要描述如下:利用USB摄像头进行视频帧的采集,基于嵌入式的PandaBoard开发板运行运动物体检测的视频帧处理算法,采用USB无线鼠键进行检测系统的启动或关闭,最终通过HDMI显示器进行检测结果的显示。其中,嵌入式PandaBoard开发板上运行的帧间差分运动物体检测算法基于上位机Simulink进行设计,设计完成后直接下载到PandaBoard开发板上运行。该系统可以脱离上位机及Simulink开发环境独立运行,具有设备简单、成本低、算法可拓展性强等特点,具有良好的应用前景。

Automatic Segmentation of Moving Objects in Video Sequences for Indoor and Outdoor Applications

Computer vision systems have an impressive spread both for their practicalapplication and for theoretical research . The common approach used in such systems consists of agood segmentation of moving objects from video sequences . This paper presents an automaticalgorithm for segmenting and extracting moving objects suitable for indoor and outdoor videoapplications, where the background scene can be captured beforehand . Since edge detection is oftenused to extract accurate boundaries of the image's objects, the first step in our algorithm isaccomplished by combining two edge maps which are detected from the frame difference in twoconsecutive frames and the background subtraction . After removing edge points that belong to thebackground, the resulting moving edge map is fed to the object extraction step . A fundamental taskin this step is to declare the candidates of the moving object, followed by applying morphologicaloperations. The algorithm is implemented on a real video sequence as well as MPEG- 4 sequence andgood segmentation results are achieved.

Surveillance Video Key Frame Extraction Based on Center Offset

With the explosive growth of surveillance video data,browsing videos quickly and effectively has become an urgent problem.Video key frame extraction has received widespread attention as an effective solution.However,accurately capturing the local motion state changes of moving objects in the video is still challenging in key frame extraction.The target center offset can reflect the change of its motion state.This observation proposed a novel key frame extraction method based on moving objects center offset in this paper.The proposed method utilizes the center offset to obtain the global and local motion state information of moving objects,and meanwhile,selects the video frame where the center offset curve changes suddenly as the key frame.Such processing effectively overcomes the inaccuracy of traditional key frame extraction methods.Initially,extracting the center point of each frame.Subsequently,calculating the center point offset of each frame and forming the center offset curve by connecting the center offset of each frame.Finally,extracting candidate key frames and optimizing them to generate final key frames.The experimental results demonstrate that the proposed method outperforms contrast methods to capturing the local motion state changes of moving objects.

利用双域推扫成像方法检测对地遥感动目标

针对星载双线阵相机对地运动目标检测中,双线阵系统成本高、时间和空间同步性差、检测精度低的问题,提出了一种基于单面阵CMOS的双域线阵相机推扫成像方法,利用CMOS时间延迟积分(TDI)技术在固定位置间隔开窗,实现双区域推扫成像;针对两路通道数据,进行序贯模式图像采集,形成独立完整的两幅长条带图像;通过建立的双域线阵TDI相机时间与位置函数,检测并分析高速运动目标的运动特性;基于卫星推扫地球成像原理,设计并搭建了一套TDI推扫式成像试验装置,进行了高速运动目标的速度检测。试验结果表明,在CMOS像元分辨率为4096×3072,视场角为16°0'34″,行频为998 Hz,开窗间隔为3056行的情况下,绝对速度误差小于0.445%,像移速度误差为2.323 pixel/s,保证了时空同步性,进而提高检测精度,验证了本文方法的可行性。

基于无人机航拍视频的运动目标检测与跟踪

针对无人机视角下拍摄物体尺寸小、外观模糊,以及无人机平台自身存在运动等问题,基于无人机航拍视频的运动目标检测与跟踪仍具有很大的挑战性。提出了基于改进LK光流法的运动目标检测与跟踪算法,利用卡尔曼滤波算法进行目标跟踪;针对传统LK光流法在动态环境下效果不佳的问题,引入语义分割线程筛选动态点和静态点,通过筛选后的静态点求解单应矩阵完成无人机的运动补偿、计算动态点的光流值获得光流点以降低误匹配率,最后通过聚类算法和形态学运算得到完整的运动目标;将所提的重识别模块引入卡尔曼滤波算法实现目标跟踪。实验结果验证了所设计的运动目标检测与跟踪算法在无人机视角下能够实时、准确地提取出运动目标,并持续稳定地跟踪目标。

基于l^(1/2)-TV正则化RPCA的运动目标检测

针对复杂环境下背景干扰导致运动目标检测精度下降的问题,提出了一种基于l^(1/2)-TV正则化RPCA的运动目标检测方法。方法利用核范数来描述背景的低秩特性,采用l^(1/2)范数描述更稀疏的运动目标,以抑制运动目标中的背景干扰。同时结合TV正则化约束运动目标的空间连续性,使运动目标更加完整。利用Frobenius范数检测背景干扰。采用交替方向最小化策略扩展的增广拉格朗日乘子法求解所提出的约束最小化问题。实验结果表明,所提方法能有效去除背景干扰,提高运动目标的检测精度、改善视觉效果。

改进五帧差法机器视觉气密性检测研究

气密性是真空设备最重要的技术指标。在工业设备检漏中,传统皂泡法依赖人工目视,其检测准确性和效率取决于工作人员的专注度和操作技能。文章采用机器视觉技术,基于五帧差目标检测算法,进行检漏和漏点定位。由于传统帧差法存在部分画面重叠、边缘信息缺失和处理高帧率视频效果较差等问题,文章提出用Otsu算子和Canny边缘检测共同改进五帧差法。首先对连续图像做差分并转化为二值图,然后对中间帧进行Canny边缘检测,将二值图和Canny边缘检测的结果进行逻辑运算、中值滤波和形态学处理,最后获得完整的皂泡目标。实验表明,新算法能够处理高帧率视频并获得更完整的皂泡轮廓信息,可用于机器视觉真空设备气密性检测。