An AIoT Monitoring System for Multi-Object Tracking and Alerting

Pig farmers want to have an effective solution for automatically detecting and tracking multiple pigs and alerting their conditions in order to recognize disease risk factors quickly.In this paper,therefore,we propose a novel monitoring system using an Artificial Intelligence of Things(AIoT)technique combining artificial intelligence and Internet of Things(IoT).The proposed system consists of AIoT edge devices and a central monitoring server.First,an AIoT edge device extracts video frame images from a CCTV camera installed in a pig pen by a frame extraction method,detects multiple pigs in the images by a faster region-based convolutional neural network(RCNN)model,and tracks them by an object center-point tracking algorithm(OCTA)based on bounding box regression outputs of the faster RCNN.Finally,it sends multi-pig tracking images to the central monitoring server,which alerts them to pig farmers through a social networking service(SNS)agent in cooperation with an oneM2M-compliant IoT alerting method.Experimental results showed that the multi-pig tracking method achieved the multi-object tracking accuracy performance of about 77%.In addition,we verified alerting operation by confirming the images received in the SNS smartphone application.

Multi-Object Tracking Based on Segmentation and Collision Avoidance

An approach to track multiple objects in crowded scenes with long-term partial occlusions is proposed. Tracking-by-detection is a successful strategy to address the task of tracking multiple objects in unconstrained scenarios,but an obvious shortcoming of this method is that most information available in image sequences is simply ignored due to thresholding weak detection responses and applying non-maximum suppression. This paper proposes a multi-label conditional random field（ CRF） model which integrates the superpixel information and detection responses into a unified energy optimization framework to handle the task of tracking multiple targets. A key characteristic of the model is that the pairwise potential is constructed to enforce collision avoidance between objects,which can offer the advantage to improve the tracking performance in crowded scenes. Experiments on standard benchmark databases demonstrate that the proposed algorithm significantly outperforms the state-of-the-art tracking-by-detection methods.

Multi-Object Tracking with Micro Aerial Vehicle

A simple yet efficient tracking framework is proposed for real-time multi-object tracking with micro aerial vehicles(MAVs). It's basic missions for MAVs to detect specific targets and then track them automatically. In our method, candidate regions are generated using the salient detection in each frame and then classified by an eural network. A kernelized correlation filter(KCF) is employed to track each target until it disappears or the peak-sidelobe ratio is lower than a threshold. Besides, we define the birth and death of each tracker for the targets. The tracker is recycled if its target disappears and can be assigned to a new target. The algorithm is evaluated on the PAFISS and UAV123 datasets. The results show a good performance on both the tracking accuracy and speed.

Online Multi-Object Tracking Under Moving Unmanned Aerial Vehicle Platform Based on Object Detection and Feature Extraction Network

In order to solve the problem of small object size and low detection accuracy under the unmanned aerial vehicle(UAV)platform,the object detection algorithm based on deep aggregation network and high-resolution fusion module is studied.Furthermore,a joint network of object detection and feature extraction is studied to construct a real-time multi-object tracking algorithm.For the problem of object association failure caused by UAV movement,image registration is applied to multi-object tracking and a camera motion discrimination model is proposed to improve the speed of the multi-object tracking algorithm.The simulation results show that the algorithm proposed in this study can improve the accuracy of multi-object tracking under the UAV platform,and effectively solve the problem of association failure caused by UAV movement.

Automatic velocity picking based on optimal key points tracking algorithm

Picking velocities from semblances manually is laborious and necessitates experience. Although various methods for automatic velocity picking have been developed, there remains a challenge in efficiently incorporating information from nearby gathers to ensure picked velocity aligns with seismic horizons while also improving picking accuracy. The conventional method of velocity picking from a semblance volume is computationally demanding, highlighting a need for a more efficient strategy. In this study, we introduce a novel method for automatic velocity picking based on multi-object tracking. This dynamic tracking process across different semblance panels can integrate information from nearby gathers effectively while maintaining computational efficiency. First, we employ accelerated density clustering on the velocity spectrum to discern cluster centers without the requirement for prior knowledge regarding the number of clusters. These cluster centers embody the maximum likelihood velocities of the main subsurface structures. Second, our proposed method tracks key points within the semblance volume. Kalman filter is adopted to adjust the tracking process, followed by interpolation on these tracked points to construct the final velocity model. Our synthetic data example demonstrates that our proposed algorithm can effectively rectify the picking errors of the clustering algorithm. We further compare the performances of the clustering method(CM), the proposed tracking method(TM), and the variational method(VM) on a field dataset from the Gulf of Mexico. The results attest that our method offers superior accuracy than CM, achieves comparable accuracy with VM, and benefits from a reduced computational cost.

Multi-object tracking based on deep associated features for UAV applications

Multi-object tracking(MOT) techniques have been increasingly applied in a diverse range of tasks. Unmanned aerial vehicle(UAV) is one of its typical application scenarios. Due to the scene complexity and the low resolution of moving targets in UAV applications, it is difficult to extract target features and identify them. In order to solve this problem, we propose a new re-identification(re-ID) network to extract association features for tracking in the association stage. Moreover, in order to reduce the complexity of detection model, we perform the lightweight optimization for it. Experimental results show that the proposed re-ID network can effectively reduce the number of identity switches, and surpass current state-of-the-art algorithms. In the meantime, the optimized detector can increase the speed by 27% owing to its lightweight design, which enables it to further meet the requirements of UAV tracking tasks.

Novel learning framework for optimal multi-object video trajectory tracking

Background With the rapid development of Web3D, virtual reality, and digital twins, virtual trajectories and decision data considerably rely on the analysis and understanding of real video data, particularly in emergency evacuation scenarios. Correctly and effectively evacuating crowds in virtual emergency scenarios are becoming increasingly urgent. One good solution is to extract pedestrian trajectories from videos of emergency situations using a multi-target tracking algorithm and use them to define evacuation procedures. Methods To implement this solution, a trajectory extraction and optimization framework based on multi-target tracking is developed in this study. First, a multi-target tracking algorithm is used to extract and preprocess the trajectory data of the crowd in a video. Then, the trajectory is optimized by combining the trajectory point extraction algorithm and Savitzky-Golay smoothing filtering method. Finally, related experiments are conducted, and the results show that the proposed approach can effectively and accurately extract the trajectories of multiple target objects in real time. Results In addition, the proposed approach retains the real characteristics of the trajectories as much as possible while improving the trajectory smoothing index, which can provide data support for the analysis of pedestrian trajectory data and formulation of personnel evacuation schemes in emergency scenarios. Conclusions Further comparisons with methods used in related studies confirm the feasibility and superiority of the proposed framework.

Prescribed Performance Tracking Control of Time-Delay Nonlinear Systems With Output Constraints

The problem of prescribed performance tracking control for unknown time-delay nonlinear systems subject to output constraints is dealt with in this paper. In contrast with related works, only the most fundamental requirements, i.e., boundedness and the local Lipschitz condition, are assumed for the allowable time delays. Moreover, we focus on the case where the reference is unknown beforehand, which renders the standard prescribed performance control designs under output constraints infeasible. To conquer these challenges, a novel robust prescribed performance control approach is put forward in this paper.Herein, a reverse tuning function is skillfully constructed and automatically generates a performance envelop for the tracking error. In addition, a unified performance analysis framework based on proof by contradiction and the barrier function is established to reveal the inherent robustness of the control system against the time delays. It turns out that the system output tracks the reference with a preassigned settling time and good accuracy,without constraint violations. A comparative simulation on a two-stage chemical reactor is carried out to illustrate the above theoretical findings.

Privacy Protection in COVID Data Tracking: Textual Analysis of the Literature

The literary review presented in the following paper aims to analyze the tracking tools used in different countries during the period of the COVID-19 pandemic. Tracking apps that have been adopted in many countries to collect data in a homogeneous and immediate way have made up for the difficulty of collecting data and standardizing evaluation criteria. However, the regulation on the protection of personal data in the health sector and the adoption of the new General Data Protection Regulation in European countries has placed a strong limitation on their use. This has not been the case in non-European countries, where monitoring methodologies have become widespread. The textual analysis presented is based on co-occurrence and multiple correspondence analysis to show the contact tracing methods adopted in different countries in the pandemic period by relating them to the issue of privacy. It also analyzed the possibility of applying Blockchain technology in applications for tracking contagions from COVID-19 and managing health data to provide a high level of security and transparency, including through anonymization, thus increasing user trust in using the apps.

FPGA and computer-vision-based atom tracking technology for scanning probe microscopy

Atom tracking technology enhanced with innovative algorithms has been implemented in this study,utilizing a comprehensive suite of controllers and software independently developed domestically.Leveraging an on-board field-programmable gate array(FPGA)with a core frequency of 100 MHz,our system facilitates reading and writing operations across 16 channels,performing discrete incremental proportional-integral-derivative(PID)calculations within 3.4 microseconds.Building upon this foundation,gradient and extremum algorithms are further integrated,incorporating circular and spiral scanning modes with a horizontal movement accuracy of 0.38 pm.This integration enhances the real-time performance and significantly increases the accuracy of atom tracking.Atom tracking achieves an equivalent precision of at least 142 pm on a highly oriented pyrolytic graphite(HOPG)surface under room temperature atmospheric conditions.Through applying computer vision and image processing algorithms,atom tracking can be used when scanning a large area.The techniques primarily consist of two algorithms:the region of interest(ROI)-based feature matching algorithm,which achieves 97.92%accuracy,and the feature description-based matching algorithm,with an impressive 99.99%accuracy.Both implementation approaches have been tested for scanner drift measurements,and these technologies are scalable and applicable in various domains of scanning probe microscopy with broad application prospects in the field of nanoengineering.

Beam Training and Tracking in mmWave Communication:A Survey

Communicating on millimeter wave(mmWave)bands is ushering in a new epoch of mobile communication which provides the availability of 10 Gbps high data rate transmission.However,mmWave links are easily prone to short transmission range communication because of the serious free space path loss and the blockage by obstacles.To overcome these challenges,highly directional beams are exploited to achieve robust links by hybrid beamforming.Accurately aligning the transmitter and receiver beams,i.e.beam training,is vitally important to high data rate transmission.However,it may cause huge overhead which has negative effects on initial access,handover,and tracking.Besides,the mobility patterns of users are complicated and dynamic,which may cause tracking error and large tracking latency.An efficient beam tracking method has a positive effect on sustaining robust links.This article provides an overview of the beam training and tracking technologies on mmWave bands and reveals the insights for future research in the 6th Generation(6G)mobile network.Especially,some open research problems are proposed to realize fast,accurate,and robust beam training and tracking.We hope that this survey provides guidelines for the researchers in the area of mmWave communications.

SMSTracker:A Self-Calibration Multi-Head Self-Attention Transformer for Visual Object Tracking

Visual object tracking plays a crucial role in computer vision.In recent years,researchers have proposed various methods to achieve high-performance object tracking.Among these,methods based on Transformers have become a research hotspot due to their ability to globally model and contextualize information.However,current Transformer-based object tracking methods still face challenges such as low tracking accuracy and the presence of redundant feature information.In this paper,we introduce self-calibration multi-head self-attention Transformer(SMSTracker)as a solution to these challenges.It employs a hybrid tensor decomposition self-organizing multihead self-attention transformermechanism,which not only compresses and accelerates Transformer operations but also significantly reduces redundant data,thereby enhancing the accuracy and efficiency of tracking.Additionally,we introduce a self-calibration attention fusion block to resolve common issues of attention ambiguities and inconsistencies found in traditional trackingmethods,ensuring the stability and reliability of tracking performance across various scenarios.By integrating a hybrid tensor decomposition approach with a self-organizingmulti-head self-attentive transformer mechanism,SMSTracker enhances the efficiency and accuracy of the tracking process.Experimental results show that SMSTracker achieves competitive performance in visual object tracking,promising more robust and efficient tracking systems,demonstrating its potential to providemore robust and efficient tracking solutions in real-world applications.

Reinforcement learning based adaptive control for uncertain mechanical systems with asymptotic tracking

This paper mainly focuses on the development of a learning-based controller for a class of uncertain mechanical systems modeled by the Euler-Lagrange formulation.The considered system can depict the behavior of a large class of engineering systems,such as vehicular systems,robot manipulators and satellites.All these systems are often characterized by highly nonlinear characteristics,heavy modeling uncertainties and unknown perturbations,therefore,accurate-model-based nonlinear control approaches become unavailable.Motivated by the challenge,a reinforcement learning(RL)adaptive control methodology based on the actor-critic framework is investigated to compensate the uncertain mechanical dynamics.The approximation inaccuracies caused by RL and the exogenous unknown disturbances are circumvented via a continuous robust integral of the sign of the error(RISE)control approach.Different from a classical RISE control law,a tanh(·)function is utilized instead of a sign(·)function to acquire a more smooth control signal.The developed controller requires very little prior knowledge of the dynamic model,is robust to unknown dynamics and exogenous disturbances,and can achieve asymptotic output tracking.Eventually,co-simulations through ADAMS and MATLAB/Simulink on a three degrees-of-freedom(3-DOF)manipulator and experiments on a real-time electromechanical servo system are performed to verify the performance of the proposed approach.

Investigation of Inside-Out Tracking Methods for Six Degrees of Freedom Pose Estimation of a Smartphone in Augmented Reality

Six degrees of freedom(6DoF)input interfaces are essential formanipulating virtual objects through translation or rotation in three-dimensional(3D)space.A traditional outside-in tracking controller requires the installation of expensive hardware in advance.While inside-out tracking controllers have been proposed,they often suffer from limitations such as interaction limited to the tracking range of the sensor(e.g.,a sensor on the head-mounted display(HMD))or the need for pose value modification to function as an input interface(e.g.,a sensor on the controller).This study investigates 6DoF pose estimation methods without restricting the tracking range,using a smartphone as a controller in augmented reality(AR)environments.Our approach involves proposing methods for estimating the initial pose of the controller and correcting the pose using an inside-out tracking approach.In addition,seven pose estimation algorithms were presented as candidates depending on the tracking range of the device sensor,the tracking method(e.g.,marker recognition,visual-inertial odometry(VIO)),and whether modification of the initial pose is necessary.Through two experiments(discrete and continuous data),the performance of the algorithms was evaluated.The results demonstrate enhanced final pose accuracy achieved by correcting the initial pose.Furthermore,the importance of selecting the tracking algorithm based on the tracking range of the devices and the actual input value of the 3D interaction was emphasized.

Masked Autoencoders as Single Object Tracking Learners

Significant advancements have beenwitnessed in visual tracking applications leveragingViT in recent years,mainly due to the formidablemodeling capabilities of Vision Transformer(ViT).However,the strong performance of such trackers heavily relies on ViT models pretrained for long periods,limitingmore flexible model designs for tracking tasks.To address this issue,we propose an efficient unsupervised ViT pretraining method for the tracking task based on masked autoencoders,called TrackMAE.During pretraining,we employ two shared-parameter ViTs,serving as the appearance encoder and motion encoder,respectively.The appearance encoder encodes randomly masked image data,while the motion encoder encodes randomly masked pairs of video frames.Subsequently,an appearance decoder and a motion decoder separately reconstruct the original image data and video frame data at the pixel level.In this way,ViT learns to understand both the appearance of images and the motion between video frames simultaneously.Experimental results demonstrate that ViT-Base and ViT-Large models,pretrained with TrackMAE and combined with a simple tracking head,achieve state-of-the-art(SOTA)performance without additional design.Moreover,compared to the currently popular MAE pretraining methods,TrackMAE consumes only 1/5 of the training time,which will facilitate the customization of diverse models for tracking.For instance,we additionally customize a lightweight ViT-XS,which achieves SOTA efficient tracking performance.

Practical Prescribed Time Tracking Control With Bounded Time-Varying Gain Under Non-Vanishing Uncertainties

This paper investigates the prescribed-time control(PTC) problem for a class of strict-feedback systems subject to non-vanishing uncertainties. The coexistence of mismatched uncertainties and non-vanishing disturbances makes PTC synthesis nontrivial. In this work, a control method that does not involve infinite time-varying gain is proposed, leading to a practical and global prescribed time tracking control solution for the strict-feedback systems, in spite of both the mismatched and nonvanishing uncertainties. Different from methods based on control switching to avoid the issue of infinite control gain that involves control discontinuity at the switching point, in our method a softening unit is exclusively included to ensure the continuity of the control action. Furthermore, in contrast to most existing prescribed-time control works where the control scheme is only valid on a finite time interval, in this work, the proposed control scheme is valid on the entire time interval. In addition, the prior information on the upper or lower bound of gi is not in need,enlarging the applicability of the proposed method. Both the theoretical analysis and numerical simulation confirm the effectiveness of the proposed control algorithm.

Accurately tracking hypersonic gliding vehicles via an LEO mega-constellation in relay tracking mode

In order to effectively defend against the threats of the hypersonic gliding vehicles(HGVs),HGVs should be tracked as early as possible,which is beyond the capability of the ground-based radars.Being benefited by the developing megaconstellations in low-Earth orbit,this paper proposes a relay tracking mode to track HGVs to overcome the above problem.The whole tracking mission is composed of several tracking intervals with the same duration.Within each tracking interval,several appropriate satellites are dispatched to track the HGV.Satellites that are planned to take part in the tracking mission are selected by a new derived observability criterion.The tracking performances of the proposed tracking mode and the other two traditional tracking modes,including the stare and track-rate modes,are compared by simulation.The results show that the relay tracking mode can track the whole trajectory of a HGV,while the stare mode can only provide a very short tracking arc.Moreover,the relay tracking mode achieve higher tracking accuracy with fewer attitude controls than the track-rate mode.

Demagnetization Analysis and Velocity Tracking Control of In-wheel Motor

The error caused by irreversible demagnetization damages the accurate velocity tracking of an in-wheel motor in a mobile robot.A current feedforward vector control system based on ESO is proposed to compensate it for the demagnetization motor.A demagnetization mathematical model is established to describe a permanent magnet synchronous motor,which took the change of permanent magnet flux linkage parameters as a factor to count the demagnetization error in velocity tracking.The uncertain disturbance estimation model of the control system is built based on ESO,which eliminates the system error by the feedforward current compensation.It is compared with the vector control method in terms of control accuracy.The simulation results show that the current feedforward vector control method based on ESO reduces the velocity tracking error greatly in conditions of motor demagnetization less than 30%.It is effective to improve the operation accuracy of the mobile robot.

Fixed-Time Antidisturbance Consensus Tracking for Nonlinear Multiagent Systems With Matching and Mismatching Disturbances

In this paper,fixed-time consensus tracking for mul-tiagent systems(MASs)with dynamics in the form of strict feed-back affine nonlinearity is addressed.A fixed-time antidistur-bance consensus tracking protocol is proposed,which consists of a distributed fixed-time observer,a fixed-time disturbance observer,a nonsmooth antidisturbance backstepping controller,and the fixed-time stability analysis is conducted by using the Lyapunov theory correspondingly.This paper includes three main improvements.First,a distributed fixed-time observer is developed for each follower to obtain an estimate of the leader’s output by utilizing the topology of the communication network.Second,a fixed-time disturbance observer is given to estimate the lumped disturbances for feedforward compensation.Finally,a nonsmooth antidisturbance backstepping tracking controller with feedforward compensation for lumped disturbances is designed.In order to mitigate the“explosion of complexity”in the tradi-tional backstepping approach,we have implemented a modified nonsmooth command filter to enhance the performance of the closed-loop system.The simulation results show that the pro-posed method is effective.

Hydrodynamic characteristics and particle tracking of 90° lateral intakes at an inclined river slope

Lateral intakes are common in rivers.The pump effciency and sediment deposition are determined by the local hydrodynamic characteristics and mainstream division width.The hydraulic characteristics of lateral withdrawal from inclined river slopes at different intake elevations should be investigated.Meanwhile,the division width exhibits significant vertical non-uniformity at an inclined river slope,which should be clarified.Hence,a three-dimensional(3-D)hydrodynamic and particle-tracking model was developed with the Open Source Field Operation and Manipulation(Open FOAM),and the model was validated with physical model tests for 90°lateral withdrawal from an inclined side bank.The flow fields,withdrawal sources,and division widths were investigated with different intake bottom elevations,withdrawal discharges,and main channel velocities.This study showed that under inclined side bank conditions,water entered the intake at an oblique angle,causing significant 3-D spiral flows in the intake rather than two-dimensional closed recirculation.A lower withdrawal discharge,a lower bottom elevation of the intake,or a higher main channel velocity could further strengthen this phenomenon.The average division width and turbulent kinetic energy were smaller under inclined side bank conditions than under vertical bank conditions.With a low intake bottom elevation,a low withdrawal discharge,or a high main channel velocity,the sources of lateral withdrawal were in similar ranges near the local inclined bank in the vertical direction.Under inclined slope conditions,sediment deposition near the intake entrance could be reduced,compared to that under vertical slope conditions.The results provide hydrodynamic and sediment references for engineering designs for natural rivers with inclined terrains.