Quantification of behaviors in macaques provides crucial support for various scientific disciplines,including pharmacology,neuroscience,and ethology.Despite recent advancements in the analysis of macaque behavior,rese...Quantification of behaviors in macaques provides crucial support for various scientific disciplines,including pharmacology,neuroscience,and ethology.Despite recent advancements in the analysis of macaque behavior,research on multi-label behavior detection in socially housed macaques,including consideration of interactions among them,remains scarce.Given the lack of relevant approaches and datasets,we developed the Behavior-Aware Relation Network(BARN)for multi-label behavior detection of socially housed macaques.Our approach models the relationship of behavioral similarity between macaques,guided by a behavior-aware module and novel behavior classifier,which is suitable for multi-label classification.We also constructed a behavior dataset of rhesus macaques using ordinary RGB cameras mounted outside their cages.The dataset included 65?913 labels for19 behaviors and 60?367 proposals,including identities and locations of the macaques.Experimental results showed that BARN significantly improved the baseline SlowFast network and outperformed existing relation networks.In conclusion,we successfully achieved multilabel behavior detection of socially housed macaques with both economic efficiency and high accuracy.展开更多
In recent years,unmanned air vehicles(UAVs)are widely used in many military and civilian applications.With the big amount of UAVs operation in air space,the potential security and privacy problems are arising.This can...In recent years,unmanned air vehicles(UAVs)are widely used in many military and civilian applications.With the big amount of UAVs operation in air space,the potential security and privacy problems are arising.This can lead to consequent harm for critical infrastructure in the event of these UAVs being used for criminal or terrorist purposes.Therefore,it is crucial to promptly identify the suspicious behaviors from the surrounding UAVs for some important regions.In this paper,a novel fuzzy logic based UAV behavior detection system has been presented to detect the different levels of risky behaviors of the incoming UAVs.The heading velocity and region type are two input indicators proposed for the risk indicator output in the designed fuzzy logic based system.The simulation has shown the effective and feasible of the proposed algorithm in terms of recall and precision of the detection.Especially,the suspicious behavior detection algorithm can provide a recall of 0.89 and a precision of 0.95 for the high risk scenario in the simulation.展开更多
A novel image sequence-based risk behavior detection method to achieve high-precision risk behavior detection for power maintenance personnel is proposed in this paper.In this method,the original image sequence data i...A novel image sequence-based risk behavior detection method to achieve high-precision risk behavior detection for power maintenance personnel is proposed in this paper.In this method,the original image sequence data is first separated from the foreground and background.Then,the free anchor frame detection method is used in the foreground image to detect the personnel and correct their direction.Finally,human posture nodes are extracted from each frame of the image sequence,which are then used to identify the abnormal behavior of the human.Simulation experiment results demonstrate that the proposed algorithm has significant advantages in terms of the accuracy of human posture node detection and risk behavior identification.展开更多
In recent years, sub-synchronous oscillation accidents caused by wind power integration have received extensive attention. The recorded constant-amplitude waveforms can be induced by either linear or nonlinear oscilla...In recent years, sub-synchronous oscillation accidents caused by wind power integration have received extensive attention. The recorded constant-amplitude waveforms can be induced by either linear or nonlinear oscillation mechanisms. Hence, the nonlinear behavior needs to be distinguished prior to choosing the analysis method. Since the 1960s, the higher-order statistics(HOS) theory has become a powerful tool for the detection of nonlinear behavior(DNB) in production quality control wherein it has mainly been applied to mechanical condition monitoring and fault diagnosis. This study focuses on the hard limiters of the voltage source converter(VSC) control systems in the wind farms and attempts to detect the nonlinear behavior caused by bi-or uni-lateral saturation hard limiting using the HOS analysis. First, the conventional describing function is extended to obtain the detailed frequency domain information on the bi-and uni-lateral saturation hard limiting. Furthermore, the bi-and tri-spectra are introduced as the HOS, which are extended into bi-and tri-coherence spectra to eliminate the effects of the linear parts on the harmonic characteristics of hard limiting in the VSC control system, respectively. The effectiveness of the HOS in the DNB and the classification of the hard-limiting types is proven, and its detailed derivation and estimation procedure is presented. Finally, the quadratic and cubic phase coupling in the signals is illustrated, and the performance of the proposed method is evaluated and discussed.展开更多
The frame rate of conventional vision systems is restricted to the video signal formats (e.g., NTSC 30 fps and PAL 25 fps) that are designed on the basis of the characteristics of the human eye, which implies that t...The frame rate of conventional vision systems is restricted to the video signal formats (e.g., NTSC 30 fps and PAL 25 fps) that are designed on the basis of the characteristics of the human eye, which implies that the processing speed of these systems is limited to the recognition speed of the human eye. However, there is a strong demand for real-time high-speed vision sensors in many application fields, such as factory automation, biomedicine, and robotics, where high-speed operations are carried out. These high-speed operations can be tracked and inspected by using high-speed vision systems with intelligent sensors that work at hundreds of Hertz or more, especially when the operation is difficult to observe with the human eye. This paper reviews advances in developing real-time high Speed vision systems and their applications in various fields, such as intelligent logging systems, vibration dynamics sensing, vision-based mechanical control, three-dimensional measurement/automated visual inspection, vision-based human interface, and biomedical applications.展开更多
Key requirements of successful animal behavior research in the laboratory are robustness,objectivity,and high throughput,which apply to both the recording and analysis of behavior.Many automatic methods of monitoring ...Key requirements of successful animal behavior research in the laboratory are robustness,objectivity,and high throughput,which apply to both the recording and analysis of behavior.Many automatic methods of monitoring animal behavior meet these requirements.However,they usually depend on high-performing hardware and sophisticated software,which may be expensive.Here,we describe an automatic infrared behavior-monitor(AIBM)system based on an infrared touchscreen frame.Using this,animal positions can be recorded and used for further behavioral analysis by any PC supporting touch events.This system detects animal behavior in real time and gives closed-loop feedback using relatively low computing resources and simple algorithms.The AIBM system automatically records and analyzes multiple types of animal behavior in a highly efficient,unbiased,and low-cost manner.展开更多
基金supported by the Major Project of the National Natural Science Foundation of China (82090051,81871442)Outstanding Member Project of Youth Innovation Promotion Association of the Chinese Academy of Sciences (Y201930)。
文摘Quantification of behaviors in macaques provides crucial support for various scientific disciplines,including pharmacology,neuroscience,and ethology.Despite recent advancements in the analysis of macaque behavior,research on multi-label behavior detection in socially housed macaques,including consideration of interactions among them,remains scarce.Given the lack of relevant approaches and datasets,we developed the Behavior-Aware Relation Network(BARN)for multi-label behavior detection of socially housed macaques.Our approach models the relationship of behavioral similarity between macaques,guided by a behavior-aware module and novel behavior classifier,which is suitable for multi-label classification.We also constructed a behavior dataset of rhesus macaques using ordinary RGB cameras mounted outside their cages.The dataset included 65?913 labels for19 behaviors and 60?367 proposals,including identities and locations of the macaques.Experimental results showed that BARN significantly improved the baseline SlowFast network and outperformed existing relation networks.In conclusion,we successfully achieved multilabel behavior detection of socially housed macaques with both economic efficiency and high accuracy.
基金supported by the Fundamental Research Funds for the Central Universities(No.NJ20160015)
文摘In recent years,unmanned air vehicles(UAVs)are widely used in many military and civilian applications.With the big amount of UAVs operation in air space,the potential security and privacy problems are arising.This can lead to consequent harm for critical infrastructure in the event of these UAVs being used for criminal or terrorist purposes.Therefore,it is crucial to promptly identify the suspicious behaviors from the surrounding UAVs for some important regions.In this paper,a novel fuzzy logic based UAV behavior detection system has been presented to detect the different levels of risky behaviors of the incoming UAVs.The heading velocity and region type are two input indicators proposed for the risk indicator output in the designed fuzzy logic based system.The simulation has shown the effective and feasible of the proposed algorithm in terms of recall and precision of the detection.Especially,the suspicious behavior detection algorithm can provide a recall of 0.89 and a precision of 0.95 for the high risk scenario in the simulation.
基金supported by the project“Research and application of key technologies of safe production management and control of substation operation and maintenance based on video semantic analysis”(5700-202133259A-0-0-00)of the State Grid Corporation of China.
文摘A novel image sequence-based risk behavior detection method to achieve high-precision risk behavior detection for power maintenance personnel is proposed in this paper.In this method,the original image sequence data is first separated from the foreground and background.Then,the free anchor frame detection method is used in the foreground image to detect the personnel and correct their direction.Finally,human posture nodes are extracted from each frame of the image sequence,which are then used to identify the abnormal behavior of the human.Simulation experiment results demonstrate that the proposed algorithm has significant advantages in terms of the accuracy of human posture node detection and risk behavior identification.
基金supported by the State Grid Guide Project(No.5108-202218030A-1-1-ZN)。
文摘In recent years, sub-synchronous oscillation accidents caused by wind power integration have received extensive attention. The recorded constant-amplitude waveforms can be induced by either linear or nonlinear oscillation mechanisms. Hence, the nonlinear behavior needs to be distinguished prior to choosing the analysis method. Since the 1960s, the higher-order statistics(HOS) theory has become a powerful tool for the detection of nonlinear behavior(DNB) in production quality control wherein it has mainly been applied to mechanical condition monitoring and fault diagnosis. This study focuses on the hard limiters of the voltage source converter(VSC) control systems in the wind farms and attempts to detect the nonlinear behavior caused by bi-or uni-lateral saturation hard limiting using the HOS analysis. First, the conventional describing function is extended to obtain the detailed frequency domain information on the bi-and uni-lateral saturation hard limiting. Furthermore, the bi-and tri-spectra are introduced as the HOS, which are extended into bi-and tri-coherence spectra to eliminate the effects of the linear parts on the harmonic characteristics of hard limiting in the VSC control system, respectively. The effectiveness of the HOS in the DNB and the classification of the hard-limiting types is proven, and its detailed derivation and estimation procedure is presented. Finally, the quadratic and cubic phase coupling in the signals is illustrated, and the performance of the proposed method is evaluated and discussed.
文摘The frame rate of conventional vision systems is restricted to the video signal formats (e.g., NTSC 30 fps and PAL 25 fps) that are designed on the basis of the characteristics of the human eye, which implies that the processing speed of these systems is limited to the recognition speed of the human eye. However, there is a strong demand for real-time high-speed vision sensors in many application fields, such as factory automation, biomedicine, and robotics, where high-speed operations are carried out. These high-speed operations can be tracked and inspected by using high-speed vision systems with intelligent sensors that work at hundreds of Hertz or more, especially when the operation is difficult to observe with the human eye. This paper reviews advances in developing real-time high Speed vision systems and their applications in various fields, such as intelligent logging systems, vibration dynamics sensing, vision-based mechanical control, three-dimensional measurement/automated visual inspection, vision-based human interface, and biomedical applications.
基金This work was supported by a Shenzhen Governmental Grant(JCYJ20180302145710934)the National Natural Science Foundation of China(31700907 and 31700908)+6 种基金the Key-Area Research and Development Program of Guangdong Province(2018B030331001)the International Partnership Program of the Chinese Academy of Sciences(172644KYS820170004)the Strategic Priority Research Program of Chinese Academy of Science(XDB32030100)Guangdong Special Support Program([2018]9)Ten Thousand Talent ProgramKey Laboratory of SIAT(2019DP173024)the Center for Excellence in Brain Science and Intelligence Technology,Chinese Academy of Sciences.
文摘Key requirements of successful animal behavior research in the laboratory are robustness,objectivity,and high throughput,which apply to both the recording and analysis of behavior.Many automatic methods of monitoring animal behavior meet these requirements.However,they usually depend on high-performing hardware and sophisticated software,which may be expensive.Here,we describe an automatic infrared behavior-monitor(AIBM)system based on an infrared touchscreen frame.Using this,animal positions can be recorded and used for further behavioral analysis by any PC supporting touch events.This system detects animal behavior in real time and gives closed-loop feedback using relatively low computing resources and simple algorithms.The AIBM system automatically records and analyzes multiple types of animal behavior in a highly efficient,unbiased,and low-cost manner.