A Weakly-Supervised Crowd Density Estimation Method Based on Two-Stage Linear Feature Calibration

In a crowd density estimation dataset,the annotation of crowd locations is an extremely laborious task,and they are not taken into the evaluation metrics.In this paper,we aim to reduce the annotation cost of crowd datasets,and propose a crowd density estimation method based on weakly-supervised learning,in the absence of crowd position supervision information,which directly reduces the number of crowds by using the number of pedestrians in the image as the supervised information.For this purpose,we design a new training method,which exploits the correlation between global and local image features by incremental learning to train the network.Specifically,we design a parent-child network(PC-Net)focusing on the global and local image respectively,and propose a linear feature calibration structure to train the PC-Net simultaneously,and the child network learns feature transfer factors and feature bias weights,and uses the transfer factors and bias weights to linearly feature calibrate the features extracted from the Parent network,to improve the convergence of the network by using local features hidden in the crowd images.In addition,we use the pyramid vision transformer as the backbone of the PC-Net to extract crowd features at different levels,and design a global-local feature loss function(L2).We combine it with a crowd counting loss(LC)to enhance the sensitivity of the network to crowd features during the training process,which effectively improves the accuracy of crowd density estimation.The experimental results show that the PC-Net significantly reduces the gap between fullysupervised and weakly-supervised crowd density estimation,and outperforms the comparison methods on five datasets of Shanghai Tech Part A,ShanghaiTech Part B,UCF_CC_50,UCF_QNRF and JHU-CROWD++.

Deep learning for joint channel estimation and feedback in massive MIMO systems

The great potentials of massive Multiple-Input Multiple-Output(MIMO)in Frequency Division Duplex(FDD)mode can be fully exploited when the downlink Channel State Information(CSI)is available at base stations.However,the accurate CsI is difficult to obtain due to the large amount of feedback overhead caused by massive antennas.In this paper,we propose a deep learning based joint channel estimation and feedback framework,which comprehensively realizes the estimation,compression,and reconstruction of downlink channels in FDD massive MIMO systems.Two networks are constructed to perform estimation and feedback explicitly and implicitly.The explicit network adopts a multi-Signal-to-Noise-Ratios(SNRs)technique to obtain a single trained channel estimation subnet that works well with different SNRs and employs a deep residual network to reconstruct the channels,while the implicit network directly compresses pilots and sends them back to reduce network parameters.Quantization module is also designed to generate data-bearing bitstreams.Simulation results show that the two proposed networks exhibit excellent performance of reconstruction and are robust to different environments and quantization errors.

A comparative study of data-driven battery capacity estimation based on partial charging curves

With its generality and practicality, the combination of partial charging curves and machine learning(ML) for battery capacity estimation has attracted widespread attention. However, a clear classification,fair comparison, and performance rationalization of these methods are lacking, due to the scattered existing studies. To address these issues, we develop 20 capacity estimation methods from three perspectives:charging sequence construction, input forms, and ML models. 22,582 charging curves are generated from 44 cells with different battery chemistry and operating conditions to validate the performance. Through comprehensive and unbiased comparison, the long short-term memory(LSTM) based neural network exhibits the best accuracy and robustness. Across all 6503 tested samples, the mean absolute percentage error(MAPE) for capacity estimation using LSTM is 0.61%, with a maximum error of only 3.94%. Even with the addition of 3 m V voltage noise or the extension of sampling intervals to 60 s, the average MAPE remains below 2%. Furthermore, the charging sequences are provided with physical explanations related to battery degradation to enhance confidence in their application. Recommendations for using other competitive methods are also presented. This work provides valuable insights and guidance for estimating battery capacity based on partial charging curves.

Efficient Unsupervised Image Stitching Using Attention Mechanism with Deep Homography Estimation

Traditional feature-based image stitching techniques often encounter obstacles when dealing with images lackingunique attributes or suffering from quality degradation. The scarcity of annotated datasets in real-life scenesseverely undermines the reliability of supervised learning methods in image stitching. Furthermore, existing deeplearning architectures designed for image stitching are often too bulky to be deployed on mobile and peripheralcomputing devices. To address these challenges, this study proposes a novel unsupervised image stitching methodbased on the YOLOv8 (You Only Look Once version 8) framework that introduces deep homography networksand attentionmechanisms. Themethodology is partitioned into three distinct stages. The initial stage combines theattention mechanism with a pooling pyramid model to enhance the detection and recognition of compact objectsin images, the task of the deep homography networks module is to estimate the global homography of the inputimages consideringmultiple viewpoints. The second stage involves preliminary stitching of the masks generated inthe initial stage and further enhancement through weighted computation to eliminate common stitching artifacts.The final stage is characterized by adaptive reconstruction and careful refinement of the initial stitching results.Comprehensive experiments acrossmultiple datasets are executed tometiculously assess the proposed model. Ourmethod’s Peak Signal-to-Noise Ratio (PSNR) and Structure Similarity Index Measure (SSIM) improved by 10.6%and 6%. These experimental results confirm the efficacy and utility of the presented model in this paper.

Cascaded ELM-Based Joint Frame Synchronization and Channel Estimation over Rician Fading Channel with Hardware Imperfections

Due to the interdependency of frame synchronization(FS)and channel estimation(CE),joint FS and CE(JFSCE)schemes are proposed to enhance their functionalities and therefore boost the overall performance of wireless communication systems.Although traditional JFSCE schemes alleviate the influence between FS and CE,they show deficiencies in dealing with hardware imperfection(HI)and deterministic line-of-sight(LOS)path.To tackle this challenge,we proposed a cascaded ELM-based JFSCE to alleviate the influence of HI in the scenario of the Rician fading channel.Specifically,the conventional JFSCE method is first employed to extract the initial features,and thus forms the non-Neural Network(NN)solutions for FS and CE,respectively.Then,the ELMbased networks,named FS-NET and CE-NET,are cascaded to capture the NN solutions of FS and CE.Simulation and analysis results show that,compared with the conventional JFSCE methods,the proposed cascaded ELM-based JFSCE significantly reduces the error probability of FS and the normalized mean square error(NMSE)of CE,even against the impacts of parameter variations.

High-Precision Doppler Frequency Estimation Based Positioning Using OTFS Modulations by Red and Blue Frequency Shift Discriminator

Orthogonal Time Frequency and Space(OTFS) modulation is expected to provide high-speed and ultra-reliable communications for emerging mobile applications, including low-orbit satellite communications. Using the Doppler frequency for positioning is a promising research direction on communication and navigation integration. To tackle the high Doppler frequency and low signal-to-noise ratio(SNR) in satellite communication, this paper proposes a Red and Blue Frequency Shift Discriminator(RBFSD) based on the pseudo-noise(PN) sequence.The paper derives that the cross-correlation function on the Doppler domain exhibits the characteristic of a Sinc function. Therefore, it applies modulation onto the Delay-Doppler domain using PN sequence and adjusts Doppler frequency estimation by red-shifting or blue-shifting. Simulation results show that the performance of Doppler frequency estimation is close to the Cramér-Rao Lower Bound when the SNR is greater than -15dB. The proposed algorithm is about 1/D times less complex than the existing PN pilot sequence algorithm, where D is the resolution of the fractional Doppler.

Model-driven full system dynamics estimation of PMSM-driven chain shell magazine

Based on the system dynamic model, a full system dynamics estimation method is proposed for a chain shell magazine driven by a permanent magnet synchronous motor(PMSM). An adaptive extended state observer(AESO) is proposed to estimate the unmeasured states and disturbance, in which the model parameters are adjusted in real time. Theoretical analysis shows that the estimation errors of the disturbances and unmeasured states converge exponentially to zero, and the parameter estimation error can be obtained from the extended state. Then, based on the extended state of the AESO, a novel parameter estimation law is designed. Due to the convergence of AESO, the novel parameter estimation law is insensitive to controllers and excitation signal. Under persistent excitation(PE) condition, the estimated parameters will converge to a compact set around the actual parameter value. Without PE signal, the estimated parameters will converge to zero for the extended state. Simulation and experimental results show that the proposed method can accurately estimate the unmeasured states and disturbance of the chain shell magazine, and the estimated parameters will converge to the actual value without strictly continuous PE signals.

Side Information-Based Stealthy False Data Injection Attacks Against Multi-Sensor Remote Estimation

Dear Editor,This letter investigates a novel stealthy false data injection(FDI)attack scheme based on side information to deteriorate the multi-sensor estimation performance of cyber-physical systems(CPSs).Compared with most existing works depending on the full system knowledge,this attack scheme is only related to attackers'sensor and physical process model.The design principle of the attack signal is derived to diverge the system estimation performance.Next,it is proven that the proposed attack scheme can successfully bypass the residual-based detector.Finally,all theoretical results are verified by numerical simulation.

Protocol-Based Non-Fragile State Estimation for Delayed Recurrent Neural Networks Subject to Replay Attacks

Dear Editor, This letter focuses on the protocol-based non-fragile state estimation problem for a class of recurrent neural networks(RNNs). With the development of communication technology, the networked systems have received particular attentions. The networked system brings advantages such as easy to implement.

Brain age estimation:premise,promise,and problems

Premise:The com bined effects of modern healthcare practices which prolong lifespan and declining birthrates have created unprecedented changes in age demographics worldwide that are especially pronounced in Japan,South Korea,Europe,and North America.Since old age is the most significant predictor of dementia,global healthcare systems must rise to the challenge of providing care for those with neurodegenerative disorders.

State Estimation of Drive-by-Wire Chassis Vehicle Based on Dual Unscented Particle Filter Algorithm

Accurate vehicle dynamic information plays an important role in vehicle driving safety.However,due to the characteristics of high mobility and multiple controllable degrees of freedom of drive-by-wire chassis vehicles,the current mature application of traditional vehicle state estimation algorithms can not meet the requirements of drive-by-wire chassis vehicle state estimation.This paper proposes a state estimation method for drive-by-wire chassis vehicle based on the dual unscented particle filter algorithm,which make full use of the known advantages of the four-wheel drive torque and steer angle parameters of the drive-by-wire chassis vehicle.In the dual unscented particle filter algorithm,two unscented particle filter transfer information to each other,observe the vehicle state information and the tire force parameter information of the four wheels respectively,which reduce the influence of parameter uncertainty and model parameter changes on the estimation accuracy during driving.The performance with the dual unscented particle filter algorithm,which is analyzed in terms of the time-average square error,is superior of the unscented Kalman filter algorithm.The effectiveness of the algorithm is further verified by driving simulator test.In this paper,a vehicle state estimator based on dual unscented particle filter algorithm was proposed for the first time to improve the estimation accuracy of vehicle parameters and states.

Double-check in Lizard Age Estimation:Use of Phalanx Bone and Keratin Claw Sheath Lamellas

Dear Editor,The problem of age estimation in amphibians and reptiles with annual fluctuations of growth pattern has been considered to be mostly solved since the skeletochronological method was introduced(Kleinenberg and Smirina,1969).This method is based on counting the number of lines of arrested growth(LAGs)—cyclical growth marks that are usually formed annually and characterized by different optical aspects within the tubular bones.

Non-cooperative Space Target Estimation Algorithm Without Prior Information Dependence Based on Temporal Line of Sight Constraint

Under single-satellite observation,the parameter estimation of the boost phase of high-precision space noncooperative targets requires prior information.To improve the accuracy without prior information,we propose a parameter estimation model of the boost phase based on trajectory plane parametric cutting.The use of the plane passing through the geo-center and the cutting sequence line of sight(LOS)generates the trajectory-cutting plane.With the coefficient of the trajectory cutting plane directly used as the parameter to be estimated,a motion parameter estimation model in space non-cooperative targets is established,and the Gauss-Newton iteration method is used to solve the flight parameters.The experimental results show that the estimation algorithm proposed in this paper weakly relies on prior information and has higher estimation accuracy,providing a practical new idea and method for the parameter estimation of space non-cooperative targets under single-satellite warning.

Report for Type 2 Bayes-Fuzzy Estimation in No-Data Problem

It is well known that the system (1 + 1) can be unequal to 2, because this system has both observation error and system error. Furthermore, we must provide our mustered service within our cool head and warm heart, where two states of nature are existing upon us. Any system is regarded as the two-dimensional variable error model. On the other hand, we consider that the fuzziness is existing in this system. Though we can usually obtain the fuzzy number from the possibility theory, it is not fuzzy but possibility, because the possibility function is as same as the likelihood function, and we can obtain the possibility measure by the maximal likelihood method (i.e. max product method proposed by Dr. Hideo Tanaka). Therefore, Fuzzy is regarded as the only one case according to Vague, which has both some state of nature in this world and another state of nature in the other world. Here, we can consider that Type 1 Vague Event in other world can be obtained by mapping and translating from Type 1 fuzzy Event in this world. We named this estimation as Type 1 Bayes-Fuzzy Estimation. When the Vague Events were abnormal (ex. under War), we need to consider that another world could exist around other world. In this case, we call it Type 2 Bayes-Fuzzy Estimation. Where Hori et al. constructed the stochastic different equation upon Type 1 Vague Events, along with the general following probabilistic introduction method from the single regression model, multi-regression model, AR model, Markov (decision) process, to the stochastic different equation. Furthermore, we showed that the system theory approach is Possibility Markov Process, and that the making decision approach is Sequential Bayes Estimation, too. After all, Type 1 Bays-Fuzzy estimation is the special case in Bayes estimation, because the pareto solutions can exist in two stochastic different equations upon Type 2 Vague Events, after we ignore one equation each other (note that this is Type 1 case), we can obtain both its system solution and its decision solution. Here, it is noted that Type 2 Vague estimation can be applied to the shallow abnormal decision problem with possibility reserved judgement. However, it is very important problem that we can have no idea for possibility reserved judgement under the deepest abnormal envelopment (ex. under War). Expect for this deepest abnormal decision problem, Bayes estimation can completely cover fuzzy estimation. In this paper, we explain our flowing study and further research object forward to this deepest abnormal decision problem.

Beamspace maximum likelihood algorithm based on sum and difference beams for elevation estimation

Beamspace super-resolution methods for elevation estimation in multipath environment has attracted significant attention, especially the beamspace maximum likelihood(BML)algorithm. However, the difference beam is rarely used in superresolution methods, especially in low elevation estimation. The target airspace information in the difference beam is different from the target airspace information in the sum beam. And the use of difference beams does not significantly increase the complexity of the system and algorithms. Thus, this paper applies the difference beam to the beamformer to improve the elevation estimation performance of BML algorithm. And the direction and number of beams can be adjusted according to the actual needs. The theoretical target elevation angle root means square error(RMSE) and the computational complexity of the proposed algorithms are analyzed. Finally, computer simulations and real data processing results demonstrate the effectiveness of the proposed algorithms.

Distributed Dynamic Load in Structural Dynamics by the Impulse-Based Force Estimation Algorithm

This paper proposes a novel approach for identifying distributed dynamic loads in the time domain.Using polynomial andmodal analysis,the load is transformed intomodal space for coefficient identification.This allows the distributed dynamic load with a two-dimensional form in terms of time and space to be simultaneously identified in the form of modal force,thereby achieving dimensionality reduction.The Impulse-based Force Estimation Algorithm is proposed to identify dynamic loads in the time domain.Firstly,the algorithm establishes a recursion scheme based on convolution integral,enabling it to identify loads with a long history and rapidly changing forms over time.Secondly,the algorithm introduces moving mean and polynomial fitting to detrend,enhancing its applicability in load estimation.The aforementioned methodology successfully accomplishes the reconstruction of distributed,instead of centralized,dynamic loads on the continuum in the time domain by utilizing acceleration response.To validate the effectiveness of the method,computational and experimental verification were conducted.

Bioinspired Polarized Optical Flow Enables Turbid Underwater Target Motion Estimation

Underwater target motion estimation is a challenge for ocean military and scientific research.In this work,we propose a method based on the combination of polarization imaging and optical flow for turbid underwater target detection.Polarization imaging can reduce the influence of backscattered light and obtain high-quality images underwater.The optical flow shows the motion and structural information of the target.We use polarized optical flow to obtain the optical flow field and estimate the target motion.The experimental results of different targets under varying water turbidity levels illustrate that our method is realizable and robust.The precision is verified by comparing the results with the precise displacement data and calculating two error measures.The proposed method based on polarized optical flow can obtain accurate displacement information and a good recognition effect.Moving target segmentation based on the Otsu method further proves the superiority of the polarized optical flow under turbid water.This study is valuable for target detection and motion estimation in scattering environments.

A Facial Expression Recognition Method Integrating Uncertainty Estimation and Active Learning

The effectiveness of facial expression recognition(FER)algorithms hinges on the model’s quality and the availability of a substantial amount of labeled expression data.However,labeling large datasets demands significant human,time,and financial resources.Although active learning methods have mitigated the dependency on extensive labeled data,a cold-start problem persists in small to medium-sized expression recognition datasets.This issue arises because the initial labeled data often fails to represent the full spectrum of facial expression characteristics.This paper introduces an active learning approach that integrates uncertainty estimation,aiming to improve the precision of facial expression recognition regardless of dataset scale variations.The method is divided into two primary phases.First,the model undergoes self-supervised pre-training using contrastive learning and uncertainty estimation to bolster its feature extraction capabilities.Second,the model is fine-tuned using the prior knowledge obtained from the pre-training phase to significantly improve recognition accuracy.In the pretraining phase,the model employs contrastive learning to extract fundamental feature representations from the complete unlabeled dataset.These features are then weighted through a self-attention mechanism with rank regularization.Subsequently,data from the low-weighted set is relabeled to further refine the model’s feature extraction ability.The pre-trained model is then utilized in active learning to select and label information-rich samples more efficiently.Experimental results demonstrate that the proposed method significantly outperforms existing approaches,achieving an improvement in recognition accuracy of 5.09%and 3.82%over the best existing active learning methods,Margin,and Least Confidence methods,respectively,and a 1.61%improvement compared to the conventional segmented active learning method.

An Enhanced Multiview Transformer for Population Density Estimation Using Cellular Mobility Data in Smart City

This paper addresses the problem of predicting population density leveraging cellular station data.As wireless communication devices are commonly used,cellular station data has become integral for estimating population figures and studying their movement,thereby implying significant contributions to urban planning.However,existing research grapples with issues pertinent to preprocessing base station data and the modeling of population prediction.To address this,we propose methodologies for preprocessing cellular station data to eliminate any irregular or redundant data.The preprocessing reveals a distinct cyclical characteristic and high-frequency variation in population shift.Further,we devise a multi-view enhancement model grounded on the Transformer(MVformer),targeting the improvement of the accuracy of extended time-series population predictions.Comparative experiments,conducted on the above-mentioned population dataset using four alternate Transformer-based models,indicate that our proposedMVformer model enhances prediction accuracy by approximately 30%for both univariate and multivariate time-series prediction assignments.The performance of this model in tasks pertaining to population prediction exhibits commendable results.

Cybersecurity Landscape on Remote State Estimation:A Comprehensive Review

Cyber-physical systems(CPSs)have emerged as an essential area of research in the last decade,providing a new paradigm for the integration of computational and physical units in modern control systems.Remote state estimation(RSE)is an indispensable functional module of CPSs.Recently,it has been demonstrated that malicious agents can manipulate data packets transmitted through unreliable channels of RSE,leading to severe estimation performance degradation.This paper aims to present an overview of recent advances in cyber-attacks and defensive countermeasures,with a specific focus on integrity attacks against RSE.Firstly,two representative frameworks for the synthesis of optimal deception attacks with various performance metrics and stealthiness constraints are discussed,which provide a deeper insight into the vulnerabilities of RSE.Secondly,a detailed review of typical attack detection and resilient estimation algorithms is included,illustrating the latest defensive measures safeguarding RSE from adversaries.Thirdly,some prevalent attacks impairing the confidentiality and data availability of RSE are examined from both attackers'and defenders'perspectives.Finally,several challenges and open problems are presented to inspire further exploration and future research in this field.