期刊文献+
共找到25篇文章
< 1 2 >
每页显示 20 50 100
Adaptive Gaussian Noise Image Removal Algorithm Using Filtering-Based Noise Estimation 被引量:2
1
作者 Tuan-anh NGUYEN Hong-son NGUYEN Min-cheol HONG 《Journal of Measurement Science and Instrumentation》 CAS 2011年第3期230-234,共5页
This paper proposes a spatially denoising algorithm using filtering-based noise estimation for an image corrupted by Gaussian noise.The proposed algorithm consists of two stages:estimation and elimination of noise den... This paper proposes a spatially denoising algorithm using filtering-based noise estimation for an image corrupted by Gaussian noise.The proposed algorithm consists of two stages:estimation and elimination of noise density.To adaptively deal with variety of the noise amount,a noisy input image is firstly filtered by a lowpass filter.Standard deviation of the noise is computed from different images between the noisy input and its filtered image.In addition,a modified Gaussian noise removal filter based on the local statistics such as local weighted mean,local weighted activity and local maximum is used to control the degree of noise suppression.Experiments show the effectiveness of the proposed algorithm. 展开更多
关键词 DENOISING local statistics Gaussian filtering noise estimation Gaussian noise
下载PDF
Noise estimation and filtering method of MEMS gyroscope based on EMMAP 被引量:1
2
作者 CHEN Guangwu YU Yue +1 位作者 LI Wenyuan LIU Hao 《Journal of Measurement Science and Instrumentation》 CAS CSCD 2021年第2期170-176,共7页
Aiming at the problems of low measurement accuracy,uncertainty and nonlinearity of random noise of the micro electro mechanical system(MEMS)gyroscope,a gyroscope noise estimation and filtering method is proposed,which... Aiming at the problems of low measurement accuracy,uncertainty and nonlinearity of random noise of the micro electro mechanical system(MEMS)gyroscope,a gyroscope noise estimation and filtering method is proposed,which combines expectation maximum(EM)with maximum a posterior(MAP)to form an adpative unscented Kalman filter(UKF),called EMMAP-UKF.According to the MAP estimation principle,a suboptimal unbiased MAP noise statistical estimation model is constructed.Then,EM algorithm is introduced to transform the noise estimation problem into the mathematical expectation maximization problem,which can dynamically adjust the variance of the observed noise.Finally,the estimation and filtering of gyroscope random drift error can be realized.The performance of the gyro noise filtering method is evaluated by Allan variance,and the effectiveness of the method is verified by hardware-in-the-loop simulation. 展开更多
关键词 micro electro mechanical system(MEMS)gyroscope expectation maximization(EM)algorithm noise estimation unscented Kalman filter(UKF)
下载PDF
A maximum noise fraction transform with improved noise estimation for hyperspectral images 被引量:6
3
作者 LIU Xiang ZHANG Bing +1 位作者 GAO LianRu CHEN DongMei 《Science in China(Series F)》 2009年第9期1578-1587,共10页
Feature extraction is often performed to reduce spectral dimension of hyperspectral images before image classification. The maximum noise fraction (MNF) transform is one of the most commonly used spectral feature ex... Feature extraction is often performed to reduce spectral dimension of hyperspectral images before image classification. The maximum noise fraction (MNF) transform is one of the most commonly used spectral feature extraction methods. The spectral features in several bands of hyperspectral images are submerged by the noise. The MNF transform is advantageous over the principle component (PC) transform because it takes the noise information in the spatial domain into consideration. However, the experiments described in this paper demonstrate that classification accuracy is greatly influenced by the MNF transform when the ground objects are mixed together. The underlying mechanism of it is revealed and analyzed by mathematical theory. In order to improve the performance of classification after feature extraction when ground objects are mixed in hyperspectral images, a new MNF transform, with an improved method of estimating hyperspectral image noise covariance matrix (NCM), is presented. This improved MNF transform is applied to both the simulated data and real data. The results show that compared with the classical MNF transform, this new method enhanced the ability of feature extraction and increased classification accuracy. 展开更多
关键词 principal component transform maximum noise fraction transform hyperspectral image noise estimation
原文传递
Carrier frequency offset and impulse noise estimation for underwater acoustic orthogonal frequency division multiplexing 被引量:9
4
作者 SUN Haixin XU Xiaoka +3 位作者 MA Li KUAI Xiaoyan CHENG En CHEN En 《Chinese Journal of Acoustics》 2014年第3期289-298,共10页
The carrier frequency offset(CFO)and impulse noise always affect the performance of underwater acoustic communication_systems.The CFO and impulse noise could be estimated by using the null subcarriers to cancel the ... The carrier frequency offset(CFO)and impulse noise always affect the performance of underwater acoustic communication_systems.The CFO and impulse noise could be estimated by using the null subcarriers to cancel the effects of the two types of interference.The null subcarriers estimation methods include optimal separate estimation and joint estimation.The separate estimation firstly estimates the CFO value and then estimates the impulse noise value.However,the CFO and impulse noise always affect each other when either of them is estimated separately.The performance could be improved by using the joint estimation.The results of simulations and experiments have showed that these two optimization methods have good performance and the joint estimation has better performance than the separate estimation method.There is 3 dB performance gain at the BER value of 10^(-2)when using the joint estimation method.Thus these methods could improve the system robustness by using the CFO compensation and impulse noise suppression. 展开更多
关键词 CFO Carrier frequency offset and impulse noise estimation for underwater acoustic orthogonal frequency division multiplexing BER
原文传递
Noise estimation for deep sub-micron integrated circuits 被引量:1
5
作者 陈彬 杨华中 汪惠 《Science in China(Series F)》 2001年第5期396-400,共5页
Noise analysis and avoidance are an increasingly critical step in the design of deep sub-micron (DSM) integrated circuits (ICs). The crosstalk between neighboring interconnects gradually becomes the main noise sources... Noise analysis and avoidance are an increasingly critical step in the design of deep sub-micron (DSM) integrated circuits (ICs). The crosstalk between neighboring interconnects gradually becomes the main noise sources in DSM ICs. We introduce an efficient and accurate noise-evaluation method for capacitively coupled nets of ICs. The method holds for a victim net with arbitrary number of aggressive nets under ramp input excitation. For common RC nets extracted by electronic design au-tomation (EDA) tools, the deviation between our method and HSPICE is under 10% . 展开更多
关键词 noise estimation CROSSTALK interconnect model.
原文传递
Automatic estimation and removal of noise on digital image
6
作者 Tuananh Nguyen Beomsu Kim Mincheol Hong 《Journal of Measurement Science and Instrumentation》 CAS 2013年第3期256-262,共7页
An spatially adaptive noise detection and removal algorithm is proposed.Under the assumption that an observed image and its additive noise have Gaussian distribution,the noise parameters are estimated with local stati... An spatially adaptive noise detection and removal algorithm is proposed.Under the assumption that an observed image and its additive noise have Gaussian distribution,the noise parameters are estimated with local statistics from an observed degraded image,and the parameters are used to define the constraints on the noise detection process.In addition,an adaptive low-pass filter having a variable filter window defined by the constraints on noise detection is used to control the degree of smoothness of the reconstructed image.Experimental results demonstrate the capability of the proposed algorithm. 展开更多
关键词 noise estimation DENOISING noise parameters local statistics adaptive filterCLC number:TN911.73 Document code:AArticle ID:1674-8042(2013)03-0256-07
下载PDF
Noise level estimation method with application to EMD-based signal denoising 被引量:3
7
作者 Xiaoyu Li Jing Jin +1 位作者 Yi Shen Yipeng Liu 《Journal of Systems Engineering and Electronics》 SCIE EI CSCD 2016年第4期763-771,共9页
This paper proposes a new signal noise level estimation approach by local regions. The estimated noise variance is applied as the threshold for an improved empirical mode decomposition(EMD) based signal denoising me... This paper proposes a new signal noise level estimation approach by local regions. The estimated noise variance is applied as the threshold for an improved empirical mode decomposition(EMD) based signal denoising method. The proposed estimation method can effectively extract the candidate regions for the noise level estimation by measuring the correlation coefficient between noisy signal and a Gaussian filtered signal. For the improved EMD based method, the situation of decomposed intrinsic mode function(IMFs) which contains noise and signal simultaneously are taken into account. Experimental results from two simulated signals and an X-ray pulsar signal demonstrate that the proposed method can achieve better performance than the conventional EMD and wavelet transform(WT) based denoising methods. 展开更多
关键词 signal denoising empirical mode decomposition(EMD) Gaussian filter correlation coefficient noise level estimation
下载PDF
Joint DOA and polarization estimation for unequal power sources based on reconstructed noise subspace 被引量:2
8
作者 Yong Han Qingyuan Fang +2 位作者 Fenggang Yan Ming Jin Xiaolin Qiao 《Journal of Systems Engineering and Electronics》 SCIE EI CSCD 2016年第3期501-513,共13页
In most literature about joint direction of arrival(DOA) and polarization estimation, the case that sources possess different power levels is seldom discussed. However, this case exists widely in practical applicati... In most literature about joint direction of arrival(DOA) and polarization estimation, the case that sources possess different power levels is seldom discussed. However, this case exists widely in practical applications, especially in passive radar systems. In this paper, we propose a joint DOA and polarization estimation method for unequal power sources based on the reconstructed noise subspace. The invariance property of noise subspace(IPNS) to power of sources has been proved an effective method to estimate DOA of unequal power sources. We develop the IPNS method for joint DOA and polarization estimation based on a dual polarized array. Moreover, we propose an improved IPNS method based on the reconstructed noise subspace, which has higher resolution probability than the IPNS method. It is theoretically proved that the IPNS to power of sources is still valid when the eigenvalues of the noise subspace are changed artificially. Simulation results show that the resolution probability of the proposed method is enhanced compared with the methods based on the IPNS and the polarimetric multiple signal classification(MUSIC) method. Meanwhile, the proposed method has approximately the same estimation accuracy as the IPNS method for the weak source. 展开更多
关键词 invariance property of noise subspace(IPNS) joint DOA and polarization estimation multiple signal classification(MUSIC) reconstruction of noise subspace unequal power sources
下载PDF
Research on Restoration of Murals Based on Diffusion Model and Transformer
9
作者 Yaoyao Wang Mansheng Xiao +2 位作者 Yuqing Hu Jin Yan Zeyu Zhu 《Computers, Materials & Continua》 SCIE EI 2024年第9期4433-4449,共17页
Due to the limitations of a priori knowledge and convolution operation,the existing image restoration techniques cannot be directly applied to the cultural relics mural restoration,in order to more accurately restore ... Due to the limitations of a priori knowledge and convolution operation,the existing image restoration techniques cannot be directly applied to the cultural relics mural restoration,in order to more accurately restore the original appearance of the cultural relics mural images,an image restoration based on the denoising diffusion probability model(Denoising Diffusion Probability Model(DDPM))and the Transformer method.The process involves two steps:in the first step,the damaged mural image is firstly utilized as the condition to generate the noise image,using the time,condition and noise image patch as the inputs to the noise prediction network,capturing the global dependencies in the input sequence through the multi-attentionmechanismof the input sequence and feedforward neural network processing,and designing a long skip connection between the shallow and deep layers in the Transformer blocks between the shallow and deep layers using long skip connections to fuse the feature information of global and local outputs to maintain the overall consistency of the restoration results;In the second step,taking the noisy image as a condition to direct the diffusion model to back sample to generate the restored image.Experiment results show that the PSNR and SSIM of the proposedmethod are improved by 2%to 9%and 1%to 3.3%,respectively,which are compared to the comparison methods.This study proposed synthesizes the advantages of the diffusionmodel and deep learningmodel to make themural restoration results more accurate. 展开更多
关键词 TRANSFORMER deep learning noise estimation network diffusion model mural restoration
下载PDF
HMM-based noise estimator for speech enhancement
10
作者 许春冬 夏日升 +2 位作者 应冬文 李军锋 颜永红 《Journal of Beijing Institute of Technology》 EI CAS 2014年第4期549-556,共8页
A noise estimator was presented in this paper by modeling the log-power sequence with hidden Markov model (HMM). The smoothing factor of this estimator was motivated by the speech presence probability at each freque... A noise estimator was presented in this paper by modeling the log-power sequence with hidden Markov model (HMM). The smoothing factor of this estimator was motivated by the speech presence probability at each frequency band. This HMM had a speech state and a nonspeech state, and each state consisted of a unique Gaussian function. The mean of the nonspeech state was the estimation of the noise logarithmic power. To make this estimator run in an on-line manner, an HMM parameter updated method was used based on a first-order recursive process. The noise signal was tracked together with the HMM to be sequentially updated. For the sake of reliability, some constraints were introduced to the HMM. The proposed algorithm was compared with the conventional ones such as minimum statistics (MS) and improved minima controlled recursive averaging (IM- CRA). The experimental results confirms its promising performance. 展开更多
关键词 noise estimation hidden markov model CONSTRAINTS first-order recursive process speech enhancement
下载PDF
Nonparametric VSS-APA based on precise background noise power estimate 被引量:1
11
作者 文昊翔 赖晓翰 +1 位作者 陈隆道 蔡忠法 《Journal of Central South University》 SCIE EI CAS CSCD 2015年第1期251-260,共10页
The adaptive algorithm used for echo cancellation(EC) system needs to provide 1) low misadjustment and 2) high convergence rate. The affine projection algorithm(APA) is a better alternative than normalized least mean ... The adaptive algorithm used for echo cancellation(EC) system needs to provide 1) low misadjustment and 2) high convergence rate. The affine projection algorithm(APA) is a better alternative than normalized least mean square(NLMS) algorithm in EC applications where the input signal is highly correlated. Since the APA with a constant step-size has to make compromise between the performance criteria 1) and 2), a variable step-size APA(VSS-APA) provides a more reliable solution. A nonparametric VSS-APA(NPVSS-APA) is proposed by recovering the background noise within the error signal instead of cancelling the a posteriori errors. The most problematic term of its variable step-size formula is the value of background noise power(BNP). The power difference between the desired signal and output signal, which equals the power of error signal statistically, has been considered the BNP estimate in a rough manner. Considering that the error signal consists of background noise and misalignment noise, a precise BNP estimate is achieved by multiplying the rough estimate with a corrective factor. After the analysis on the power ratio of misalignment noise to background noise of APA, the corrective factor is formulated depending on the projection order and the latest value of variable step-size. The new algorithm which does not require any a priori knowledge of EC environment has the advantage of easier controllability in practical application. The simulation results in the EC context indicate the accuracy of the proposed BNP estimate and the more effective behavior of the proposed algorithm compared with other versions of APA class. 展开更多
关键词 adaptive algorithm affine projection algorithm echo cancellation background noise power estimate variable step-size affine projection algorithm
下载PDF
A new information fusion white noise deconvolution estimator
12
作者 Xiaojun SUN Shigang WANG Zili DENG 《控制理论与应用(英文版)》 EI 2009年第4期438-444,共7页
The white noise deconvolution or input white noise estimation problem has important applications in oil seismic exploration, communication and signal processing. By the modern time series analysis method, based on the... The white noise deconvolution or input white noise estimation problem has important applications in oil seismic exploration, communication and signal processing. By the modern time series analysis method, based on the autoregressive moving average (ARMA) innovation model, a new information fusion white noise deconvolution estimator is presented for the general multisensor systems with different local dynamic models and correlated noises. It can handle the input white noise fused filtering, prediction and smoothing problems, and it is applicable to systems with colored measurement noises. It is locally optimal, and is globally suboptimal. The accuracy of the fuser is higher than that of each local white noise estimator. In order to compute the optimal weights, the formula computing the local estimation error cross-covariances is given. A Monte Carlo simulation example for the system with Bernoulli-Gaussian input white noise shows the effectiveness and performances. 展开更多
关键词 Multisensor information fusion Weighted fusion White noise estimator DECONVOLUTION Modern time series analysis method
下载PDF
INFORMATION FUSION STEADY-STATE WHITE NOISE DECONVOLUTION ESTIMATORS WITH TIME-DELAYED MEASUREMENTS AND COLORED MEASUREMENT NOISES
13
作者 Sun Xiaojun Deng Zili 《Journal of Electronics(China)》 2009年第2期161-167,共7页
White noise deconvolution or input white noise estimation problem has important appli-cation backgrounds in oil seismic exploration,communication and signal processing.By the modern time series analysis method,based o... White noise deconvolution or input white noise estimation problem has important appli-cation backgrounds in oil seismic exploration,communication and signal processing.By the modern time series analysis method,based on the Auto-Regressive Moving Average(ARMA) innovation model,under the linear minimum variance optimal fusion rules,three optimal weighted fusion white noise deconvolution estimators are presented for the multisensor systems with time-delayed measurements and colored measurement noises.They can handle the input white noise fused filtering,prediction and smoothing problems.The accuracy of the fusers is higher than that of each local white noise estimator.In order to compute the optimal weights,the formula of computing the local estimation error cross-covariances is given.A Monte Carlo simulation example for the system with 3 sensors and the Bernoulli-Gaussian input white noise shows their effectiveness and performances. 展开更多
关键词 Multisensor information fusion White noise estimator DECONVOLUTION Time-delayed measurement Modern time series analysis method
下载PDF
SPEECH ENHANCEMENT USING CONSTRAINED SPECTRAL AMPLITUDE SUBTRACTION BASED ON NONCAUSAL A PRIORI SNR 被引量:3
14
作者 Wu Hongwei Wu Zhenyang 《Journal of Electronics(China)》 2006年第6期937-942,共6页
Two gain forms of spectral amplitude subtraction are derived theoretically without neglecting the correlation of speech and noise spectrum during the period of a fralne. In the implementation, the constrained gain is ... Two gain forms of spectral amplitude subtraction are derived theoretically without neglecting the correlation of speech and noise spectrum during the period of a fralne. In the implementation, the constrained gain is expressed as a function of noncausal a priori SNR (Signal-to-Noise Ratio). Noise and noncausal a priori SNR are estimated from the multitaper spectrum of the noisy signal with algorithms modified to be suitable for the multitaper spectruln. Objective evaluations show that in case of white Gaussian noise the proposed method outperforms some methods based on LSA (Log Spectral Amplitude) in terms of MBSD (Modified Bark Spectral Distortion), segmental SNR and overall SNR, and informal listening tests show that speech reconstructed in this way has little speech distortion and musical noise is nearly inaudible even at low SNR. 展开更多
关键词 Speech cnhancement Spectral amplitude subtraction noise estimation Multitaper spectrum
下载PDF
Application of Adaptive Divided Difference Filter on GPS/IMU Integrated Navigation System
15
作者 ZHAO Pei-pei LI Shi-xin XIAO Zhi-tao 《Semiconductor Photonics and Technology》 CAS 2009年第3期158-162,178,共6页
The efficient and accurate approximate nonlinear filters have been widely used in the estimation of states and parameters of dynamical systems. In this paper, an adaptive divided difference filter is designed for prec... The efficient and accurate approximate nonlinear filters have been widely used in the estimation of states and parameters of dynamical systems. In this paper, an adaptive divided difference filter is designed for precise estimation of states and parameters of micromechanical gyro navigation system. Based on the investigation of nonlinear divided difference filter the adaptive divided difference filter(ADDF) was designed, which takes account of the incorrect time-varying noise statistics of dynamical systems and compensation of the nonlinearity effects neglected by linearization. And its performance is superior to that of DDF and extended Kalman filter(EKF). Simulation results indicate that the advantages of the proposed nonlinear filters make them attractive alternatives to the extended Kalman filter. 展开更多
关键词 ADAPTIVE divided difference filter noise estimation
下载PDF
Self-tuning weighted measurement fusion Kalman filter and its convergence 被引量:2
16
作者 Chenjian RAN,Zili DENG (Department of Automation,Heilongjiang University,Harbin Heilongjiang 150080,China) 《控制理论与应用(英文版)》 EI 2010年第4期435-440,共6页
For multisensor systems,when the model parameters and the noise variances are unknown,the consistent fused estimators of the model parameters and noise variances are obtained,based on the system identification algorit... For multisensor systems,when the model parameters and the noise variances are unknown,the consistent fused estimators of the model parameters and noise variances are obtained,based on the system identification algorithm,correlation method and least squares fusion criterion.Substituting these consistent estimators into the optimal weighted measurement fusion Kalman filter,a self-tuning weighted measurement fusion Kalman filter is presented.Using the dynamic error system analysis (DESA) method,the convergence of the self-tuning weighted measurement fusion Kalman filter is proved,i.e.,the self-tuning Kalman filter converges to the corresponding optimal Kalman filter in a realization.Therefore,the self-tuning weighted measurement fusion Kalman filter has asymptotic global optimality.One simulation example for a 4-sensor target tracking system verifies its effectiveness. 展开更多
关键词 Multisensor weighted measurement fusion Fused parameter estimator Fused noise variance estimator Self-tuning fusion Kalman filter Asymptotic global optimality CONVERGENCE
下载PDF
Decoupled Wiener state fuser for descriptor systems 被引量:1
17
作者 Chenjian RAN Zili DENG 《控制理论与应用(英文版)》 EI 2008年第4期365-371,共7页
By the modem time series analysis method, based on the autoregressive moving average (ARMA) innovation models and white noise estimation theory, using the optimal fusion rule weighted by diagonal matrices, a distrib... By the modem time series analysis method, based on the autoregressive moving average (ARMA) innovation models and white noise estimation theory, using the optimal fusion rule weighted by diagonal matrices, a distributed descriptor Wiener state fuser is presented by weighting the local Wiener state estimators for the linear discrete stochastic descriptor systems with multisensor. It realizes a decoupled fusion estimation for state components. In order to compute the optimal weights, the formulas of computing the cross-covariances among local estimation errors are presented based on cross-covariances among the local innovation processes, input white noise, and measurement white noises. It can handle the fused filtering, smoothing, and prediction problems in a unified framework. Its accuracy is higher than that of each local estimator. A Monte Carlo simulation example shows its effectiveness and correctness. 展开更多
关键词 Multisensor information fusion Weighted fusion Decoupled fusion Descriptor system Wiener statefuser White noise estimator ARMA innovation model Modern time series analysis method
下载PDF
The frequency estimation of harmonic signals embedded in multiplicative and additive noise
18
作者 FAN Yangyu1,2 TAO Baoqi1 XIONG Ke1 SHANG Jiuhao2 SUN Jincai3 LI Yaan3(1 The key Laboratory for Smart Materials and Structures, Nanjing University of Aeronautics andAstronautics Nanjing 210016)(2 Mechanical & Electrical Engineering College, Northwest Unive 《Chinese Journal of Acoustics》 2002年第3期271-277,共7页
A method to separate a harmonic signal from multiplicative and additive noises is proposed. The method is to square the signal x(t), which consists of a harmonic signal embedded in multiplicative and additive noises, ... A method to separate a harmonic signal from multiplicative and additive noises is proposed. The method is to square the signal x(t), which consists of a harmonic signal embedded in multiplicative and additive noises, to form another signal y(t) = x2(t)-E[x2(t)]. After y(t) having been gotten, the Fourier transform is imposed on it. Because the information of x(t) (especially about frequency) is included in y(t), the frequency of x(t) can be estimated from the power spectrum of y(t). According to the simulation, under the condition where frequencies divided by resolution dω are integer, the maximum relative error of estimated frequencies is less than 0.4% when the signal-to-noise ratio (SNR) is greater than -23 dB. If frequencies divided by resolution dω are not integer, the maximum relative error will be less than 2.9%. But it is still small in terms of engineering. 展开更多
关键词 The frequency estimation of harmonic signals embedded in multiplicative and additive noise
原文传递
A noise cross PSD estimator for dual-microphone speech enhancement based on minimum statistics 被引量:3
19
作者 Mohsen RAHMANI Ahmad AKBARI +1 位作者 Beghdad AYAD Nima DERAKHSHAN 《Journal of Zhejiang University-Science A(Applied Physics & Engineering)》 SCIE EI CAS CSCD 2009年第6期805-809,共5页
Some two-microphone noise reduction techniques that work in the frequency domain exploit coherence function between two noisy signals. They have shown good results when noise signals on two sensors are uncorrelated, b... Some two-microphone noise reduction techniques that work in the frequency domain exploit coherence function between two noisy signals. They have shown good results when noise signals on two sensors are uncorrelated, but their per-formance decreases with correlated noises. Coherence based methods can be improved when the cross power spectral density (CPSD) of correlated noise signals is available. In this paper, we propose a new method for estimation of the CPSD of the noise, which is based on the minimum tracking technique. Despite the fact that the proposed estimator does not need to implement a voice activity detector (VAD), its performance is comparable to a CPSD estimator that uses an ideal VAD. 展开更多
关键词 Two-channel noise reduction noise estimation Minima tracking
原文传递
A robust optimization method for label noisy datasets based on adaptive threshold: Adaptive-k
20
作者 Enes DEDEOGLU Himmet Toprak KESGIN Mehmet Fatih AMASYALI 《Frontiers of Computer Science》 SCIE EI CSCD 2024年第4期49-60,共12页
The use of all samples in the optimization process does not produce robust results in datasets with label noise.Because the gradients calculated according to the losses of the noisy samples cause the optimization proc... The use of all samples in the optimization process does not produce robust results in datasets with label noise.Because the gradients calculated according to the losses of the noisy samples cause the optimization process to go in the wrong direction.In this paper,we recommend using samples with loss less than a threshold determined during the optimization,instead of using all samples in the mini-batch.Our proposed method,Adaptive-k,aims to exclude label noise samples from the optimization process and make the process robust.On noisy datasets,we found that using a threshold-based approach,such as Adaptive-k,produces better results than using all samples or a fixed number of low-loss samples in the mini-batch.On the basis of our theoretical analysis and experimental results,we show that the Adaptive-k method is closest to the performance of the Oracle,in which noisy samples are entirely removed from the dataset.Adaptive-k is a simple but effective method.It does not require prior knowledge of the noise ratio of the dataset,does not require additional model training,and does not increase training time significantly.In the experiments,we also show that Adaptive-k is compatible with different optimizers such as SGD,SGDM,and Adam.The code for Adaptive-k is available at GitHub. 展开更多
关键词 robust optimization label noise noisy label deep learning noisy datasets noise ratio estimation robust training
原文传递
上一页 1 2 下一页 到第
使用帮助 返回顶部