In the case of Z+^d(d ≥ 2)-the positive d-dimensional lattice points with partial ordering ≤, {Xk,k∈ Z+^d} i.i.d, random variables with mean 0, Sn =∑k≤nXk and Vn^2 = ∑j≤nXj^2, the precise asymptotics for ∑...In the case of Z+^d(d ≥ 2)-the positive d-dimensional lattice points with partial ordering ≤, {Xk,k∈ Z+^d} i.i.d, random variables with mean 0, Sn =∑k≤nXk and Vn^2 = ∑j≤nXj^2, the precise asymptotics for ∑n1/|n|(log|n|dP(|Sn/Vn|≥ε√log log|n|) and ∑n(logn|)b/|n|(log|n|)^d-1P(|Sn/Vn|≥ε√log n),as ε↓0,is established.展开更多
In this case study, we would like to illustrate the utility of characteristic functions, using an example of a sample statistic defined for samples from Cauchy distribution. The derivation of the corresponding asympto...In this case study, we would like to illustrate the utility of characteristic functions, using an example of a sample statistic defined for samples from Cauchy distribution. The derivation of the corresponding asymptotic probability density function is based on [1], elaborating and expanding the individual steps of their presentation, and including a small extension;our reason for such a plagiarism is to make the technique, its mathematical tools and ingenious arguments available to the widest possible audience.展开更多
The Berry-Esseen bound provides an upper bound on the Kolmogorov distance between a random variable and the normal distribution.In this paper,we establish Berry-Esseen bounds with optimal rates for self-normalized sum...The Berry-Esseen bound provides an upper bound on the Kolmogorov distance between a random variable and the normal distribution.In this paper,we establish Berry-Esseen bounds with optimal rates for self-normalized sums of locally dependent random variables,assuming only a second-moment condition.Our proof leverages Stein's method and introduces a novel randomized concentration inequality,which may also be of independent interest for other applications.Our main results have applied to self-normalized sums of m-dependent random variables and graph dependency models.展开更多
With the continuous growth of online news articles,there arises the necessity for an efficient abstractive summarization technique for the problem of information overloading.Abstractive summarization is highly complex...With the continuous growth of online news articles,there arises the necessity for an efficient abstractive summarization technique for the problem of information overloading.Abstractive summarization is highly complex and requires a deeper understanding and proper reasoning to come up with its own summary outline.Abstractive summarization task is framed as seq2seq modeling.Existing seq2seq methods perform better on short sequences;however,for long sequences,the performance degrades due to high computation and hence a two-phase self-normalized deep neural document summarization model consisting of improvised extractive cosine normalization and seq2seq abstractive phases has been proposed in this paper.The novelty is to parallelize the sequence computation training by incorporating feed-forward,the self-normalized neural network in the Extractive phase using Intra Cosine Attention Similarity(Ext-ICAS)with sentence dependency position.Also,it does not require any normalization technique explicitly.Our proposed abstractive Bidirectional Long Short Term Memory(Bi-LSTM)encoder sequence model performs better than the Bidirectional Gated Recurrent Unit(Bi-GRU)encoder with minimum training loss and with fast convergence.The proposed model was evaluated on the Cable News Network(CNN)/Daily Mail dataset and an average rouge score of 0.435 was achieved also computational training in the extractive phase was reduced by 59%with an average number of similarity computations.展开更多
Let {X,Xn,n1} be a sequence of independent identically distributed random variables with EX=0 and assume that EX2I(|X|≤x) is slowly varying as x→∞,i.e.,X is in the domain of attraction of the normal law.In this pap...Let {X,Xn,n1} be a sequence of independent identically distributed random variables with EX=0 and assume that EX2I(|X|≤x) is slowly varying as x→∞,i.e.,X is in the domain of attraction of the normal law.In this paper a Strassen-type strong approximation is established for self-normalized sums of such random variables.展开更多
Let {X n,n≥1} be a stationary LNQD or NA sequence satisfying EX 1=μ,EX 2 1<∞ and (Var S n)/n→σ 2 as n→∞.In this paper a class of self-normalized central limit theorems and estimators of Var S n are ...Let {X n,n≥1} be a stationary LNQD or NA sequence satisfying EX 1=μ,EX 2 1<∞ and (Var S n)/n→σ 2 as n→∞.In this paper a class of self-normalized central limit theorems and estimators of Var S n are studied.The weak and strong consistency of the estimators of Var S n are presented.展开更多
The research for the Intelligent Reflecting Surface(IRS)which has the advantages of cost and energy efficiency has been studied.Channel capacity can be effectively increased by appropriately setting the phase value of...The research for the Intelligent Reflecting Surface(IRS)which has the advantages of cost and energy efficiency has been studied.Channel capacity can be effectively increased by appropriately setting the phase value of IRS elements according to the channel conditions.However,the problem of obtaining an appropriate phase value of IRs is difficult to solve due to the non-convex problem.This paper proposes an iterative algorithm for the alternating optimal solution in the Single User Multiple-Input-Multiple-Output(SU-MIMO)systems.The proposed iterative algorithm finds an alternating optimal solution that is the phase value of IRS one by one.The results show that the proposed method has better performance than that of the randomized IRS systems.The number of iterations for maximizing the performance of the proposed algorithm depends on the channel state between the IRS and the receiver.展开更多
Self-normalizing neural networks(SNN)regulate the activation and gradient flows through activation functions with the self-normalization property.As SNNs do not rely on norms computed from minibatches,they are more fr...Self-normalizing neural networks(SNN)regulate the activation and gradient flows through activation functions with the self-normalization property.As SNNs do not rely on norms computed from minibatches,they are more friendly to data parallelism,kernel fusion,and emerging architectures such as ReRAM-based accelerators.However,existing SNNs have mainly demonstrated their effectiveness on toy datasets and fall short in accuracy when dealing with large-scale tasks like ImageNet.They lack the strong normalization,regularization,and expression power required for wider,deeper models and larger-scale tasks.To enhance the normalization strength,this paper introduces a comprehensive and practical definition of the self-normalization property in terms of the stability and attractiveness of the statistical fixed points.It is comprehensive as it jointly considers all the fixed points used by existing studies:the first and second moment of forward activation and the expected Frobenius norm of backward gradient.The practicality comes from the analytical equations provided by our paper to assess the stability and attractiveness of each fixed point,which are derived from theoretical analysis of the forward and backward signals.The proposed definition is applied to a meta activation function inspired by prior research,leading to a stronger self-normalizing activation function named‘‘bi-scaled exponential linear unit with backward standardized’’(bSELU-BSTD).We provide both theoretical and empirical evidence to show that it is superior to existing studies.To enhance the regularization and expression power,we further propose scaled-Mixup and channel-wise scale&shift.With these three techniques,our approach achieves 75.23%top-1 accuracy on the ImageNet with Conv MobileNet V1,surpassing the performance of existing self-normalizing activation functions.To the best of our knowledge,this is the first SNN that achieves comparable accuracy to batch normalization on ImageNet.展开更多
In this paper,we investigate the complete convergence and complete moment conver-gence for weighted sums of arrays of rowwise asymptotically negatively associated(ANA)random variables,without assuming identical distri...In this paper,we investigate the complete convergence and complete moment conver-gence for weighted sums of arrays of rowwise asymptotically negatively associated(ANA)random variables,without assuming identical distribution.The obtained results not only extend those of An and Yuan[1]and Shen et al.[2]to the case of ANA random variables,but also partially improve them.展开更多
Slope stability analysis is a classical mechanical problem in geotechnical engineering and engineering geology.It is of great significance to study the stability evolution of expansive soil slopes for engineering cons...Slope stability analysis is a classical mechanical problem in geotechnical engineering and engineering geology.It is of great significance to study the stability evolution of expansive soil slopes for engineering construction in expansive soil areas.Most of the existing studies evaluate the slope stability by analyzing the limit equilibrium state of the slope,and the analysis method for the stability evolution considering the damage softening of the shear zone is lacking.In this study,the large deformation shear mechanical behavior of expansive soil was investigated by ring shear test.The damage softening characteristic of expansive soil in the shear zone was analyzed,and a shear damage model reflecting the damage softening behavior of expansive soil was derived based on the damage theory.Finally,by skillfully combining the vector sum method and the shear damage model,an analysis method for the stability evolution of the expansive soil slope considering the shear zone damage softening was proposed.The results show that the shear zone subjected to large displacement shear deformation exhibits an obvious damage softening phenomenon.The damage variable equation based on the logistic function can be well used to describe the shear damage characteristics of expansive soil,and the proposed shear damage model is in good agreement with the ring shear test results.The vector sum method considering the damage softening behavior of the shear zone can be well applied to analyze the stability evolution characteristics of the expansive soil slope.The stability factor of the expansive soil slope decreases with the increase of shear displacement,showing an obvious progressive failure behavior.展开更多
Let variables in the {X, Xn, n ≥ 1} be a sequence of strictly stationary φ-mixing positive random domain of attraction of the normal law. Under some suitable conditions the principle for self-normalized products of ...Let variables in the {X, Xn, n ≥ 1} be a sequence of strictly stationary φ-mixing positive random domain of attraction of the normal law. Under some suitable conditions the principle for self-normalized products of partial sums is obtained.展开更多
The Linear variable differential transformer(LVDT)is widely used in the aircraft field and crucial to the safety of the aircraft.Based on the short-circuit failure mode between the high and common ends of the LVDT′s ...The Linear variable differential transformer(LVDT)is widely used in the aircraft field and crucial to the safety of the aircraft.Based on the short-circuit failure mode between the high and common ends of the LVDT′s lead wires,the theoretical formula of short-circuit sum voltage was deduced and verified via tests.Moreover,the effects of the core length and the winding resistance on the short-circuit sum voltage were analyzed and discussed through numerical methods.The present research put forward some references for LVDT′s design.展开更多
It is well established that Nash equilibrium exists within the framework of mixed strategies in strategic-form non-cooperative games. However, finding the Nash equilibrium generally belongs to the class of problems kn...It is well established that Nash equilibrium exists within the framework of mixed strategies in strategic-form non-cooperative games. However, finding the Nash equilibrium generally belongs to the class of problems known as PPAD (Polynomial Parity Argument on Directed graphs), for which no polynomial-time solution methods are known, even for two-player games. This paper demonstrates that in fixed-sum two-player games (including zero-sum games), the Nash equilibrium forms a convex set, and has a unique expected payoff. Furthermore, these equilibria are Pareto optimal. Additionally, it is shown that the Nash equilibrium of fixed-sum two-player games can theoretically be found in polynomial time using the principal-dual interior point method, a solution method of linear programming.展开更多
In this article, the unit root test for AR(p) model with GARCH errors is considered. The Dickey-Fuller test statistics are rewritten in the form of self-normalized sums, and the asymptotic distribution of the test s...In this article, the unit root test for AR(p) model with GARCH errors is considered. The Dickey-Fuller test statistics are rewritten in the form of self-normalized sums, and the asymptotic distribution of the test statistics is derived under the weak conditions.展开更多
Sums of convergent series for any desired number of terms, which may be infinite, are estimated very accurately by establishing definite rational polynomials. For infinite number of terms the sum infinite is obtained ...Sums of convergent series for any desired number of terms, which may be infinite, are estimated very accurately by establishing definite rational polynomials. For infinite number of terms the sum infinite is obtained by taking the asymptotic limit of the rational polynomial. A rational function with second-degree polynomials both in the numerator and denominator is found to produce excellent results. Sums of series with different characteristics such as alternating signs are considered for testing the performance of the proposed approach.展开更多
In this paper,we use the elementary methods,the properties of Dirichlet character sums and the classical Gauss sums to study the estimation of the mean value of high-powers for a special character sum modulo a prime,a...In this paper,we use the elementary methods,the properties of Dirichlet character sums and the classical Gauss sums to study the estimation of the mean value of high-powers for a special character sum modulo a prime,and derive an exact computational formula.It can be conveniently programmed by the“Mathematica”software,by which we can get the exact results easily.展开更多
文摘In the case of Z+^d(d ≥ 2)-the positive d-dimensional lattice points with partial ordering ≤, {Xk,k∈ Z+^d} i.i.d, random variables with mean 0, Sn =∑k≤nXk and Vn^2 = ∑j≤nXj^2, the precise asymptotics for ∑n1/|n|(log|n|dP(|Sn/Vn|≥ε√log log|n|) and ∑n(logn|)b/|n|(log|n|)^d-1P(|Sn/Vn|≥ε√log n),as ε↓0,is established.
文摘In this case study, we would like to illustrate the utility of characteristic functions, using an example of a sample statistic defined for samples from Cauchy distribution. The derivation of the corresponding asymptotic probability density function is based on [1], elaborating and expanding the individual steps of their presentation, and including a small extension;our reason for such a plagiarism is to make the technique, its mathematical tools and ingenious arguments available to the widest possible audience.
基金supported by the Singapore Ministry of Education Academic Research Fund Tier 2(Grant No.MOE2018-T2-2-076)。
文摘The Berry-Esseen bound provides an upper bound on the Kolmogorov distance between a random variable and the normal distribution.In this paper,we establish Berry-Esseen bounds with optimal rates for self-normalized sums of locally dependent random variables,assuming only a second-moment condition.Our proof leverages Stein's method and introduces a novel randomized concentration inequality,which may also be of independent interest for other applications.Our main results have applied to self-normalized sums of m-dependent random variables and graph dependency models.
文摘With the continuous growth of online news articles,there arises the necessity for an efficient abstractive summarization technique for the problem of information overloading.Abstractive summarization is highly complex and requires a deeper understanding and proper reasoning to come up with its own summary outline.Abstractive summarization task is framed as seq2seq modeling.Existing seq2seq methods perform better on short sequences;however,for long sequences,the performance degrades due to high computation and hence a two-phase self-normalized deep neural document summarization model consisting of improvised extractive cosine normalization and seq2seq abstractive phases has been proposed in this paper.The novelty is to parallelize the sequence computation training by incorporating feed-forward,the self-normalized neural network in the Extractive phase using Intra Cosine Attention Similarity(Ext-ICAS)with sentence dependency position.Also,it does not require any normalization technique explicitly.Our proposed abstractive Bidirectional Long Short Term Memory(Bi-LSTM)encoder sequence model performs better than the Bidirectional Gated Recurrent Unit(Bi-GRU)encoder with minimum training loss and with fast convergence.The proposed model was evaluated on the Cable News Network(CNN)/Daily Mail dataset and an average rouge score of 0.435 was achieved also computational training in the extractive phase was reduced by 59%with an average number of similarity computations.
基金supported by an NSERC Canada Discovery Grant of M.Csrgo at Carleton UniversityNational Natural Science Foundation of China(Grant No.10801122)+1 种基金Research Fund for the Doctoral Program of Higher Education of China(Grant No.200803581009)the Fundamental Research Funds for the Central Universities
文摘Let {X,Xn,n1} be a sequence of independent identically distributed random variables with EX=0 and assume that EX2I(|X|≤x) is slowly varying as x→∞,i.e.,X is in the domain of attraction of the normal law.In this paper a Strassen-type strong approximation is established for self-normalized sums of such random variables.
基金the National Natural Science Foundation of China(1 0 0 71 0 72 )
文摘Let {X n,n≥1} be a stationary LNQD or NA sequence satisfying EX 1=μ,EX 2 1<∞ and (Var S n)/n→σ 2 as n→∞.In this paper a class of self-normalized central limit theorems and estimators of Var S n are studied.The weak and strong consistency of the estimators of Var S n are presented.
基金supported by the MSIT(Ministry of Science and ICT),Korea,under the ITRC(Information Technology Research Center)support program(IITP-2022-2018-0-01423)supervised by the ITP(Institute for Information&Communications Technology Planning&Evaluation)supported by Basic Science Research Program through the National Research Foundation of Korea(NRF)funded by the Ministry of Education(2020R1A6A1A03038540).
文摘The research for the Intelligent Reflecting Surface(IRS)which has the advantages of cost and energy efficiency has been studied.Channel capacity can be effectively increased by appropriately setting the phase value of IRS elements according to the channel conditions.However,the problem of obtaining an appropriate phase value of IRs is difficult to solve due to the non-convex problem.This paper proposes an iterative algorithm for the alternating optimal solution in the Single User Multiple-Input-Multiple-Output(SU-MIMO)systems.The proposed iterative algorithm finds an alternating optimal solution that is the phase value of IRS one by one.The results show that the proposed method has better performance than that of the randomized IRS systems.The number of iterations for maximizing the performance of the proposed algorithm depends on the channel state between the IRS and the receiver.
基金National Key R&D Program of China(2018AAA0102600)National Natural Science Foundation of China(No.61876215,62106119)+1 种基金Beijing Academy of Artificial Intelligence(BAAI),ChinaChinese Institute for Brain Research,Beijing,and the Science and Technology Major Project of Guangzhou,China(202007030006).
文摘Self-normalizing neural networks(SNN)regulate the activation and gradient flows through activation functions with the self-normalization property.As SNNs do not rely on norms computed from minibatches,they are more friendly to data parallelism,kernel fusion,and emerging architectures such as ReRAM-based accelerators.However,existing SNNs have mainly demonstrated their effectiveness on toy datasets and fall short in accuracy when dealing with large-scale tasks like ImageNet.They lack the strong normalization,regularization,and expression power required for wider,deeper models and larger-scale tasks.To enhance the normalization strength,this paper introduces a comprehensive and practical definition of the self-normalization property in terms of the stability and attractiveness of the statistical fixed points.It is comprehensive as it jointly considers all the fixed points used by existing studies:the first and second moment of forward activation and the expected Frobenius norm of backward gradient.The practicality comes from the analytical equations provided by our paper to assess the stability and attractiveness of each fixed point,which are derived from theoretical analysis of the forward and backward signals.The proposed definition is applied to a meta activation function inspired by prior research,leading to a stronger self-normalizing activation function named‘‘bi-scaled exponential linear unit with backward standardized’’(bSELU-BSTD).We provide both theoretical and empirical evidence to show that it is superior to existing studies.To enhance the regularization and expression power,we further propose scaled-Mixup and channel-wise scale&shift.With these three techniques,our approach achieves 75.23%top-1 accuracy on the ImageNet with Conv MobileNet V1,surpassing the performance of existing self-normalizing activation functions.To the best of our knowledge,this is the first SNN that achieves comparable accuracy to batch normalization on ImageNet.
基金National Natural Science Foundation of China (Grant Nos.12061028, 71871046)Support Program of the Guangxi China Science Foundation (Grant No.2018GXNSFAA281011)。
文摘In this paper,we investigate the complete convergence and complete moment conver-gence for weighted sums of arrays of rowwise asymptotically negatively associated(ANA)random variables,without assuming identical distribution.The obtained results not only extend those of An and Yuan[1]and Shen et al.[2]to the case of ANA random variables,but also partially improve them.
基金supported by the National Key Research and Development Program of China(Grant No.2019YFC1509901).
文摘Slope stability analysis is a classical mechanical problem in geotechnical engineering and engineering geology.It is of great significance to study the stability evolution of expansive soil slopes for engineering construction in expansive soil areas.Most of the existing studies evaluate the slope stability by analyzing the limit equilibrium state of the slope,and the analysis method for the stability evolution considering the damage softening of the shear zone is lacking.In this study,the large deformation shear mechanical behavior of expansive soil was investigated by ring shear test.The damage softening characteristic of expansive soil in the shear zone was analyzed,and a shear damage model reflecting the damage softening behavior of expansive soil was derived based on the damage theory.Finally,by skillfully combining the vector sum method and the shear damage model,an analysis method for the stability evolution of the expansive soil slope considering the shear zone damage softening was proposed.The results show that the shear zone subjected to large displacement shear deformation exhibits an obvious damage softening phenomenon.The damage variable equation based on the logistic function can be well used to describe the shear damage characteristics of expansive soil,and the proposed shear damage model is in good agreement with the ring shear test results.The vector sum method considering the damage softening behavior of the shear zone can be well applied to analyze the stability evolution characteristics of the expansive soil slope.The stability factor of the expansive soil slope decreases with the increase of shear displacement,showing an obvious progressive failure behavior.
基金National Natural Science Foundation of China(1067117610771192).
文摘Let variables in the {X, Xn, n ≥ 1} be a sequence of strictly stationary φ-mixing positive random domain of attraction of the normal law. Under some suitable conditions the principle for self-normalized products of partial sums is obtained.
文摘The Linear variable differential transformer(LVDT)is widely used in the aircraft field and crucial to the safety of the aircraft.Based on the short-circuit failure mode between the high and common ends of the LVDT′s lead wires,the theoretical formula of short-circuit sum voltage was deduced and verified via tests.Moreover,the effects of the core length and the winding resistance on the short-circuit sum voltage were analyzed and discussed through numerical methods.The present research put forward some references for LVDT′s design.
文摘It is well established that Nash equilibrium exists within the framework of mixed strategies in strategic-form non-cooperative games. However, finding the Nash equilibrium generally belongs to the class of problems known as PPAD (Polynomial Parity Argument on Directed graphs), for which no polynomial-time solution methods are known, even for two-player games. This paper demonstrates that in fixed-sum two-player games (including zero-sum games), the Nash equilibrium forms a convex set, and has a unique expected payoff. Furthermore, these equilibria are Pareto optimal. Additionally, it is shown that the Nash equilibrium of fixed-sum two-player games can theoretically be found in polynomial time using the principal-dual interior point method, a solution method of linear programming.
基金National Natural Science Foundation of China(1047112610671176).
文摘In this article, the unit root test for AR(p) model with GARCH errors is considered. The Dickey-Fuller test statistics are rewritten in the form of self-normalized sums, and the asymptotic distribution of the test statistics is derived under the weak conditions.
文摘Sums of convergent series for any desired number of terms, which may be infinite, are estimated very accurately by establishing definite rational polynomials. For infinite number of terms the sum infinite is obtained by taking the asymptotic limit of the rational polynomial. A rational function with second-degree polynomials both in the numerator and denominator is found to produce excellent results. Sums of series with different characteristics such as alternating signs are considered for testing the performance of the proposed approach.
文摘In this paper,we use the elementary methods,the properties of Dirichlet character sums and the classical Gauss sums to study the estimation of the mean value of high-powers for a special character sum modulo a prime,and derive an exact computational formula.It can be conveniently programmed by the“Mathematica”software,by which we can get the exact results easily.