This paper develops asymptotic properties of singularly perturbed Markov chains with inclusion of absorbing states.It focuses on both unscaled and scaled occupation measures.Under mild conditions,a mean-square estimat...This paper develops asymptotic properties of singularly perturbed Markov chains with inclusion of absorbing states.It focuses on both unscaled and scaled occupation measures.Under mild conditions,a mean-square estimate is obtained.By averaging the fast components,we obtain an aggregated process.Although the aggregated process itself may be non-Markovian,its weak limit is a Markov chain with much smaller state space.Moreover,a suitably scaled sequence consisting of a component of scaled occupation measures and a component of the aggregated process is shown to converge to a pair of processes with a switching diffusion component.展开更多
We introduce the results on the multifractal structure of the occupation measures of a Brownian Motion, a stable process, a general subordinator and a stochastic process derived from random reordering of the Cantor se...We introduce the results on the multifractal structure of the occupation measures of a Brownian Motion, a stable process, a general subordinator and a stochastic process derived from random reordering of the Cantor set. We also introduced an interesting and powerful technique to investigate the multifractal spectrum.展开更多
Using the hyper-exponential recurrence criterion,we establish the occupation measures’large deviation principle for a class of non-linear monotone stochastic partial differential equations(SPDEs)driven by Wiener nois...Using the hyper-exponential recurrence criterion,we establish the occupation measures’large deviation principle for a class of non-linear monotone stochastic partial differential equations(SPDEs)driven by Wiener noise,including the stochastic p-Laplace equation,the stochastic porous medium equation and the stochastic fast-diffusion equation.We also propose a framework for verifying hyper-exponential recurrence,and apply it to study the large deviation problems for strong dissipative SPDEs.These SPDEs can be stochastic systems driven by heavy-tailedα-stable process.展开更多
Suppose X is a super-α-stable process in R^d, (0 〈 α〈 2), whose branching rate function is dr, and branching mechanism is of the form ψ(z) = z^1+β (0 〈0 〈β ≤1). Let Xγ and Yγ denote the exit measur...Suppose X is a super-α-stable process in R^d, (0 〈 α〈 2), whose branching rate function is dr, and branching mechanism is of the form ψ(z) = z^1+β (0 〈0 〈β ≤1). Let Xγ and Yγ denote the exit measure and the total weighted occupation time measure of X in a bounded smooth domain D, respectively. The absolute continuities of Xγ and Yγ are discussed.展开更多
This paper analyzes current spectrum utilization from all aspects based on related methods of spectrum measurement. The measurement results show that some spectrum resources are not used effectively due to current fix...This paper analyzes current spectrum utilization from all aspects based on related methods of spectrum measurement. The measurement results show that some spectrum resources are not used effectively due to current fixed spectrum allocation policy, and the spectrum occupancy varies dramatically in terms of time and space. These results provide basis for the development of next generation wireless communication technologies such as Cognitive Radio (CR).展开更多
Let {X(t),t ∈ R+} be an integrated α stable process. In this paper, a functional law of the iterated logarithm (LIL) is derived via estimating the small ball probability of X. As a corollary,, the classical C...Let {X(t),t ∈ R+} be an integrated α stable process. In this paper, a functional law of the iterated logarithm (LIL) is derived via estimating the small ball probability of X. As a corollary,, the classical Chung LIL of X is obtained. Furthermore, some results about the weighted occupation measure of X(t) are established.展开更多
Let {Xm(t), t∈R+} be an m-Fold integrated Brownian motion. In this paper, with the help of small ball probability estimate, a functional law of the iterated logarithm (LIL) for Xm(t) is established. This exten...Let {Xm(t), t∈R+} be an m-Fold integrated Brownian motion. In this paper, with the help of small ball probability estimate, a functional law of the iterated logarithm (LIL) for Xm(t) is established. This extends the classic Chung type liminf result for this process. Furthermore, a result about the weighted occupation measure for Xm(t) is also obtained.展开更多
This paper attempts to study the convergence of optimal values and optimal policies of continuous-time Markov decision processes(CTMDP for short)under the constrained average criteria. For a given original model M_∞o...This paper attempts to study the convergence of optimal values and optimal policies of continuous-time Markov decision processes(CTMDP for short)under the constrained average criteria. For a given original model M_∞of CTMDP with denumerable states and a sequence {M_n} of CTMDP with finite states, we give a new convergence condition to ensure that the optimal values and optimal policies of {M_n} converge to the optimal value and optimal policy of M_∞as the state space Snof Mnconverges to the state space S_∞of M_∞, respectively. The transition rates and cost/reward functions of M_∞are allowed to be unbounded. Our approach can be viewed as a combination method of linear program and Lagrange multipliers.展开更多
文摘This paper develops asymptotic properties of singularly perturbed Markov chains with inclusion of absorbing states.It focuses on both unscaled and scaled occupation measures.Under mild conditions,a mean-square estimate is obtained.By averaging the fast components,we obtain an aggregated process.Although the aggregated process itself may be non-Markovian,its weak limit is a Markov chain with much smaller state space.Moreover,a suitably scaled sequence consisting of a component of scaled occupation measures and a component of the aggregated process is shown to converge to a pair of processes with a switching diffusion component.
基金Supported by the National Natural Science Foundation of China
文摘We introduce the results on the multifractal structure of the occupation measures of a Brownian Motion, a stable process, a general subordinator and a stochastic process derived from random reordering of the Cantor set. We also introduced an interesting and powerful technique to investigate the multifractal spectrum.
基金supported by National Natural Science Foundation of China(Grant Nos.11431014 and 11671076)supported by University of Macao Multi-Year Research Grant(Grant No.MYRG2016-00025-FST)Science and Technology Development Fund,Macao SAR(Grant Nos.025/2016/A1,030/2016/A1 and 038/2017/A1)the Faculty of Science and Technology,University of Macao,for financial support and hospitality。
文摘Using the hyper-exponential recurrence criterion,we establish the occupation measures’large deviation principle for a class of non-linear monotone stochastic partial differential equations(SPDEs)driven by Wiener noise,including the stochastic p-Laplace equation,the stochastic porous medium equation and the stochastic fast-diffusion equation.We also propose a framework for verifying hyper-exponential recurrence,and apply it to study the large deviation problems for strong dissipative SPDEs.These SPDEs can be stochastic systems driven by heavy-tailedα-stable process.
基金Supported by NNSF of China (10001020 and 10471003), Foundation for Authors Awarded Excellent Ph.D.Dissertation
文摘Suppose X is a super-α-stable process in R^d, (0 〈 α〈 2), whose branching rate function is dr, and branching mechanism is of the form ψ(z) = z^1+β (0 〈0 〈β ≤1). Let Xγ and Yγ denote the exit measure and the total weighted occupation time measure of X in a bounded smooth domain D, respectively. The absolute continuities of Xγ and Yγ are discussed.
文摘This paper analyzes current spectrum utilization from all aspects based on related methods of spectrum measurement. The measurement results show that some spectrum resources are not used effectively due to current fixed spectrum allocation policy, and the spectrum occupancy varies dramatically in terms of time and space. These results provide basis for the development of next generation wireless communication technologies such as Cognitive Radio (CR).
基金Supported by National Natural Science Foundation of China (Grant Nos. 10131040, 10371109 and 10801118)
文摘Let {X(t),t ∈ R+} be an integrated α stable process. In this paper, a functional law of the iterated logarithm (LIL) is derived via estimating the small ball probability of X. As a corollary,, the classical Chung LIL of X is obtained. Furthermore, some results about the weighted occupation measure of X(t) are established.
基金Project supported by the National Natural Science Foundation of China (No.10131040)the Specialized Research Fund for the Doctor Program of Higher Education (No.2002335090).
文摘Let {Xm(t), t∈R+} be an m-Fold integrated Brownian motion. In this paper, with the help of small ball probability estimate, a functional law of the iterated logarithm (LIL) for Xm(t) is established. This extends the classic Chung type liminf result for this process. Furthermore, a result about the weighted occupation measure for Xm(t) is also obtained.
文摘This paper attempts to study the convergence of optimal values and optimal policies of continuous-time Markov decision processes(CTMDP for short)under the constrained average criteria. For a given original model M_∞of CTMDP with denumerable states and a sequence {M_n} of CTMDP with finite states, we give a new convergence condition to ensure that the optimal values and optimal policies of {M_n} converge to the optimal value and optimal policy of M_∞as the state space Snof Mnconverges to the state space S_∞of M_∞, respectively. The transition rates and cost/reward functions of M_∞are allowed to be unbounded. Our approach can be viewed as a combination method of linear program and Lagrange multipliers.