The Relations Among Various Markov Chains

Some basic equations and the relations among various Markov chains are established. These works are the bases in the investigation of the theory of Markov chain in random environment.

Markov Chains Based on Random Generalized 1-Flipper Operations for Connected Regular Multi-digraphs

The properties of generalized flip Markov chains on connected regular digraphs are discussed.The 1-Flipper operation on Markov chains for undirected graphs is generalized to that for multi-digraphs.The generalized 1-Flipper operation preserves the regularity and weak connectivity of multi-digraphs.The generalized 1-Flipper operation is proved to be symmetric.Moreover,it is presented that a series of random generalized 1-Flipper operations eventually lead to a uniform probability distribution over all connected d-regular multi-digraphs without loops.

Air Quality Estimation Using Nonhomogeneous Markov Chains: A Case Study Comparing Two Rules Applied to Mexico City Data

A nonhomogeneous Markov chain is applied to the study of the air quality classification in Mexico City when the so-called criterion pollutants are used. We consider the indices associated with air quality using two regulations where different ways of classification are taken into account. Parameters of the model are the initial and transition probabilities of the chain. They are estimated under the Bayesian point of view through samples generated directly from the corresponding posterior distributions. Using the estimated parameters, the probability of having an air quality index in a given hour of the day is obtained.

Ecological Classroom Model for Vocabulary Teaching Based on Markov Chain

This paper explores the current English vocabulary teaching classroom based on an eco-linguistic perspective and the Markov chain,points out the ecological imbalance in the English vocabulary classroom,and proposes measures to solve the problem and strategies to build an ecological English vocabulary learning classroom,in order to provide some reference for future English vocabulary curriculum reform and curriculum design.In this paper,a random sample of 20 students from each class was taken from an advanced arts class and an advanced science class.The results show that after a semester of teaching process,the overall English scores of the arts and science classes improved,and since,the arts classes improved more and the teachers’teaching quality was better.

Weighted Markov chains for forecasting and analysis in Incidence of infectious diseases in jiangsu Province,China

This paper first applies the sequential cluster method to set up the classification standard of infectious disease incidence state based on the fact that there are many uncertainty characteristics in the incidence course.Then the paper presents a weighted Markov chain,a method which is used to predict the future incidence state.This method assumes the standardized self-coefficients as weights based on the special characteristics of infectious disease incidence being a dependent stochastic variable.It also analyzes the characteristics of infectious diseases incidence via the Markov chain Monte Carlo method to make the long-term benefit of decision optimal.Our method is successfully validated using existing incidents data of infectious diseases in Jiangsu Province.In summation,this paper proposes ways to improve the accuracy of the weighted Markov chain,specifically in the field of infection epidemiology.

基于Markov Chain的协议异常检测模型

本文介绍了基于Markov链的协议异常检测模型,此外,通过对MIT Lincoln实验室1999评估数据的分析,证明此模型的正确性和有效性。

基于MLP-ANN与Markov Chain的土地利用变化预测方法——以锡林郭勒盟为例

以北方草地典型地区—内蒙古锡林郭勒盟为案例区,在1995年到2000年的土地利用变化与驱动力分析的基础上,利用土地利用转换类型和驱动力模型,采用多层感知人工神经网络模型分析了各种土地利用类型未来的转换潜力;利用马尔可夫链模型,预测了2005和2010年土地利用格局。预测结果显示:高覆盖度草地减少幅度最大,中覆盖度草地减少相对和缓,高、中覆盖度草地的减少造成了未利用地和低覆盖度草地的增加,尤其是前者增加的幅度最大;从空间分布看,高覆盖度草地的减少集中在西北部地区,主要转变为中低覆盖度草地,中覆盖度草地的减少主要集中在西南部地区,其流向主要是以沙化土地为主的未利用地;案例研究表明,多层感知人工神经网络模型与马尔可夫链模型的结合与应用能够在很大程度上预测稳定驱动力作用下的土地利用变化趋势,从而为生态干预提供指导。

Basic Lithofacies-Succession Model for the Wumishan Cyclothems: Their Markov Chain Analysis and Regularly Vertical Stacking Patterns in the Third-Order Sequences

The Mesoproterozoic Wumishan Formation in the Jixian section of Tianjin is a succession of 3300-m-thick carbonate strata formed in a period of about 100 Ma (1310±20 Ma-1207±10 Ma). In this succession of strata, the carbonate metre-scale cyclic sequences belonging to peritidal type with an approximately symmetrical lithofacies-succession are best developed. The wide development of 1:4 stacking patterns shows that these metre-scale cyclic sequences are genetically related to the short-eccentricity cycles, which are called the Wumishan cyclothems that could truly represent sedimentary cycles. Generally, massive and thick-bedded calcareous dolomites and dolomitic limestones of stromatolite biostromes and thrombolite bioherms constitute the central part of the Wumishan cyclothems. The lower and upper parts consist of tidal flat dolostones, sandy-muddy dolostone and the top part is composed of lagoonal facies dolomitic shales with a paleosol cap. Therefore, an approximately symmetrical lithofacies-succession is formed. Many features such as the clear deepening and shoaling vectors of cyclothems, and all kinds of marks of fresh-water diagenesis indicate that the Wumishan cyclothems are the product of autocyclic sedimentation governed by allocyclic high-frequency sea-level changes. The results of a Markov chain analysis reaffirm the existence of the lithofacies-succession model of the Wumishan cyclothems. The boundaries of the Wumishan cyclothems are marked by the instantaneous exposed punctuated surface, which leads to the discrepancy between the cyclothems and the parasequences of the sequence stratigraphy terminology system. It is difficult to form a judgment that the time span of the Milankovitch cycles in the Precambrian is certainly equal to that of the Phanerozoic, but the regularly vertical stacking patterns of the seventh-order rhythms, sixth-order cyclothems and fifth-order parasequence sets still indicate their consistency with the duration of the Milankovitch cycles in the Phanerozoic.

多重填补法Markov Chain Monte Carlo模型在有缺失值的妇幼卫生纵向数据中的应用

目的 针对妇幼卫生纵向数据的任意缺失模式,采用多重填补方法进行填补,探求最佳填补结果,以便对数据作进一步分析与研究。方法 运用SAS9.0 ,采用多重填补方法Markov China Monte Carlo(MCMC)模型对缺失数据进行多次填补并综合分析。结果 填补5次所得结果最优。结论 多重填补方法可以处理有缺失数据资料中的许多普遍问题,可提高统计效率,尤其是MCMC模型在处理复杂的缺失数据上,优势明显。

THE CLASSIFICATION AND PERIOD OF STATES FOR MARKOV CHAIN IN RANDOM ENVIRONMENT

This paper is a continuation of [8]. In Section 1, three kinds of communication are introdnced for two states and the relations among them are investigated. In Section 2, two kinds of period of a state are introdnced and it is obtained that the period is a 'class property',i.e. two states x and y belong to same class implies the period of x is equal to the period of y.

Intrusion detection based on system calls and homogeneous Markov chains

A novel method for detecting anomalous program behavior is presented, which is applicable to hostbased intrusion detection systems that monitor system call activities. The method constructs a homogeneous Markov chain model to characterize the normal behavior of a privileged program, and associates the states of the Markov chain with the unique system calls in the training data. At the detection stage, the probabilities that the Markov chain model supports the system call sequences generated by the program are computed. A low probability indicates an anomalous sequence that may result from intrusive activities. Then a decision rule based on the number of anomalous sequences in a locality frame is adopted to classify the program＇s behavior. The method gives attention to both computational efficiency and detection accuracy, and is especially suitable for on-line detection. It has been applied to practical host-based intrusion detection systems.

ON MARKOV CHAINS IN SPACE-TIME RANDOM ENVIRONMENTS

In Section 1, the authors establish the models of two kinds of Markov chains in space-time random environments (MCSTRE and MCSTRE(+)) with abstract state space. In Section 2, the authors construct a MCSTRE and a MCSTRE(+) by an initial distribution Φ and a random Markov kernel (RMK) p(γ). In Section 3, the authors es-tablish several equivalence theorems on MCSTRE and MCSTRE(+). Finally, the authors give two very important examples of MCMSTRE, the random walk in spce-time random environment and the Markov br...

THE DECOMPOSITION OF STATE SPACE FOR MARKOV CHAIN IN RANDOM ENVIRONMENT

This paper is a continuation of [8] and [9]. The author obtains the decomposition of state space X of an Markov chain in random environment by making use of the results in [8] and [9], gives three examples, random walk in random environment, renewal process in random environment and queue process in random environment, and obtains the decompositions of the state spaces of these three special examples.

An Algorithm Based on Markov Chain to Improve Edge Cache Hit Ratio for Blockchain-Enabled IoT

Reasonable allocation of storage and computing resources is the basis of building big data system.With the development of IoT(Internet of Things),more data will be brought.A three-layer architecture includes smart devices layer,edge cloud layer and blockchain-based distributed cloud layer.Blockchain is used in IoT for building a distributed decentralize P2P architecture to deal with the secure issue while edge computing deals with increasing volume of data.Edge caching is one of the important application scenarios.In order to allocate edge cache resources reasonably,to improve the quality of service and to reduce the waste of bandwidth resources,this paper proposes a content selection algorithm of edge cache nodes.The algorithm adopts markov chain model,improves the utilization of cache space and reduces the content transmission delay.The hierarchical caching strategy is adopted and the secondary cache stores slides of contents to expand the coverage of cached content and to reduce user waiting time.Regional node cooperation is adopted to expand the cache space and to support the regional preference of cache content.Compared with the classical substitution algorithm,simulation results show that the algorithm in this paper has higher cache hit ratio and higher space utilization.

Grey Markov chain and its application in drift prediction model of FOGs

A novel grey Markov chain predictive model is discussed to reduce drift influence on the output of fiber optical gyroscopes (FOGs) and to improve FOGs' measurement precision. The proposed method possesses advantages of grey model and Markov chain. It makes good use of dynamic modeling idea of the grey model to predict general trend of original data. Then according to the trend, states are divided so that it can overcome the disadvantage of high computational cost of state transition probability matrix in Markov chain. Moreover, the presented approach expands the applied scope of the grey model and makes it be fit for prediction of random data with bigger fluctuation. The numerical results of real drift data from a certain type FOG verify the effectiveness of the proposed grey Markov chain model powerfully. The Markov chain is also investigated to provide a comparison with the grey Markov chain model. It is shown that the hybrid grey Markov chain prediction model has higher modeling precision than Markov chain itself, which prove this proposed method is very applicable and effective.

Bayesian Markov chain Monte Carlo inversion for anisotropy of PP-and PS-wave in weakly anisotropic and heterogeneous media

A single set of vertically aligned cracks embedded in a purely isotropic background may be con- sidered as a long-wavelength effective transversely iso- tropy （HTI） medium with a horizontal symmetry axis. The crack-induced HTI anisotropy can be characterized by the weakly anisotropic parameters introduced by Thomsen. The seismic scattering theory can be utilized for the inversion for the anisotropic parameters in weakly aniso- tropic and heterogeneous HTI media. Based on the seismic scattering theory, we first derived the linearized PP- and PS-wave reflection coefficients in terms of P- and S-wave impedances, density as well as three anisotropic parameters in HTI media. Then, we proposed a novel Bayesian Mar- kov chain Monte Carlo inversion method of PP- and PS- wave for six elastic and anisotropic parameters directly. Tests on synthetic azimuthal seismic data contaminated by random errors demonstrated that this method appears more accurate, anti-noise and stable owing to the usage of the constrained PS-wave compared with the standards inver- sion scheme taking only the PP-wave into account.

STRONG LAW OF LARGE NUMBERS AND SHANNON-MCMILLAN THEOREM FOR MARKOV CHAINS FIELD ON CAYLEY TREE

This paper studies the strong law of large numbers and the Shannom-McMillan theorem for Markov chains field on Cayley tree. The authors first prove the strong law of large number on the frequencies of states and orderd couples of states for Markov chains field on Cayley tree. Then they prove the Shannon-McMillan theorem with a.e. convergence for Markov chains field on Cayley tree. In the proof, a new technique in the study the strong limit theorem in probability theory is applied.

Testing and Evaluation for Web Usability Based on Extended Markov Chain Model

As the increasing popularity and complexity of Web applications and the emergence of their new characteristics, the testing and maintenance of large, complex Web applications are becoming more complex and difficult. Web applications generally contain lots of pages and are used by enormous users. Statistical testing is an effective way of ensuring their quality. Web usage can be accurately described by Markov chain which has been proved to be an ideal model for software statistical testing. The results of unit testing can be utilized in the latter stages, which is an important strategy for bottom-to-top integration testing, and the other improvement of extended Markov chain model (EMM) is to present the error type vector which is treated as a part of page node. this paper also proposes the algorithm for generating test cases of usage paths. Finally, optional usage reliability evaluation methods and an incremental usability regression testing model for testing and evaluation are presented. Key words statistical testing - evaluation for Web usability - extended Markov chain model (EMM) - Web log mining - reliability evaluation CLC number TP311. 5 Foundation item: Supported by the National Defence Research Project (No. 41315. 9. 2) and National Science and Technology Plan (2001BA102A04-02-03)Biography: MAO Cheng-ying (1978-), male, Ph.D. candidate, research direction: software testing. Research direction: advanced database system, software testing, component technology and data mining.

STRONG LAW OF LARGE NUMBERS AND ASYMPTOTIC EQUIPARTITION PROPERTY FOR NONSYMMETRIC MARKOV CHAIN FIELDS ON CAYLEY TREES

Some strong laws of large numbers for the frequencies of occurrence of states and ordered couples of states for nonsymmetric Markov chain fields （NSMC） on Cayley trees are studied. In the proof, a new technique for the study of strong limit theorems of Markov chains is extended to the case of Markov chain fields, The asymptotic equipartition properties with almost everywhere （a,e.） convergence for NSMC on Cayley trees are obtained,

Model of Markov Chains in Space-Time Random Environments

A general framework of stochastic model for a Markov chain in a space-time random environment is introduced, here the environment ξ^＊：={ξ1,x∈N,x∈ X}is a random field. We study the dependence relations between the environment and the original chain, especially the ＂feedback＂. Some equivalence theorems and law of large numbers are obtained.