Mathematical Modeling of Possibility Markov Chains by Possibility Theory

Statistical regression models are input-oriented estimation models that account for observation errors. On the other hand, an output-oriented possibility regression model that accounts for system fluctuations is proposed. Furthermore, the possibility Markov chain is proposed, which has a disidentifiable state (posterior) and a nondiscriminable state (prior). In this paper, we first take up the entity efficiency evaluation problem as a case study of the posterior non-discriminable production possibility region and mention Fuzzy DEA with fuzzy constraints. Next, the case study of the ex-ante non-discriminable event setting is discussed. Finally, we introduce the measure of the fuzzy number and the equality relation and attempt to model the possibility Markov chain mathematically. Furthermore, we show that under ergodic conditions, the direct sum state can be decomposed and reintegrated using fuzzy OR logic. We had already constructed the Possibility Markov process based on the indifferent state of this world. In this paper, we try to extend it to the indifferent event in another world. It should be noted that we can obtain the possibility transfer matrix by full use of possibility theory.

Application of Cellular Automata and Markov Chain model for urban green infrastructure in Kuala Lumpur,Malaysia

Kuala Lumpur of Malaysia,as a tropical city,has experienced a notable decline in its critical urban green infrastructure(UGI)due to rapid urbanization and haphazard development.The decrease of UGI,especially natural forest and artificial forest,may reduce the diversity of ecosystem services and the ability of Kuala Lumpur to build resilience in the future.This study analyzed land use and land cover(LULC)and UGI changes in Kuala Lumpur based on Landsat satellite images in 1990,2005,and 2021and employed the overall accuracy and Kappa coefficient to assess classification accuracy.LULC was categorized into six main types:natural forest,artificial forest,grassland,water body,bare ground,and built-up area.Satellite images in 1990,2005,and 2021 showed the remarkable overall accuracy values of 91.06%,96.67%,and 98.28%,respectively,along with the significant Kappa coefficient values of 0.8997,0.9626,and 0.9512,respectively.Then,this study utilized Cellular Automata and Markov Chain model to analyze the transition of different LULC types during 1990-2005 and 1990-2021 and predict LULC types in 2050.The results showed that natural forest decreased from 15.22%to 8.20%and artificial forest reduced from 18.51%to 15.16%during 1990-2021.Reductions in natural forest and artificial forest led to alterations in urban surface water dynamics,increasing the risk of urban floods.However,grassland showed a significant increase from 7.80%to 24.30%during 1990-2021.Meanwhile,bare ground increased from 27.16%to 31.56%and built-up area increased from 30.45%to 39.90%during 1990-2005.In 2021,built-up area decreased to 35.10%and bare ground decreased to 13.08%,indicating a consistent dominance of built-up area in the central parts of Kuala Lumpur.This study highlights the importance of integrating past,current,and future LULC changes to improve urban ecosystem services in the city.

Forecast future disasters using hydro-meteorological datasets in the Yamuna river basin,Western Himalaya:Using Markov Chain and LSTM approaches

This research aim to evaluate hydro-meteorological data from the Yamuna River Basin,Uttarakhand,India,utilizing Extreme Value Distribution of Frequency Analysis and the Markov Chain Approach.This method assesses persistence and allows for combinatorial probability estimations such as initial and transitional probabilities.The hydrologic data was generated(in-situ)and received from Uttarakhand Jal Vidut Nigam Limited(UJVNL),and meteorological data was acquired from NASA’s archives MERRA-2 product.A total of sixteen years(2005-2020)of data was used to foresee daily Precipitation from 2020 to 2022.MERRA-2 products are utilized as observed and forecast values for daily Precipitation throughout the monsoon season,which runs from July to September.Markov Chain and Long Short-Term Memory(LSTM)findings for 2020,2021,and 2022 were observed,and anticipated values for daily rainfall during the monsoon season between July and September.According to test findings,the artificial intelligence technique cannot anticipate future regional meteorological formations;the correlation coefficient R^(2) is around 0.12.According to the randomly verified precipitation data findings,the Markov Chain model has a success rate of 79.17 percent.The results suggest that extended return periods should be a warning sign for drought and flood risk in the Himalayan region.This study gives a better knowledge of the water budget,climate change variability,and impact of global warming,ultimately leading to improved water resource management and better emergency planning to the establishment of the Early Warning System(EWS)for extreme occurrences such as cloudbursts,flash floods,landslides hazards in the complex Himalayan region.

D-S理论和Markov链组合的桥梁性能退化预测研究

为准确预测桥梁性能退化,考虑到数据随机性和微小扰动发生状态跳跃,提出了一种D-S(Dempster-Shafer)证据理论和Markov链组合的桥梁性能退化组合预测模型和性能退化率的概念.该模型基于指数平滑(exponential smoothing,ES)方法获得新的预测数据序列,并利用Markov链和D-S理论不断进行优化,从而实现桥梁性能退化的组合预测.实际工程的应用结果表明:性能退化率可以直观地表征在梁性能退化的速度.其次,该模型的平均相对误差为1.54%,较于回归、灰色和模糊加权Markov链模型,精度分别提高了1.11%,0.88%和2.8%,而后验差比值为0.242,小于0.35;模型的标准差为9.021,相比其他模型分别减小了3.978,3.405和7.500,而变异系数为0.109,均小于其他模型,验证了组合预测模型在精度和稳定性方面的优越性,可为在役桥梁结构性能退化预测与维护提供理论基础.

基于RS-SPA-Markov chain的生物质气化站安全评价与预测模型研究

本文在资料收集、实地考察、专家评估的基础上,建立了相对通用的生物质气化站安全评价指标体系,引入了RS-SPA-Markov chain安全评价与预测模型。通过实例应用,证明了该模型应用于生物质气化站安全评价与预测的可行性和科学性,为生物质气化站安全评价与预测提供了一种新的途径。

Auto-selection order of Markov chain for background sequences with chi-square test

Modeling non coding background sequences appropriately is important for the detection of regulatory elements from DNA sequences. Based on the chi square statistic test, some explanations about why to choose higher order Markov chain model and how to automatically select the proper order are given in this paper. The chi square test is first run on synthetic data sets to show that it can efficiently find the proper order of Markov chain. Using chi square test, distinct higher order context dependences inherent in ten sets of sequences of yeast S.cerevisiae from other literature have been found. So the Markov chain with higher order would be more suitable for modeling the non coding background sequences than an independent model.

Applicability of Markov chain-based stochastic model for bubbling fluidized beds

A Markov chain-based stochastic model （MCM） is developed to simulate the movement of particles in a 2D bubbling fluidized bed （BFB）. The state spaces are determined by the discretized physical cells of the bed, and the transition probability matrix is directly calculated by the results of a discrete element method （DEM） simulation. The Markov property of the BFB is discussed by the comparison results calculated from both static and dynamic transition probability matrices. The static matrix is calculated based on the Markov chain while the dynamic matrix is calculated based on the memory property of the particle movement. Results show that the difference in the trends of particle movement between the static and dynamic matrix calculation is very small. Besides, the particle mixing curves of the MCM and DEM have the same trend and similar numerical values, and the details show the time averaged characteristic of the MCM and also expose its shortcoming in describing the instantaneous particle dynamics in the BFB.

东北地区土地覆被格局变化模拟:基于CLUE-S和Markov-CA模型的对比分析

研究以遥感解译的东北地区2000年、2010年、2015年的土地覆被变化为基础,充分考虑自然和社会因素对土地覆被变化的影响,分别通过CLUE-S模型和Markov-CA模型对东北地区2015年和2030年土地覆被格局进行模拟,研究结果表明:通过与遥感解译的2015年实际土地覆被类型数据对比验证,CLUE-S模型和Markov-CA模型模拟结果的总体Kappa指数分别为0.9700和0.9649,结果表明2种模型的模拟结果较为理想,CLUE-S模型的模拟精度较Markov-CA模型更高。2015—2030年东北地区草地、耕地、湿地、其他用地和水体面积呈现下降趋势,林地、人工表面面积呈现增加趋势,人地关系越发紧张。东北地区作为生态环境相对脆弱的区域需警惕不可持续的土地覆被变化,需权衡生态保护、粮食增加与基础设施建设的用地需求和协调发展。

Basic Lithofacies-Succession Model for the Wumishan Cyclothems: Their Markov Chain Analysis and Regularly Vertical Stacking Patterns in the Third-Order Sequences

The Mesoproterozoic Wumishan Formation in the Jixian section of Tianjin is a succession of 3300-m-thick carbonate strata formed in a period of about 100 Ma (1310±20 Ma-1207±10 Ma). In this succession of strata, the carbonate metre-scale cyclic sequences belonging to peritidal type with an approximately symmetrical lithofacies-succession are best developed. The wide development of 1:4 stacking patterns shows that these metre-scale cyclic sequences are genetically related to the short-eccentricity cycles, which are called the Wumishan cyclothems that could truly represent sedimentary cycles. Generally, massive and thick-bedded calcareous dolomites and dolomitic limestones of stromatolite biostromes and thrombolite bioherms constitute the central part of the Wumishan cyclothems. The lower and upper parts consist of tidal flat dolostones, sandy-muddy dolostone and the top part is composed of lagoonal facies dolomitic shales with a paleosol cap. Therefore, an approximately symmetrical lithofacies-succession is formed. Many features such as the clear deepening and shoaling vectors of cyclothems, and all kinds of marks of fresh-water diagenesis indicate that the Wumishan cyclothems are the product of autocyclic sedimentation governed by allocyclic high-frequency sea-level changes. The results of a Markov chain analysis reaffirm the existence of the lithofacies-succession model of the Wumishan cyclothems. The boundaries of the Wumishan cyclothems are marked by the instantaneous exposed punctuated surface, which leads to the discrepancy between the cyclothems and the parasequences of the sequence stratigraphy terminology system. It is difficult to form a judgment that the time span of the Milankovitch cycles in the Precambrian is certainly equal to that of the Phanerozoic, but the regularly vertical stacking patterns of the seventh-order rhythms, sixth-order cyclothems and fifth-order parasequence sets still indicate their consistency with the duration of the Milankovitch cycles in the Phanerozoic.

The Relations Among Various Markov Chains

Some basic equations and the relations among various Markov chains are established. These works are the bases in the investigation of the theory of Markov chain in random environment.

Weighted Markov chains for forecasting and analysis in Incidence of infectious diseases in jiangsu Province,China

This paper first applies the sequential cluster method to set up the classification standard of infectious disease incidence state based on the fact that there are many uncertainty characteristics in the incidence course.Then the paper presents a weighted Markov chain,a method which is used to predict the future incidence state.This method assumes the standardized self-coefficients as weights based on the special characteristics of infectious disease incidence being a dependent stochastic variable.It also analyzes the characteristics of infectious diseases incidence via the Markov chain Monte Carlo method to make the long-term benefit of decision optimal.Our method is successfully validated using existing incidents data of infectious diseases in Jiangsu Province.In summation,this paper proposes ways to improve the accuracy of the weighted Markov chain,specifically in the field of infection epidemiology.

THE CLASSIFICATION AND PERIOD OF STATES FOR MARKOV CHAIN IN RANDOM ENVIRONMENT

This paper is a continuation of [8]. In Section 1, three kinds of communication are introdnced for two states and the relations among them are investigated. In Section 2, two kinds of period of a state are introdnced and it is obtained that the period is a 'class property',i.e. two states x and y belong to same class implies the period of x is equal to the period of y.

Intrusion detection based on system calls and homogeneous Markov chains

A novel method for detecting anomalous program behavior is presented, which is applicable to hostbased intrusion detection systems that monitor system call activities. The method constructs a homogeneous Markov chain model to characterize the normal behavior of a privileged program, and associates the states of the Markov chain with the unique system calls in the training data. At the detection stage, the probabilities that the Markov chain model supports the system call sequences generated by the program are computed. A low probability indicates an anomalous sequence that may result from intrusive activities. Then a decision rule based on the number of anomalous sequences in a locality frame is adopted to classify the program＇s behavior. The method gives attention to both computational efficiency and detection accuracy, and is especially suitable for on-line detection. It has been applied to practical host-based intrusion detection systems.

ON MARKOV CHAINS IN SPACE-TIME RANDOM ENVIRONMENTS

In Section 1, the authors establish the models of two kinds of Markov chains in space-time random environments (MCSTRE and MCSTRE(+)) with abstract state space. In Section 2, the authors construct a MCSTRE and a MCSTRE(+) by an initial distribution Φ and a random Markov kernel (RMK) p(γ). In Section 3, the authors es-tablish several equivalence theorems on MCSTRE and MCSTRE(+). Finally, the authors give two very important examples of MCMSTRE, the random walk in spce-time random environment and the Markov br...

THE DECOMPOSITION OF STATE SPACE FOR MARKOV CHAIN IN RANDOM ENVIRONMENT

This paper is a continuation of [8] and [9]. The author obtains the decomposition of state space X of an Markov chain in random environment by making use of the results in [8] and [9], gives three examples, random walk in random environment, renewal process in random environment and queue process in random environment, and obtains the decompositions of the state spaces of these three special examples.

Grey Markov chain and its application in drift prediction model of FOGs

A novel grey Markov chain predictive model is discussed to reduce drift influence on the output of fiber optical gyroscopes (FOGs) and to improve FOGs' measurement precision. The proposed method possesses advantages of grey model and Markov chain. It makes good use of dynamic modeling idea of the grey model to predict general trend of original data. Then according to the trend, states are divided so that it can overcome the disadvantage of high computational cost of state transition probability matrix in Markov chain. Moreover, the presented approach expands the applied scope of the grey model and makes it be fit for prediction of random data with bigger fluctuation. The numerical results of real drift data from a certain type FOG verify the effectiveness of the proposed grey Markov chain model powerfully. The Markov chain is also investigated to provide a comparison with the grey Markov chain model. It is shown that the hybrid grey Markov chain prediction model has higher modeling precision than Markov chain itself, which prove this proposed method is very applicable and effective.

THE CONSTRUCTION OF MULTITYPE CANONICAL MARKOV BRANCHING CHAINS IN RANDOM ENVIRONMENTS

The investigation for branching processes has a long history by their strong physics background, but only a few authors have investigated the branching processes in random environments. First of all, the author introduces the concepts of the multitype canonical Markov branching chain in random environment （CMBCRE） and multitype Markov branching chain in random environment （MBCRE） and proved that CMBCRE must be MBCRE, and any MBCRE must be equivalent to another CMBCRE in distribution. The main results of this article are the construction of CMBCRE and some of its probability properties.

An Algorithm Based on Markov Chain to Improve Edge Cache Hit Ratio for Blockchain-Enabled IoT

Reasonable allocation of storage and computing resources is the basis of building big data system.With the development of IoT(Internet of Things),more data will be brought.A three-layer architecture includes smart devices layer,edge cloud layer and blockchain-based distributed cloud layer.Blockchain is used in IoT for building a distributed decentralize P2P architecture to deal with the secure issue while edge computing deals with increasing volume of data.Edge caching is one of the important application scenarios.In order to allocate edge cache resources reasonably,to improve the quality of service and to reduce the waste of bandwidth resources,this paper proposes a content selection algorithm of edge cache nodes.The algorithm adopts markov chain model,improves the utilization of cache space and reduces the content transmission delay.The hierarchical caching strategy is adopted and the secondary cache stores slides of contents to expand the coverage of cached content and to reduce user waiting time.Regional node cooperation is adopted to expand the cache space and to support the regional preference of cache content.Compared with the classical substitution algorithm,simulation results show that the algorithm in this paper has higher cache hit ratio and higher space utilization.

Bayesian Markov chain Monte Carlo inversion for anisotropy of PP-and PS-wave in weakly anisotropic and heterogeneous media

A single set of vertically aligned cracks embedded in a purely isotropic background may be con- sidered as a long-wavelength effective transversely iso- tropy （HTI） medium with a horizontal symmetry axis. The crack-induced HTI anisotropy can be characterized by the weakly anisotropic parameters introduced by Thomsen. The seismic scattering theory can be utilized for the inversion for the anisotropic parameters in weakly aniso- tropic and heterogeneous HTI media. Based on the seismic scattering theory, we first derived the linearized PP- and PS-wave reflection coefficients in terms of P- and S-wave impedances, density as well as three anisotropic parameters in HTI media. Then, we proposed a novel Bayesian Mar- kov chain Monte Carlo inversion method of PP- and PS- wave for six elastic and anisotropic parameters directly. Tests on synthetic azimuthal seismic data contaminated by random errors demonstrated that this method appears more accurate, anti-noise and stable owing to the usage of the constrained PS-wave compared with the standards inver- sion scheme taking only the PP-wave into account.

A new grey forecasting model based on BP neural network and Markov chain

A new grey forecasting model based on BP neural network and Markov chain was proposed. In order to combine the grey forecasting model with neural network, an important theorem that the grey differential equation is equivalent to the time response model, was proved by analyzing the features of grey forecasting model（GM（1,1））. Based on this, the differential equation parameters were included in the network when the BP neural network was constructed, and the neural network was trained by extracting samples from grey system＇s known data. When BP network was converged, the whitened grey differential equation parameters were extracted and then the grey neural network forecasting model （GNNM（1,1）） was built. In order to reduce stochastic phenomenon in GNNM（1,1）, the state transition probability between two states was defined and the Markov transition matrix was established by building the residual sequences between grey forecasting and actual value. Thus, the new grey forecasting model（MNNGM（1,1）） was proposed by combining Markov chain with GNNM（1,1）. Based on the above discussion, three different approaches were put forward for forecasting China electricity demands. By comparing GM（1, 1） and GNNM（1,1） with the proposed model, the results indicate that the absolute mean error of MNNGM（1,1） is about 0.4 times of GNNM（1,1） and 0.2 times of GM（I, 1）, and the mean square error of MNNGM（1,1） is about 0.25 times of GNNM（1,1） and 0.1 times of GM（1,1）.