Data analytics of an information system is conducted based on a Markov decision process(MDP)and a partially observable Markov decision process(POMDP)in this paper.Data analytics over a finite planning horizon and an i...Data analytics of an information system is conducted based on a Markov decision process(MDP)and a partially observable Markov decision process(POMDP)in this paper.Data analytics over a finite planning horizon and an infinite planning horizon for a discounted MDP is performed,respectively.Value iteration(VI),policy iteration(PI),and Q-learning are utilized in the data analytics for a discounted MDP over an infinite planning horizon to evaluate the validity of the MDP model.The optimal policy to minimize the total expected cost of states of the information system is obtained based on the MDP.In the analytics for a discounted POMDP over an infinite planning horizon of the information system,the effects of various parameters on the total expected cost of the information system are studied.展开更多
Since its inception,Systems Engineering(SE)has developed as a distinctive discipline,and there has been significant progress in this field in the past two decades.Compared to other engineering disciplines,SE is not af...Since its inception,Systems Engineering(SE)has developed as a distinctive discipline,and there has been significant progress in this field in the past two decades.Compared to other engineering disciplines,SE is not affirmed by a set of underlying fundamental propositions,instead it has emerged as a set of best practices to deal with intricacies stemming from the stochastic nature of engineering complex systems and addressing their problems.Since the existing methodologies and paradigms(dominant patterns of thought and concepts)of SE are very diverse and somewhat fragmented.This appears to create some confusion regarding the design,deployment,operation,and application of SE.The purpose of this paper is 1)to delineate the development of SE from 1926-2017 based on insights derived from a histogram analysis,2)to discuss the different paradigms and school of thoughts related to SE,3)to derive a set of fundamental attributes of SE using advanced coding techniques and analysis,and 4)to present a newly developed instrument that could assess the performance of systems engineers.More than Two hundred and fifty different sources have been reviewed in this research in order to demonstrate the development trajectory of the SE discipline based on the frequency of publication.展开更多
文摘Data analytics of an information system is conducted based on a Markov decision process(MDP)and a partially observable Markov decision process(POMDP)in this paper.Data analytics over a finite planning horizon and an infinite planning horizon for a discounted MDP is performed,respectively.Value iteration(VI),policy iteration(PI),and Q-learning are utilized in the data analytics for a discounted MDP over an infinite planning horizon to evaluate the validity of the MDP model.The optimal policy to minimize the total expected cost of states of the information system is obtained based on the MDP.In the analytics for a discounted POMDP over an infinite planning horizon of the information system,the effects of various parameters on the total expected cost of the information system are studied.
基金We would like to personally thank anonymous reviewers for raising such questions that have transformed this manuscript into a muchimproved paper.
文摘Since its inception,Systems Engineering(SE)has developed as a distinctive discipline,and there has been significant progress in this field in the past two decades.Compared to other engineering disciplines,SE is not affirmed by a set of underlying fundamental propositions,instead it has emerged as a set of best practices to deal with intricacies stemming from the stochastic nature of engineering complex systems and addressing their problems.Since the existing methodologies and paradigms(dominant patterns of thought and concepts)of SE are very diverse and somewhat fragmented.This appears to create some confusion regarding the design,deployment,operation,and application of SE.The purpose of this paper is 1)to delineate the development of SE from 1926-2017 based on insights derived from a histogram analysis,2)to discuss the different paradigms and school of thoughts related to SE,3)to derive a set of fundamental attributes of SE using advanced coding techniques and analysis,and 4)to present a newly developed instrument that could assess the performance of systems engineers.More than Two hundred and fifty different sources have been reviewed in this research in order to demonstrate the development trajectory of the SE discipline based on the frequency of publication.