This article is concerned with a class of control systems with Markovian switching, in which an It5 formula for Markov-modulated processes is derived. Moreover, an optimal control law satisfying the generalized Hamilt...This article is concerned with a class of control systems with Markovian switching, in which an It5 formula for Markov-modulated processes is derived. Moreover, an optimal control law satisfying the generalized Hamilton-Jacobi-Bellman （HJB） equation with Markovian switching is characterized. Then, through the generalized HJB equation, we study an optimal consumption and portfolio problem with the financial markets of Markovian switching and inflation. Thus, we deduce the optimal policies and show that a modified Mutual Fund Theorem consisting of three funds holds. Finally, for the CRRA utility function, we explicitly give the optimal consumption and portfolio policies. Numerical examples are included to illustrate the obtained results.展开更多
In this paper,we present a new method for finding a fixed local-optimal policy for computing the customer lifetime value.The method is developed for a class of ergodic controllable finite Markov chains.We propose an a...In this paper,we present a new method for finding a fixed local-optimal policy for computing the customer lifetime value.The method is developed for a class of ergodic controllable finite Markov chains.We propose an approach based on a non-converging state-value function that fluctuates（increases and decreases） between states of the dynamic process.We prove that it is possible to represent that function in a recursive format using a one-step-ahead fixed-optimal policy.Then,we provide an analytical formula for the numerical realization of the fixed local-optimal strategy.We also present a second approach based on linear programming,to solve the same problem,that implement the c-variable method for making the problem computationally tractable.At the end,we show that these two approaches are related：after a finite number of iterations our proposed approach converges to same result as the linear programming method.We also present a non-traditional approach for ergodicity verification.The validity of the proposed methods is successfully demonstrated theoretically and,by simulated credit-card marketing experiments computing the customer lifetime value for both an optimization and a game theory approach.展开更多
基金supported by National Natural Science Foundation of China(71171003)Anhui Natural Science Foundation(10040606003)Anhui Natural Science Foundation of Universities(KJ2012B019,KJ2013B023)
文摘This article is concerned with a class of control systems with Markovian switching, in which an It5 formula for Markov-modulated processes is derived. Moreover, an optimal control law satisfying the generalized Hamilton-Jacobi-Bellman （HJB） equation with Markovian switching is characterized. Then, through the generalized HJB equation, we study an optimal consumption and portfolio problem with the financial markets of Markovian switching and inflation. Thus, we deduce the optimal policies and show that a modified Mutual Fund Theorem consisting of three funds holds. Finally, for the CRRA utility function, we explicitly give the optimal consumption and portfolio policies. Numerical examples are included to illustrate the obtained results.
文摘In this paper,we present a new method for finding a fixed local-optimal policy for computing the customer lifetime value.The method is developed for a class of ergodic controllable finite Markov chains.We propose an approach based on a non-converging state-value function that fluctuates（increases and decreases） between states of the dynamic process.We prove that it is possible to represent that function in a recursive format using a one-step-ahead fixed-optimal policy.Then,we provide an analytical formula for the numerical realization of the fixed local-optimal strategy.We also present a second approach based on linear programming,to solve the same problem,that implement the c-variable method for making the problem computationally tractable.At the end,we show that these two approaches are related：after a finite number of iterations our proposed approach converges to same result as the linear programming method.We also present a non-traditional approach for ergodicity verification.The validity of the proposed methods is successfully demonstrated theoretically and,by simulated credit-card marketing experiments computing the customer lifetime value for both an optimization and a game theory approach.
