基于马尔科夫决策过程的带缓存双机系统不完美维护策略

Imperfect Maintenance Policy for a Two-Machine One-Buffer System Based on Markov Decision Process

为有效解决退化系统的设备维护优化问题,对带缓存双机系统的预防性维护策略进行研究.首先,考虑两设备的随机退化,针对不完美的小修和预防性维护,通过马尔科夫过程描述系统状态.然后,基于收入和成本,建立生产系统的利润模型.最后,通过最大化长期期望利润,确定不同系统状态下的预防性维护决策.采用值迭代方法对模型进行求解,数值分析结果表明,设备的维护决策不仅取决于自身状态,还受其他设备状态和缓存量的影响.

To solve the problem of machine maintenance optimization of degraded systems,the preventive maintenance policy of a two-machine one-buffer production system is studied.First,random degradations of both machines are considered.For imperfect minimal repair and preventive maintenance,a Markov process is used to describe the system state.Then,a profit model for the production system is established based on cost and income.Finally,preventive maintenance decisions in different system states are determined by maximizing long-term expected profits.The model is solved by value iteration,and numerical analysis results show that the maintenance decision of the machine depends not only on its own state,but also on the state of other machines and the amount of the buffer.