基于增强学习的半导体测试调度研究

Scheduling Study for Semiconductor Final Test Based on Reinforcement Learning

采用Sarsa(λ,k)学习算法求解、产品、测试机、测试工具包、使能器部件对应关系非常复杂的半导体测试调度问题。针对测试调度,通过定义系统状态的表示方式、构造行为和报酬函数把调度问题转化为增强学习问题,并把Sarsa(λ,k)算法和梯度下降径向基神经网络函数泛化器结合使用。实验验证了Sarsa(λ,k)算法解决半导体测试调度问题的有效性。Sarsa(λ,k)算法通过反复解决调度问题来调整调度策略,能克服单个行为策略短视的缺点,综合利用各个行为策略的优点,从而找到较优的调度方案。

Semiconductor test scheduling problem is a variation of reentrant unrelated parallel machine problem considering intricate multiple resources constraints and sequence-dependant setup times, etc. A multi-step reinforcement learning（RL）algorithm called Sarsa（λ, k）was applied to deal with the semiconductor final test scheduling problem. Allowing enabler reconfiguration,the production capacity of the test facility was expanded and scheduling optimization was performed at the component level. In order to apply Sarsa（λ, k）, the scheduling problem was transformed into an RL problem by defining state representation, constructing actions and the reward function, and combining the algorithm with the gradient descend radial basis neural networks function approximation. Experiments show that Sarsa（λ,k） outperforms the scheduling method in industry and validate its effectiveness to solve the semiconductor test scheduling problem.