深度学习程序内存预测方法

Memory estimation for deep learning program

深度学习程序在广泛领域取得了巨大成功,然而其内部错误可能导致严重的资源浪费,甚至引发灾难性故障。本文分析了导致程序在实际运行中出现任务执行失败的典型缺陷及其关键影响因素,提出基于静态分析与自注意力机制网络的深度学习程序内存预测方法,在程序内存估计任务上达到平均8.38%的相对预测误差,可以有效预防内存溢出问题、协助合理优化硬件资源配置。

Deep learning programs have achieved tremendous success in a wide range of fields.However,internal errors in these programs can lead to significant resource wastage and even result in catastrophic failures.This paper analyzes typical defects that cause task execution failures during the practical operation of programs,as well as their key influencing factors.A deep learning program memory prediction method is proposed based on static analysis and a self-attention mechanism network.This method achieves a mean relative error of 8.38%in memory estimation tasks,effectively preventing memory overflow issues and assisting in the rational optimization of hardware resource allocation.