飞桨:源于产业实践的开源深度学习平台

PaddlePaddle:An Open-Source Deep Lear

【目的】深度学习是近年来人工智能取得突破的驱动性核心技术,深度学习框架也被称作智能时代的操作系统,本文对国内唯一功能完备的开源深度学习平台飞桨(Paddle Paddle)进行了系统性介绍。【方法】首先介绍深度学习框架的发展历程,并概述飞桨深度学习平台的技术全景和生态建设进展,然后详细介绍飞桨核心框架的关键技术,包括前端语言、组网编程范式、核心架构图、算子库以及高效率计算核心五个部分。【结果】飞桨经过多年来产业实践中持续迭代创新,已经在超大规模分布式训练、多端高速推理等方面形成了独特的优势。【结论】系统性总结飞桨的主要创新点并对未来发展趋势进行展望。

[Objective]Deep learning is widely recognized as core technology driving the breakthroughs in artificial intelligence.Deep learning frameworks can be considered as the operating system in the era of artificial intelligence.PaddlePaddle,as the only fully-functioning open-source deep learning platform in China,is introduced comprehensively.[Methods]In this paper,a brief history of the deep learning frameworks is introduced,followed by an overview of PaddlePaddle,which is comprised of the core framework,toolkits and service platforms.After that,we elaborate on the core technologies of PaddlePaddle,including the front-end programming language,the modeling paradigm etc.Finally,the main innovations in PaddlePaddle are summarized.[Results]PaddlePaddle has been intensively tested in Baidu production for years,with unique features in supporting distributed training with ultra-large data and fast inference on server,mobile as well as edges.[Conclusions]The main innovations,research and development trends are discussed systematically.