期刊文献+

神经网络架构搜索发展综述

Overview of neural network architecture search development
下载PDF
导出
摘要 神经架构搜索的目标是通过深度学习让机器学会自动优化参数,构建最优的神经架构。以神经架构搜索发展历程为时间线,从搜索空间、搜索策略和性能评估等3个方面简述神经架构搜索的算法发展和实验条件变化。分析总结典型架构搜索算法的特点和实验条件,探讨神经架构搜索技术未来发展趋势。 The goal of neural architecture search is to make machine learn automatically optimize parameters by deep learning,and build the best neural architecture.Taking the development history of neural architecture search as the timeline,the algorithm development and the experimental condition changes are briefly discussed from search space,search strategy and performance evaluation.The algorithm characteristics and experimental conditions of typical architectures are analyzed and summarized.The development trend of neural architecture search technology is discussed.
作者 潘晓英 曹园 贾蓉 戚玉涛 PAN Xiaoying;CAO Yuan;JIA Rong;QI Yutao(School of Computer Science and Technology,Xi’an University of Posts and Telecommunications,Xi’an 710121,China;Shaanxi Key Laboratory of Networks Data Analysis and Intelligent Processing,Xi’an University of Posts and Telecommunications,Xi’an 710121,China;School of Computer Science and Technology,Xidian University,Xi’an 710071,China)
出处 《西安邮电大学学报》 2022年第4期43-63,共21页 Journal of Xi’an University of Posts and Telecommunications
基金 国家自然科学基金项目(62001380)。
关键词 自动化深度学习 机器学习 神经架构搜索 进化算法 贝叶斯优化 automated deep learning machine learning neural architecture search evolutionary algorithm Bayesian optimization
  • 相关文献

参考文献2

二级参考文献56

  • 1史忠值.神经网络[M].北京:高等教育出版社,2009.
  • 2李彦宏.2012百度年会主题报告:相信技术的力量[R].北京:百度,2013.
  • 3Rumelhart D,Hinton G,Williams R.Learning representationsby back-propagating errors[J].Nature,1986,323(6088):533-536.
  • 4Hinton G,Salakhutdinov R.Reducing the dimensionality of data with neural networks[J].Science,2006,313(5786):504-507.
  • 5Ding Shi-fei,Zhang Yan-an,Chen Jin-rong,et al.Research onUsing Genetic Algorithms to Optimize Elman Neural Networks[J].Neural Computing and Applications,2013,23(2):293-297.
  • 6Ding Shi-fei,Jia Wei-kuan,Su Chun-yang,et al.Research ofNeural Network Algorithm Based on Factor Analysis and Cluster Analysis[J].Neural Computing and Applications,2011,20(2):297-302.
  • 7Lee T S,Mumford D.Hierarchical Bayesian inference in the vi-sual cortex[J].Optical Society of America,2003,20(7):1434-1448.
  • 8Serre T,Wolf L,Bileschi S,et al.Robust object recognition with cortex-like mechanisms[J].IEEE Trans on Pattern Analysis and Machine Intelligence,2007,29(3):411-426.
  • 9Lee T S,Mumford D,Romero R,et al.The role of the primary visual cortex in higher level vision[J].Vision Research,1998,38 (15):2429-2454.
  • 10Bengio Y.Learning deep architectures for AI[J].Foundations and Trends in Machine Learning,2009,2(1):1-127.

共引文献205

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部