期刊文献+

大规模软件系统日志汇集服务平台设计与实现 被引量:8

DESIGN AND IMPLEMENTATION OF LOG COLLECTION SERVICE PLATFORM FOR LARGE-SCALE SOFTWARE SYSTEM
下载PDF
导出
摘要 针对大规模软件系统中日志的采集、汇集与存储提出一种实现方案,可以为软件研发、系统运维、数据分析提供支撑。该方案对各类源日志进行整合,并通过本地采集、网络汇集、集中管控、异步分级处理等方式,解决了系统大规模部署下日志采集配置复杂,难以集中控制的问题。针对性地设计一种集群调度算法,提高系统的负载能力和稳定性。 In this paper,an implementation scheme was proposed for the collection,gathering and storage of logs in large-scale software system,which could provide support for software research and development,system maintenance,and data analysis.This scheme integrated various kinds of source logs.By means of local collection,network gathering,centralized control and asynchronous hierarchical processing,the problem of complex configuration and difficult centralized control of log collection was solved under large-scale deployment of the system.A cluster scheduling algorithm was designed to improve the load capacity and stability of the system.
作者 汤网祥 王金华 赫凌俊 李敏敬 Tang Wangxiang;Wang Jinhua;He Lingjun;Li Minjing(The 32nd Research Institute of China Electronics Technology Group Corporation,Shanghai 201808,China)
出处 《计算机应用与软件》 北大核心 2018年第11期173-178,共6页 Computer Applications and Software
关键词 日志服务平台 日志采集 集群调度 Log service platform Log collection Cluster scheduling
  • 相关文献

参考文献9

二级参考文献71

  • 1Coverity. Coverity Scan: 2012 Open Source Report. 2013. http://www.coverity.com/.
  • 2Yuan D, Park S, Huang P, Liu Y, Lee MM, Tang X, Zhou Y, Savage S. Be conservative: enhancing failure diagnosis with proactive logging. In: Proe. of the 10th Syrup. on Operating Systems Design and Implementation (OSDI). 2012. 293-306.
  • 3Yuan D, Park S, Zhou Y. Characterizing logging practices in open-source software. In: Proc. of the 2012 Int'l Conf. on Software Engineering. 2012. 102-112. [doi: 10.1109/ICSE.2012.6227202].
  • 4Kavulya SP, Joshi K, Di Giandomenico F, Narasimhan P. Failure Diagnosis of Complex Systems, Resilience Assessment and Evaluation of Computing Systems. Springer-Verlag, 2012. 239-261. [doi: 10.1007/978-3-642-29032-9].
  • 5Fu Q, Zhu J, Hu W, Lou JG, Ding R, Lin Q, Zhang D, Xie T. Where do developers log? An empirical study on logging practices in industry. In: Proc. of the 36th Int'l Conf. on Software Engineering. 2014.24-33. [doi: 10.1145/2591062.2591175 ].
  • 6Jiang W, Hu C, Pasupathy S, Kanevsky A, Li Z, Zhou Y. Understanding Customer Problem Troubleshooting from Storage System Logs. In: Proc. of the 7th USENIX Conf. on File and Storage Technologies (FAST). 2009.43-56.
  • 7Prewett JE. Analyzing cluster log files using logsurfer. In: Proc. of the 4th Annual Conf. on Linux Clusters. 2003.
  • 8Hellerstein JL, Ma S, Perng CS. Discovering actionable patterns in event data. IBM Systems Journal, 2002,41(3):475-493. [doi: 10. 1147/sj.413.0475].
  • 9Ma S, Hellerstein JL. Mining partially periodic event patterns with unknown periods. In: Proc. of the 17th Int'l Conf. on Data Engineering. 2001. 205-214. [doi: 10.1109/ICDE.2001.914829].
  • 10Yamanishi K, Maruyama Y. Dynamic syslog mining for network failure monitoring, In: Proc. of the 11th ACM SIGKDD Int'l Conf. on Knowledge Discovery in Data Mining. 2005.499-508. [doi: 10.1145/1081870.1081927].

共引文献67

同被引文献64

引证文献8

二级引证文献31

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部