媒体业务日志的结构化处理

Structured Processing of Media Business Logs

随着互联网技术的蓬勃发展与数字化信息的快速增长,新媒体行业正迈入数智化时代[1],大数据技术为形式各异的数据提供了分析处理方式,赋予新媒体行业更全面、准确的用户洞察能力,提升了内容生产和传播的效率和精度,成为新媒体行业发生的重要驱动力。IDC(互联网数据中心)预测,2025年全球数据总量将达到175 ZB,80%的数据都将以非结构化形式存在[2],结构化数据才是数据处理的关键性因素。数据量的快速增长、数据类型及位置的不断变化,导致越来越多的企业对于数据采集、分析、利用的需求也越来越多样化[3]。在媒体业务产生的数据呈指数级增长的形势下,传统的数据管理方式越来越无法适应新媒体行业的时效性需求,容量受限、性能瓶颈、管理困难等问题亟须解决[4]。

With the vigorous development of Internet technology and the rapid growth of digital information,the new media industry is entering the era of digitalization.Big data technology provides analysis and processing methods for various forms of data,giving the new media industry more comprehensive and accurate user insights,improving the efficiency and accuracy of content production and dissemination,and becoming an important driving force for the new media industry.IDC(Internet Data Center)predicts that the total global data volume will reach 175 ZB by 2025,and 80%of the data will exist in unstructured form.Structured data is the key factor in data processing.The rapid growth of data volume and the constant changes in data types and locations have led to more and more enterprises having increasingly diverse demands for data collection,analysis,and utilization.In the context of exponential growth in data generated by media business,traditional data management methods are increasingly unable to meet the timeliness requirements of the new media industry,and problems such as limited capacity,performance bottlenecks,and management difficulties urgently need to be solved.