一种视频流数据的处理与自动负载方法

A Processing and Automatic Loading Method of Video Stream Data

近年来,大数据技术的发展使得实时视频流处理成为可能。实时视频流数据属于典型的大数据,从这些非结构化的数据中提取有价值的信息非常困难,因此需要利用大数据与视频流处理技术,通过实时处理模组从中提取有用的信息。由于视频流的大数据特性,传统的数据存储方法成本较高,需要配合云存储技术来实现视频流的高效处理与运算。云存储服务提供了大量的计算和存储资源,允许开发具有拓展性的自动负载视频流系统。本文旨在开发一个视频流处理系统,将其部署于亚马逊云服务,系统从视频流中调用实时运行的视频处理算法,并自动平衡负载,防止应用系统出现负载冗余或不足情况,节约成本,支撑视频数据的存储与管理。

In recent years,the development of big data technology has made real-time video stream processing possible.Real-time video stream data is a typical big data.It is difficult to extract valuable information from these unstructured data.Therefore,it is necessary to use big data and video stream processing technology to extract useful information by using real-time processing modules.At the same time,due to the big data characteristics of video streams,traditional data storage methods are costly.We need to cooperate with cloud storage technology to achieve efficient processing and calculation of video streams.Cloud storage services provide a large amount of computing and storage resources,which can be used to develop extensible automatic loading video stream system.This article aims to develop a video stream processing system,and it will be deployed in Amazon cloud services.The system will call real-time video processing algorithms from the video stream,and automatically balance the loading to prevent load redundancy or shortage in the application system,save costs and support the storage and management of video data.