面向突发事件应急管理的社交媒体多模态信息分析研究

Social Media Multimodal Analysis for Emergency Management

当前,社交媒体已经成为突发事件态势感知的一种重要信息来源,其中包含文本、图像、视频等多模态信息,可广泛应用于突发事件的应急管理。近年来,作为一项具有挑战性的任务,面向突发事件的社交媒体多模态信息分析已受到学术界和工业界的广泛关注。本文围绕突发事件中的社交媒体多模态信息分析研究展开综述,从内容、时空和传播三个维度解析社交媒体多模态信息的多维特征,并从信息获取、信息整合和信息挖掘三个方面归纳多模态信息分析的关键方法和技术。最后,本文在综述的基础上,结合“情境-应对”模式下的突发事件应急管理目标,构建社交媒体多模态信息分析框架,并从信息获取、描述、分析和可视化等方面展望未来的研究方向,为面向突发事件应急管理的社交媒体多模态信息分析研究和实践提供指引,以期通过方法创新提升突发事件的应急管理能力。

Social media has become an important information source for situation awareness during emergencies.Multimodal information such as text,images,and videos viewed through social media can be widely used for emergency information management.Multimodal information analysis during emergencies is a challenging topic and has received significant attention from both academia and industry.We review studies on social media analysis in emergencies.The multi-dimensional characteristics of multimodal information in social media are analyzed using three dimensions:content,spatialtemporal,and information dissemination.The key methods and technologies of multimodal information analysis are summarized from three aspects:information acquisition,information integration,and information mining.Finally,we construct a multimodal information analysis framework for emergency management based on this review and propose future research directions on information acquisition,description,analysis,and visualization.We expect this survey to provide guidance for research on and practice of social media multimodal information analysis and to improve the ability to manage emergencies.