AV-FDTI:Audio-visual fusion for drone threat identification

In response to the evolving challenges posed by small unmanned aerial vehicles(UAVs),which have the potential to transport harmful payloads or cause significant damage,we present AV-FDTI,an innovative Audio-Visual Fusion system designed for Drone Threat Identification.AV-FDTI leverages the fusion of audio and omnidirectional camera feature inputs,providing a comprehensive solution to enhance the precision and resilience of drone classification and 3D localization.Specifically,AV-FDTI employs a CRNN network to capture vital temporal dynamics within the audio domain and utilizes a pretrained ResNet50 model for image feature extraction.Furthermore,we adopt a visual information entropy and cross-attention-based mechanism to enhance the fusion of visual and audio data.Notably,our system is trained based on automated Leica tracking annotations,offering accurate ground truth data with millimeter-level accuracy.Comprehensive comparative evaluations demonstrate the superiority of our solution over the existing systems.In our commitment to advancing this field,we will release this work as open-source code and wearable AV-FDTI design,contributing valuable resources to the research community.

Integrating Audio-Visual Features and Text Information for Story Segmentation of News Video

Video data are composed of multimodal information streams including visual, auditory and textual streams, so an approach of story segmentation for news video using multimodal analysis is described in this paper. The proposed approach detects the topic-caption frames, and integrates them with silence clips detection results, as well as shot segmentation results to locate the news story boundaries. The integration of audio-visual features and text information overcomes the weakness of the approach using only image analysis techniques. On test data with 135 400 frames, when the boundaries between news stories are detected, the accuracy rate 85.8% and the recall rate 97.5% are obtained. The experimental results show the approach is valid and robust.

A Review on Audio-visual Translation Studies

This paper is dedicated to a thorough review on the audio-visual related translations from both home and abroad.In reviewing the foreign achievements on this specific field of translation studies it can shed some lights on our national audio-visual practice and research.The review on the Chinese scholars’ audio-visual translation studies is to offer the potential developing direction and guidelines to the studies and aspects neglected as well.Based on the summary of relevant studies,possible topics for further studies are proposed.

Audio-visual emotion recognition with multilayer boosted HMM

Emotion recognition has become an important task of modern human-computer interac- tion. A multilayer boosted HMM （ MBHMM ） classifier for automatic audio-visual emotion recognition is presented in this paper. A modified Baum-Welch algorithm is proposed for component HMM learn- ing and adaptive boosting （AdaBoost） is used to train ensemble classifiers for different layers （cues）. Except for the first layer, the initial weights of training samples in current layer are decided by recognition results of the ensemble classifier in the upper layer. Thus the training procedure using current cue can focus more on the difficult samples according to the previous cue. Our MBHMM clas- sifier is combined by these ensemble classifiers and takes advantage of the complementary informa- tion from multiple cues and modalities. Experimental results on audio-visual emotion data collected in Wizard of Oz scenarios and labeled under two types of emotion category sets demonstrate that our approach is effective and promising.

The Audio-Visual Performance Highlighted Craze in Chicago During Chinese New Year

February 10 (US Central Time), 2019, China National Peking Opera Company (CNPOC) and the Hubei Chime Bells National Chinese Orchestra presented a fantastic audio-visual performance of Chinese Peking Opera and Chinese chime bells for the American audience at the world s top-level Buntrock Hall at Symphony Center.

Research on National Identity Based on National Audio-Visual Works: Taking Inner Mongolia as an Example

Mongolian audio-visual works are an important carrier of exploring the true significance to this national culture.This paper believes that the Mongolian people in Inner Mongolia constantly enhance the individual sense of identity to the overall ethnic group through the influence of film and television and music,and on this basis constantly evolve a new culture in line with modern and contemporary life to further enhance their sense of belonging to the ethnic nation.

Application of Task-based Teaching Method to College Audio-visual English Teaching

Based on the current situation of college audio-visual English teaching in China, this article points out that the avoidance in class is a serious phenomenon in the process of college audio-visual English teaching. After further analysis and combination with the characteristics of college English audio-visual teaching in China, it puts forward the application of task-based teaching method to college audio-visual English teaching and its steps, attempting to alleviate the avoidance phenomenon in students through task-based teaching method.

Prioritized MPEG-4 Audio-Visual Objects Streaming over the DiffServ

The object-based scalable coding in MPEG-4 is investigated, and a prioritized transmission scheme of MPEG-4 audio-visual objects （AVOs） over the DiffServ network with the QoS guarantee is proposed. MPEG-4 AVOs are extracted and classified into different groups according to their priority values and scalable layers （visual importance）. These priority values are mapped to the 1P DiffServ per hop behaviors （PHB）. This scheme can selectively discard packets with low importance, in order to avoid the network congestion. Simulation results show that the quality of received video can gracefully adapt to network state, as compared with the ‘best-effort＇ manner. Also, by allowing the content provider to define prioritization of each audio-visual object, the adaptive transmission of object-based scalable video can be customized based on the content.

Integrating Zhuang Culture Into College English Audio-Visual Speaking Course:A Multicultural Perspective

Zhuang culture,a representative of the native ethnic culture of Guangxi,China,is of great significance to Chinese culture.In order to promote traditional culture,enrich the teaching content of College English Audio-Visual Speaking Course,and enhance the intercultural communication ability of college students,this paper,from a multicultural perspective,explores the classroom practices of integrating indigenous Zhuang cultural elements in College English Audio-Visual Speaking Course,providing new perspectives and reference for multicultural education in foreign languages.

基于ⅢF A/V规范和Avalon系统的大学图书馆视听数据库建设研究

随着中国网络基础设施的不断改善,视听媒体在年轻一代中非常流行,给以文本资源为主的图书馆带来了挑战。本研究旨在探究国内外大学图书馆视听资源数据库建设的现状,借鉴ⅢF规范在图像资源管理方面的成功经验和各种视听保存社区的实践,提出基于ⅢF A/V规范与开源软件的中国大学图书馆视听资源管理方法。通过分析华东师范大学图书馆在视听资源保存、流媒体发布、时间轴气泡注释、转录、视听结构化和开放共享方面的实践,进行实证研究。

Self-supervised Learning for Speech Emotion Recognition Task Using Audio-visual Features and Distil Hubert Model on BAVED and RAVDESS Databases

Existing pre-trained models like Distil HuBERT excel at uncovering hidden patterns and facilitating accurate recognition across diverse data types, such as audio and visual information. We harnessed this capability to develop a deep learning model that utilizes Distil HuBERT for jointly learning these combined features in speech emotion recognition (SER). Our experiments highlight its distinct advantages: it significantly outperforms Wav2vec 2.0 in both offline and real-time accuracy on RAVDESS and BAVED datasets. Although slightly trailing HuBERT’s offline accuracy, Distil HuBERT shines with comparable performance at a fraction of the model size, making it an ideal choice for resource-constrained environments like mobile devices. This smaller size does come with a slight trade-off: Distil HuBERT achieved notable accuracy in offline evaluation, with 96.33% on the BAVED database and 87.01% on the RAVDESS database. In real-time evaluation, the accuracy decreased to 79.3% on the BAVED database and 77.87% on the RAVDESS database. This decrease is likely a result of the challenges associated with real-time processing, including latency and noise, but still demonstrates strong performance in practical scenarios. Therefore, Distil HuBERT emerges as a compelling choice for SER, especially when prioritizing accuracy over real-time processing. Its compact size further enhances its potential for resource-limited settings, making it a versatile tool for a wide range of applications.

Cogeneration of Innovative Audio-visual Content: A New Challenge for Computing Art

In recent years,computing art has developed rapidly with the in-depth cross study of artificial intelligence generated con-tent(AIGC)and the main features of artworks.Audio-visual content generation has gradually been applied to various practical tasks,including video or game score,assisting artists in creation,art education and other aspects,which demonstrates a broad application pro-spect.In this paper,we introduce innovative achievements in audio-visual content generation from the perspective of visual art genera-tion and auditory art generation based on artificial intelligence(Al).We outline the development tendency of image and music datasets,visual and auditory content modelling,and related automatic generation systems.The objective and subjective evaluation of generated samples plays an important role in the measurement of algorithm performance.We provide a cogeneration mechanism of audio-visual content in multimodal tasks from image to music and display the construction of specific stylized datasets.There are still many new op-portunities and challenges in the field of audio-visual synesthesia generation,and we provide a comprehensive discussion on them.

云技术支持下视听新媒体监测监管系统的设计与实现

阐述云技术与视听新媒体检测监管的基本概念,分析当前视听新媒体监测监管面临的挑战。针对性提出基于云技术的视听新媒体监测监管系统设计方案,平台整体架构包含采集层、资源池、数据仓库、分析处理层和用户交互层。通过分析关键技术验证了系统的可行性。

体育赛事视听信息设权路径反思与法益体系保护—基于《体育法》第52条第2款的法教义学解读

《体育法》新增第52条第2款是否有意创设权利来保护体育赛事视听信息,学界对此尚存争议。现有设权论据之所以存在缺陷,表面上是因为设权逻辑不周延,实际上是形式上的设权期待与实质上薄弱的设权基础存在差距所致。《体育法》的基本法属性以及体系构造很难为体育赛事视听信息权预留充足的设权空间,相比之下,《体育法》确认体育赛事视听信息法益保护更具优势。结合《体育法》对体育赛事视听信息有关行为、主体和客体的态度,能够推定《体育法》第52条第2款的立法意图是确认法益保护而非创设权利。明确以《体育法》为基础法的规范统筹地位,构建体系协调的法律适用位阶,贯彻价值多元下实质正义的领域法规范体系,能够为体育赛事视听信息法益保护提供科学的指引,也为未来《体育法》的完善指明了方向。

森林作业与规划动态仿真实验室建设

为培养大学生的创新意识、创新思维和创新精神,提高整体教学质量,针对我国南方林区特点,结合森林工程学科教学与科研特色,新建了森林作业与规划动态仿真实验室,包括电控动态仿真实物模型和配套影音教学系统,提升传统的实验教学内容和实验技术方法。教学实践结果表明,有利于培养学生具备较高的现代化生态文明素质、雄厚的专业基础、宽广的专业知识面和较强的获取信息能力、实践能力和创新能力等,取得很好效果。同时,也可作为创新实验平台,为学生课外创新研究提供良好条件。

“工程索道”创新人才培养实践教学体系构建

为深化改革实践教学,提高实践教学质量和培养学生创新能力,通过师资培养、平台搭建和管理创新等,构建了"创新实践教学团队+创新实践实验室平台+创新实践成果平台+创新实践管理机制"的工程索道创新实践教学体系,并研制配套实践教学影音系统。实践表明,学生创新能力及解决实际工程问题能力显著增强,学生实践技能和创新能力培养方面特色鲜明。

智能视频监控系统关键技术及算法研究

提出了一种基于PC机的智能视频监控系统设计方案。将基于直流力矩电动机的三环伺服系统应用于云台控制,有效解决了对高速运动目标的精确实时跟踪问题。系统采用声源定位技术辅助实现对监控目标的快速定位,利用相邻三帧差分法实现了运动目标的提取,并且给出了运动目标的形心计算方法。系统根据运动目标的位置信息,实时控制云台摄像头姿态,使被监控目标始终处于监控画面中央。在MATLAB环境下,对系统各模块进行仿真,结果表明,系统能够实现对高速运动目标的精确跟踪。

利用多媒体实验室提高学生外语视听说能力

如何充分利用多媒体设备和网络教学系统提高学生的听说能力和影视鉴赏评论能力一直是我们搞视听说教学工作者所关心和探索的课题。本文根据笔者实际教学中多媒体设备和网络的应用,着重从日常生活对话,新闻听力训练和影视片鉴赏三个方面探讨了多媒体语言实验室如何导入外语视听说教学中才能充分利用学生的能动性、积极性、创造性,从而提高学生的英语视听说能力。

国内外音像资源管理系统的发展与应用调查分析

本文介绍了音像资源管理系统的基本概念、功能和发展。通过系统的调查研究,分析了音像资源管理系统的发展现状及应用情况,并对部分国内外具有代表性的音像资源管理的系统功能和关键技术进行比较分析,为利用音像资源管理系统技术构建高校及教育音像中心的音像资源管理系统提供有益的参考。

基于二维条码技术的高校电教设备管理系统

针对高校电教设备管理的特点和使用情况,提出电教设备管理系统的构建设想,通过唯一性标识对电教设备进行全程有效管理。选择二维条码作为电教设备信息的载体,将其运用于电教设备管理系统中,以达到学校电教设备管理信息化的目的。