Audio-Text Multimodal Speech Recognition via Dual-Tower Architecture for Mandarin Air Traffic Control Communications

In air traffic control communications (ATCC), misunderstandings between pilots and controllers could result in fatal aviation accidents. Fortunately, advanced automatic speech recognition technology has emerged as a promising means of preventing miscommunications and enhancing aviation safety. However, most existing speech recognition methods merely incorporate external language models on the decoder side, leading to insufficient semantic alignment between speech and text modalities during the encoding phase. Furthermore, it is challenging to model acoustic context dependencies over long distances due to the longer speech sequences than text, especially for the extended ATCC data. To address these issues, we propose a speech-text multimodal dual-tower architecture for speech recognition. It employs cross-modal interactions to achieve close semantic alignment during the encoding stage and strengthen its capabilities in modeling auditory long-distance context dependencies. In addition, a two-stage training strategy is elaborately devised to derive semantics-aware acoustic representations effectively. The first stage focuses on pre-training the speech-text multimodal encoding module to enhance inter-modal semantic alignment and aural long-distance context dependencies. The second stage fine-tunes the entire network to bridge the input modality variation gap between the training and inference phases and boost generalization performance. Extensive experiments demonstrate the effectiveness of the proposed speech-text multimodal speech recognition method on the ATCC and AISHELL-1 datasets. It reduces the character error rate to 6.54% and 8.73%, respectively, and exhibits substantial performance gains of 28.76% and 23.82% compared with the best baseline model. The case studies indicate that the obtained semantics-aware acoustic representations aid in accurately recognizing terms with similar pronunciations but distinctive semantics. The research provides a novel modeling paradigm for semantics-aware speech recognition in air traffic control communications, which could contribute to the advancement of intelligent and efficient aviation safety management.

Architecture for Cellular Enabled Integrated Communication and Sensing Services

There is growing interest in the integrated sensing and communication(ISAC)to extend the 5G+/6G network capabilities by introducing sensing capability.While the solutions for mono-static or bi-static ISAC have shown feasibility and benefits based on existing 5G physical layer design,whether and how to coordinate multiple ISAC devices to better exert networking performance are rarely discussed.3 rd Partnership Project(3GPP)has initiated the ISAC use cases study,and the follow-up studies for network architecture could be anticipated.In this article,we focus on gNB-based sensing mode and propose ISAC functional framework with given of highlevel service procedures to enable cellular based ISAC services.In the proposed ISAC framework,three types of network functions for sensing service as Sensing Function(SF),lightweight-Edge Sensing Function(ESF)and full-version-ESF are designed with interaction with network nodes to fulfill the latency requirements of ISAC use cases.Finally,with simulation evaluations and hardware testbed results,we further verify the performance benefit and feasibility to enable ISAC in 5G for the gNB-based sensing mode with new design on SF and related signaling protocols.

Effective doctor-patient communication skills training optimizes functional organization of intrinsic brain architecture:a restingstate functional MRI study

We studied the influence of doctor-patient communication skills training on brain functional architecture using resting-state functional MRI（rs-fMRI） with a regional homogeneity（ReHo） method. Ten medical students participated in the study. A 1-year long doctor-patient communication skills training program was conducted. RsfMRI data were collected at baseline, one month and one year after training. There was a significant increase in the communication skills test average scores between baseline and 1-month duration of training（P〈0.001）. After one month of communication skills training, medical students had decreased ReHo in the right superior temporal gyrus compared with the baseline. After one year of communication skills training, students had increased ReHo in multiple regions and decreased ReHo in several regions（P 〈0.05, Alphasim corrected）. The change of ReHo values in the superior temporal gyrus negatively correlated with the change of communication skills scale score between one month after communication skills training and baseline（r=-0.734, P= 0.036）. The training program we used can be an effective approach of improving doctor-patient communication skills, and the training resulted in functional plasticity of the brain’s architecture toward optimizing locally functional organization.

Study of Smart Grid Communication Network Architectures and Technologies

Smart Grid (SG) is an emerging paradigm of the modern world to upgrade and enhance the existing conventional electrical power infrastructure from generation to distribution to the consumers in a two-way communication fashion to automate the electrical power demand and supply and make this a cyber-physical system. SG infrastructure key elements, such as smart meters, circuit breakers, transformers, feeders, substations, control centers, grid stations, are required well-formed communication network architectures. SG infrastructure is divided into three main communication networks architectures, such as HAH, NAN, and WAN. Each of these communication network architectures requires reliable, stable, secure, high data rate at real-time with the help of different wireline and wireless communication technologies from HAN to WAN networks. To understand the complete concepts about SG, a concise review is presented and it will help the readers to get foundations of communication network architectures and technologies of SG.

Coalitional game based resource allocation in D2D-enabled V2V communication

The joint resource block(RB)allocation and power optimization problem is studied to maximize the sum-rate of the vehicle-to-vehicle(V2V)links in the device-to-device(D2D)-enabled V2V communication system,where one feasible cellular user(FCU)can share its RB with multiple V2V pairs.The problem is first formulated as a nonconvex mixed-integer nonlinear programming(MINLP)problem with constraint of the maximum interference power in the FCU links.Using the game theory,two coalition formation algorithms are proposed to accomplish V2V link partitioning and FCU selection,where the transferable utility functions are introduced to minimize the interference among the V2V links and the FCU links for the optimal RB allocation.The successive convex approximation(SCA)is used to transform the original problem into a convex one and the Lagrangian dual method is further applied to obtain the optimal transmit power of the V2V links.Finally,numerical results demonstrate the efficiency of the proposed resource allocation algorithm in terms of the system sum-rate.

Hybrid Beamforming Design and Signal Processing with Fully-Connected Architecture for mmWave Integrated Sensing and Communications

Millimeter-wave (mmWave) is capable of achieving gigabit/second communication capacity and centimeter-level sensing accuracy and has become one of the main frequency bands for integrated sensing and communications (ISAC) research. Hybrid beamforming techniques have attracted much attention for solving the high path loss of mmWave and further reducing the hardware cost of the system. However, the related studies based on multicarrier and fully-connected hybrid architectures are still limited. For this reason,this paper investigates the orthogonal frequency division multiplexing (OFDM) based mmWave fully-connected hybrid architecture ISAC system to form a stable communication beam and dynamically varying sensing beam. In order to realize the aforementioned multifunctional beams, the hybrid beamformer design problem based on weighted error minimization of multicarrier is proposed and solved efficiently using the penalty dual decomposition (PDD) algorithm. Meanwhile, based on the echo model, the multicarrier multiple signal classification (MUSIC) algorithm for target angle of arrival estimation and the two-dimensional discrete Fourier transform(2D-DFT)algorithm for distance and velocity estimation are proposed, respectively. Numerical simulation results show that by adjusting the weighting factor,a flexible trade-off can be formed between the communication spectrum efficiency and the sensing accuracy error.

SCA最新发展研究及通用架构设计

梳理分析了软件通信体系架构(software defined radio,SCA)最新发展现状并设计了典型通用架构,研究了SCA的技术体制,总结了SCA技术体制中的规范特点和主要优势;对SCA的关键技术和标准演进进行了详细分析;给出了SCA的设计思路,并基于SCA标准设计了典型软件无线电平台的通用架构,主要包括硬件平台、通用软件平台和波形组件,并给出基于该典型通用架构的设计实例。通过对SCA发展研究及相关典型通用架构设计,能够为新型软无电台设计提供相关研究成果和参考依据,推进新体制软件无线电电台跨越式发展。

Wireless Communications with Programmable Metasurface:Transceiver Design and Experimental Results

Metasurfaces have drawn significant attentions due to their superior capability in tailoring electromagnetic waves with a wide frequency range, from microwave to visible light. Recently, programmable metasurfaces have demonstrated the ability of manipulating the amplitude or phase of electromagnetic waves in a programmable manner in real time, which renders them especially appealing in the applications of wireless communications. In this paper, we present the fundamental principle of applying programmable metasurface as transmitter for wireless communications. Then, we establish a prototype system of metasurface-based transmitter to conduct several experiments and measurements over the air, which practically demonstrate the feasibility of using programmable metasurfaces in future communication systems. By exploiting the dynamically controllable property of programmable metasurface, the design, implementation and experimental evaluation of the proposed metasurface-based wireless communication system are presented with the prototype, which realizes single carrier quadrature phase shift keying(QPSK) transmission over the air. In the developed prototype, the phase of the reflected electromagnetic wave of programma-ble metasurface is directly manipulated in real time according to the baseband control signal, which achieves 2.048 Mbps data transfer rate with video streaming transmission over the air. In addition, experimental result is provided to compare the performance of the proposed metasurface-based architecture against the conventional one. With the slight increase of the transmit power by 5 dB, the same bit error rate(BER) performance can be achieved as the conventional system in the absence of channel coding. Such a result is encouraging considering that the metasurface-based system has the advantages of low hardware cost and simple structure, thus leading to a promising new architecture for wireless communications.

5G High Mobility Wireless Communications: Challenges and Solutions

The fifth generation(5G) network is expected to support significantly large amount of mobile data traffic and huge number of wireless connections,to achieve better spectrum- and energy-efficiency,as well as quality of service(QoS) in terms of delay,reliability and security.Furthermore,the 5G network shall also incorporate high mobility requirements as an integral part,providing satisfactory service to users travelling at a speed up to 500 km/h.This paper provides a survey of potential high mobility wireless communication(HMWC) techniques for 5G network.After discussing the typical requirements and challenges of HMWC,key techniques to cope with the challenges are reviewed,including transmission techniques under the fast timevarying channels,network architecture with mobility support,and mobility management.Finally,future research directions on 5G high mobility communications are given.

An executable modeling and analyzing approach to C4ISR architecture

To analyze the behavioral model of the command,control,communication,computer,intelligence,surveillance,reconnaissance(C4ISR)architecture,we propose an executable modeling and analyzing approach to it.First,the meta concept model of the C4ISR architecture is introduced.According to the meta concept model,we construct the executable meta models of the C4ISR architecture by extending the meta models of fUML.Then,we define the concrete syntax and executable activity algebra(EAA)semantics for executable models.The semantics functions are introduced to translating the syntax description of executable models into the item of EAA.To support the execution of models,we propose the executable rules which are the structural operational semantics of EAA.Finally,an area air defense of the C4ISR system is used to illustrate the feasibility of the approach.

一种综合射频系统SCA软件平台的设计与实现

针对机载综合射频开放式系统架构,为了在软件综合层面上实现波形应用软件与具体平台的解耦,设计并实现了一种基于软件通信架构(Software Communication Architecture,SCA)的软件平台及其环境工具,解决了机载平台软件的分布式通信、资源调度管理、系统建模等技术问题,从而实现功能、应用和波形的组件化与动态重构。测试验证与工程应用情况表明,软件平台能够满足机载领域信号、信息处理强实时、高可用的应用需求,可有效提升综合射频系统软件开发质量与集成联试效率。

SCA架构中通信中间件技术研究

电子信息技术的高速发展促使装备系统综合化的需求越来越高。信息处理系统面临降功耗、提性能的要求,因此软件无线电技术得到了广泛应用。传统的软件通信体系结构(Software Communication Architecture,SCA)采用CORBA作为通信中间件,技术约束较多,实时性不强,通过分析特定的场景需求提出了轻量化的SCA软件架构,以及统一的通信中间件解决方案,对于提升信号处理的扩展性及综合化能力具有重要意义。

基于SCA的多频段电台设计

对传统通信装备的现状进行了分析,结合软件无线电通信架构的开放性、通用性和扩展性等特点,提出了基于SCA的多频段电台设计方案。对基于SCA架构的多频段电台的总体方案、硬件架构、软件结构进行了研究和分析;详细阐述了多频段电台的基带单元设计、射频收发系统设计和天线设计,明确提出了基带单元、射频收发系统和天线的详细设计思路和具体实现方案,可为同类通信产品的设计提供参考。

基于SCA的无线通信技术研究

介绍了一种新的无线通信系统设计思想,即基于SCA规范进行无线通信系统的设计和开发,给出了该系统的软硬件体系结构,通过定义核心框架服务详细规定了波形应用组件以及设备的自动装配、智能化管理和控制等接口,为各种波形间的互通提供了统一的运行环境,保证了波形应用组件实现的独立性。最后对基于SCA的无线通信系统中所涉及的一些关键技术进行了探讨。

SCA波形组件的可视化装配与部署

针对软件通信结构(SCA)规范中XML配置文件在可视化表示波形组件描述和波形应用装配与部署方面的不足,提出SCA波形组件的可视化装配与部署,为SCA兼容系统的架构设计者和系统开发者提供了一种图形化的装配逻辑和部署关系表示方式,减少了系统设计和开发过程中可能出现的错误。并对SCA规范中的组件间端口连接方式进行了归纳和总结,给出在不同应用场景下选择端口连接方式的原则,介绍了一种基于Eclipse体系框架的SCA波形集成开发环境。

基于SCA的波形开发

介绍了如何按照SCA规范进行波形软件的设计和开发,概括了波形开发的一般步骤和波形API接口定义的原则,并结合具体的工程实践经验,提出了一种示例波形的设计和开发,分析了示例波形的功能、模块划分、API接口定义和组件设计,为基于SCA的波形开发提供了参考。

基于SCA的网电对抗平台架构设计及其应用

为了满足战场环境下网电对抗平台对不同信息层次的探测、攻击与防御能力以及通用化、模块化、协同的需求,设计了基于SCA的网电对抗平台的功能体系架构,并以组网雷达对抗为例,给出了基于此体系架构的多平台协同组网雷达对抗波形开发方案,仿真测试表明此网电对抗平台的功能体系架构具有可行性和通用性。

基于Tuscany SCA的随书光盘数据库管理系统的设计与实现

介绍Tuscany SCA的基本开发原理,通过Tuscany SCA将随书光盘数据库管理过程中常用的添加、删除、编辑、查询这4个常规操作组装成4个服务组件,并借助Tomcat将服务组件部署成标准的Web Service供第三方调用。

Communication efficiency optimization of federated learning for computing and network convergence of 6G networks

Federated learning effectively addresses issues such as data privacy by collaborating across participating devices to train global models.However,factors such as network topology and computing power of devices can affect its training or communication process in complex network environments.Computing and network convergence(CNC)of sixth-generation(6G)networks,a new network architecture and paradigm with computing-measurable,perceptible,distributable,dispatchable,and manageable capabilities,can effectively support federated learning training and improve its communication efficiency.By guiding the participating devices'training in federated learning based on business requirements,resource load,network conditions,and computing power of devices,CNC can reach this goal.In this paper,to improve the communication eficiency of federated learning in complex networks,we study the communication eficiency optimization methods of federated learning for CNC of 6G networks that give decisions on the training process for different network conditions and computing power of participating devices.The simulations address two architectures that exist for devices in federated learning and arrange devices to participate in training based on arithmetic power while achieving optimization of communication efficiency in the process of transferring model parameters.The results show that the methods we proposed can cope well with complex network situations,effectively balance the delay distribution of participating devices for local training,improve the communication eficiency during the transfer of model parameters,and improve the resource utilization in the network.

基于SCA的无线通信计算机系统研究

针对目前战术通信设备品种繁多，技术体制各异，互连互通困难，通用性差，模块化程度较低，软件可编程能力差。本文参考美军联合战术无线电系统（JTRS）及其核心SCA规范，采用开放式的体系结构和模块化设计思想，提出了基于SCA规范的无线通信计算机系统，给出了硬件体系结构和软件体系结构设计，并予以实现，在项目中得到了应用，验证了它的可用性和实用性。