Audio-Text Multimodal Speech Recognition via Dual-Tower Architecture for Mandarin Air Traffic Control Communications

In air traffic control communications (ATCC), misunderstandings between pilots and controllers could result in fatal aviation accidents. Fortunately, advanced automatic speech recognition technology has emerged as a promising means of preventing miscommunications and enhancing aviation safety. However, most existing speech recognition methods merely incorporate external language models on the decoder side, leading to insufficient semantic alignment between speech and text modalities during the encoding phase. Furthermore, it is challenging to model acoustic context dependencies over long distances due to the longer speech sequences than text, especially for the extended ATCC data. To address these issues, we propose a speech-text multimodal dual-tower architecture for speech recognition. It employs cross-modal interactions to achieve close semantic alignment during the encoding stage and strengthen its capabilities in modeling auditory long-distance context dependencies. In addition, a two-stage training strategy is elaborately devised to derive semantics-aware acoustic representations effectively. The first stage focuses on pre-training the speech-text multimodal encoding module to enhance inter-modal semantic alignment and aural long-distance context dependencies. The second stage fine-tunes the entire network to bridge the input modality variation gap between the training and inference phases and boost generalization performance. Extensive experiments demonstrate the effectiveness of the proposed speech-text multimodal speech recognition method on the ATCC and AISHELL-1 datasets. It reduces the character error rate to 6.54% and 8.73%, respectively, and exhibits substantial performance gains of 28.76% and 23.82% compared with the best baseline model. The case studies indicate that the obtained semantics-aware acoustic representations aid in accurately recognizing terms with similar pronunciations but distinctive semantics. The research provides a novel modeling paradigm for semantics-aware speech recognition in air traffic control communications, which could contribute to the advancement of intelligent and efficient aviation safety management.

Cluster DetectionMethod of Endogenous Security Abnormal Attack Behavior in Air Traffic Control Network

In order to enhance the accuracy of Air Traffic Control(ATC)cybersecurity attack detection,in this paper,a new clustering detection method is designed for air traffic control network security attacks.The feature set for ATC cybersecurity attacks is constructed by setting the feature states,adding recursive features,and determining the feature criticality.The expected information gain and entropy of the feature data are computed to determine the information gain of the feature data and reduce the interference of similar feature data.An autoencoder is introduced into the AI(artificial intelligence)algorithm to encode and decode the characteristics of ATC network security attack behavior to reduce the dimensionality of the ATC network security attack behavior data.Based on the above processing,an unsupervised learning algorithm for clustering detection of ATC network security attacks is designed.First,determine the distance between the clustering clusters of ATC network security attack behavior characteristics,calculate the clustering threshold,and construct the initial clustering center.Then,the new average value of all feature objects in each cluster is recalculated as the new cluster center.Second,it traverses all objects in a cluster of ATC network security attack behavior feature data.Finally,the cluster detection of ATC network security attack behavior is completed by the computation of objective functions.The experiment took three groups of experimental attack behavior data sets as the test object,and took the detection rate,false detection rate and recall rate as the test indicators,and selected three similar methods for comparative test.The experimental results show that the detection rate of this method is about 98%,the false positive rate is below 1%,and the recall rate is above 97%.Research shows that this method can improve the detection performance of security attacks in air traffic control network.

Novel Distance Measures on Hesitant Fuzzy Sets Based on Equal-Probability Transformation and Their Application in Decision Making on Intersection Traffic Control

The purpose of this study is to reduce the uncertainty in the calculation process on hesitant fuzzy sets(HFSs).The innovation of this study is to unify the cardinal numbers of hesitant fuzzy elements(HFEs)in a special way.Firstly,a probability density function is assigned for any given HFE.Thereafter,equal-probability transformation is introduced to transform HFEs with different cardinal numbers on the condition into the same probability density function.The characteristic of this transformation is that the higher the consistency of the membership degrees in HFEs,the higher the credibility of the mentioned membership degrees is,then,the bigger the probability density values for them are.According to this transformation technique,a set of novel distance measures on HFSs is provided.Finally,an illustrative example of intersection traffic control is introduced to show the usefulness of the given distance measures.The example also shows that this study is a good complement to operation theories on HFSs.

A Robust Conformer-Based Speech Recognition Model for Mandarin Air Traffic Control

This study aims to address the deviation in downstream tasks caused by inaccurate recognition results when applying Automatic Speech Recognition(ASR)technology in the Air Traffic Control(ATC)field.This paper presents a novel cascaded model architecture,namely Conformer-CTC/Attention-T5(CCAT),to build a highly accurate and robust ATC speech recognition model.To tackle the challenges posed by noise and fast speech rate in ATC,the Conformer model is employed to extract robust and discriminative speech representations from raw waveforms.On the decoding side,the Attention mechanism is integrated to facilitate precise alignment between input features and output characters.The Text-To-Text Transfer Transformer(T5)language model is also introduced to handle particular pronunciations and code-mixing issues,providing more accurate and concise textual output for downstream tasks.To enhance the model’s robustness,transfer learning and data augmentation techniques are utilized in the training strategy.The model’s performance is optimized by performing hyperparameter tunings,such as adjusting the number of attention heads,encoder layers,and the weights of the loss function.The experimental results demonstrate the significant contributions of data augmentation,hyperparameter tuning,and error correction models to the overall model performance.On the Our ATC Corpus dataset,the proposed model achieves a Character Error Rate(CER)of 3.44%,representing a 3.64%improvement compared to the baseline model.Moreover,the effectiveness of the proposed model is validated on two publicly available datasets.On the AISHELL-1 dataset,the CCAT model achieves a CER of 3.42%,showcasing a 1.23%improvement over the baseline model.Similarly,on the LibriSpeech dataset,the CCAT model achieves a Word Error Rate(WER)of 5.27%,demonstrating a performance improvement of 7.67%compared to the baseline model.Additionally,this paper proposes an evaluation criterion for assessing the robustness of ATC speech recognition systems.In robustness evaluation experiments based on this criterion,the proposed model demonstrates a performance improvement of 22%compared to the baseline model.

Adaptive signal control and coordination for urban traffic control in a connected vehicle environment: A review

Existing signal control systems for urban traffic are usually based on traffic flow data from fixed location detectors.Because of rapid advances in emerging vehicular communication,connected vehicle(CV)-based signal control demonstrates significant improvements over existing conventional signal control systems.Though various CV-based signal control systems have been investigated in the past decades,these approaches still have many issues and drawbacks to overcome.We summarize typical components and structures of these existing CV-based urban traffic signal control systems and digest several important issues from the summarized vital concepts.Last,future research directions are discussed with some suggestions.We hope this survey can facilitate the connected and automated vehicle and transportation research community to efficiently approach next-generation urban traffic signal control methods and systems.

Integrated Evaluation of Air Traffic Controller Workload Based on Matter-Element Analysis

A model for evaluating the controller workload was presented based on matter-element analysis, particularly from a mansystem engineering perspective. On the basis of a questionnaire survey, 18 kinds of indexes which influence the controller workload were determined. By establishing the classical field and node field of the controller workload, the correlation function of the controller workload grade was obtained; then the correlation degree and estimated grade of controller workload were given. A case study verifies the feasibility of the proposed evaluation method.

Identification of Information-Seeking Behaviors from Air Traffic Controllers′ Eye Movements

Air traffic controllers are the important parts of air traffic management system who are responsible for the safety and efficiency of the system.They make traffic management decisions based on information acquired from various sources.The understanding of their information seeking behaviors is still limited.We aim to identify controllers′ behavior through the examination of the correlations between controllers′eye movements and air traffic.Sixteen air traffic controllers were invited to participate real-time simulation experiments,during which the data of their eye ball movements and air traffic were recorded.Tweny-three air traffic complexity metrics and six eye movements metrics were calculated to examine their relationships.Two correlational methods,Pearson′s correlation and Spearman′s correlation,were tested between every eye-traffic pair of metrics.The results indicate that controllers′two kinds of information-seeking behaviors can be identified from their eye movements:Targets tracking,and confliction recognition.The study on controllers′ eye movements may contribute to the understanding of information-seeking mechanisms leading to the development of more intelligent automations in the future.

Effect of Working Experience on Air Traffic Controller Eye Movement

Eye movement is an important indicator of information-seeking behavior and provides insight into cognitive strategies which are vital for decision-making.Various measures based on eye movements have been proposed to capture humans’ability to process information in a complex environment.The effectiveness of these measures has not yet been fully explored in the field of air traffic management.This paper presents a comparative study on eye-movement measures in air traffic controllers with different levels of working experience.Two commonly investigated oculomotor behaviors,fixation and saccades,together with gaze entropy,are examined.By comparing the statistical properties of the relevant metrics,it is shown that working experience has a notable effect on eye-movement patterns.Both fixation and saccades differ between qualified and novice controllers,with the former type of controller employing more efficient searching strategies.These findings are useful in enhancing the quality of controller training and contributing to an understanding of the information-seeking mechanisms humans use when executing complex tasks.

Intelligent Virtual Assistant System(IVAS) for Air Traffic Controllers

Air traffic control is an essential obligation in the aviation industry to have safe and efficient air transportation.Year by year,the workload and on-job-stress of the air traffic controllers are rapidly increasing due to the rapid growth of air traveling.Controllers are usually dealing with multiple aircrafts at a time and must make quick and accurate decisions to ensure the safety of aircrafts.Heavy workload and high responsibilities create air traffic control a stressful job that sometimes could be error-prone and time-consuming,since controlling and decision-making are solely dependent on human intelligence.To provide effective solutions for the mentioned on the job challenges of the controllers,this study proposed an intelligent virtual assistant system(IVAS)to assist the controllers thereby to reduce the controllers’workload.Consisting of four main parts,which are voice recognition,display conversation on screen,task execution,and text to speech,the proposed system is developed with the aid of artificial intelligence(AI)techniques to make speedy decisions and be free of human interventions.IVAS is a computer-based system that can be activated by the voice of the air traffic controller and then appropriately assist to control the flight.IVAS identifies the words spoken by the controller and then a virtual assistant navigates to collect the data requested from the controllers,which allows additional or free time to the controllers to contemplate more on the work or could assist to another aircraft.The Google speech application programming interface(API)converts audio to text to recognize keywords.AI agent is trained using the Hidden marko model(HMM)algorithm such that it could learn the characteristics of the distinct voices of the controllers.At this stage,the proposed IVAS can be used to provide training for novice air traffic controllers effectively.The system is to be developed as a real-time system which could be used at the air traffic controlling base for actual traffic controlling purposes and the system is to be further upgraded to perform the task by recognizing keywords directly from the pilot voice command.

Step-coordination Algorithm of Traffic Control Based on Multi-agent System

Aiming at the deficiency of conventional traffic control method, this paper proposes a new method based on multi-agent technology for traffic control. Different from many existing methods, this paper distinguishes traffic control on the basis of the agent technology from conventional traffic control method. The composition and structure of a multi-agent system （MAS） is first discussed. Then, the step-coordination strategies of intersection-agent, segment-agent, and area-agent are put forward. The advantages of the algorithm are demonstrated by a simulation study.

Performance Evaluation of Intelligent Adaptive Traffic Control Systems: A Case Study

Mashhad, the second largest city in Iran, like many other big cities, is faced with increasing traffic congestion owing to rapidly increasing population and annual pilgrimage. In recent years, Mashhad traffic and transportation authorities have been challenged with how to manage the increasing congestion with limited budgets for major roadway construction projects. Mashhad has recognized the need to improve the existing system capacity to get the most out of their cur- rent transportation system infrastructures. Since most of the delay times occur at signalized intersections, using an intelligent control system with proper capabilities to overcome the growing traffic requirements is recommended. Following comprehensive studies carried out with the aim of developing the Mashhad traffic control center, the SCATS adaptive traffic control system was introduced as the selected intelligent control system for integrating signalized intersections. The first intersection was equipped with this system in 2005. This paper describes the results of a field evaluation in which fixed actuated-coordinated signal timings are compared with those dynamically computed by SCATS. The ef- fects of this system on optimizing fuel consumption as well as reducing air pollutants are fully discussed. It is found that SCATS consistently reduced travel times and the average delay per stopped or approaching vehicle. The positive impact of adaptive traffic control systems on fuel consumption and air pollution are also highlighted.

Assessing Work Zone Traffic Control Options for 3-to-1 Lane Closures

The presence of highway construction zones hinders mobility and affects traffic operations. A 2002 study by Wunderlich & Hardesty reported that nearly 20% of the National Highway System roads have scheduled construction work during the peak construction season. Additionally, approximately 24% of non-recurring delays on freeways are caused by work zones. To minimize time lost by travelers due to work zone induced traffic congestion, it is important to efficiently plan temporary traffic control (TTC) at work zones. Earlier research conducted by Sisiopiku & Ramadan, 2017 confirms that the majority of State Departments of Transportation currently rely on their earlier experience when planning for work zones, rather than consider operational and safety impacts. Using a study corridor in Birmingham, Alabama as a test bed, this study investigated the operational impacts of TTC options for work zones with 3-to-1 lane drop configuration using traffic data collected from the Alabama Department of Transportation. The VISSIM simulation platform was used to conduct the experiments. The experimental design considered two TTC strategies (i.e., static late and early merge) under 3-to-1 lane drop configuration for work-space length of 500 ft for long- and short-term lane closures. The study concluded that the 3-to-1 lane-drop configuration should not be scheduled for long-term duration. Maintenance work can be scheduled from midnight to early morning and under the 3-to-1 lane closure scenario the performance of early and late merge traffic control is similar. Overall, this study used simulation modeling to compare the effectiveness of two traffic control strategies at work zones on the basis of different performance measures. The results provide information about the impact of each control strategy on density, speed, travel time etc. They also help determine what time of the day is best for lane closings in order to reduce adverse impacts from capacity reduction. Thus, the findings are expected to provide valuable guidance for agencies responsible for planning, design, and operations of work zones in the future.

Research on an Urban Traffic Control System Based on DGPS

The basic principles of GPS (Global Positioning System) and DGPS (Differential GPS) are described. The principle and structure of vehicle navigation systems, and its application to the urban traffic flow guidance are analyzed. Then, an area coordinated adaptive control system based on DGPS and a traffic flow guidance information system based on DGPS are put forward, and their working principles and functions are researched. This is to provides a new way for the development of urban road traffic control systems.

Admission and Traffic Control Schemes Suitable for QoS Applications in WLAN Systems

This paper proposes the use of admission and traffic control schemes for real-time applications. The admission control scheme determines the admission of high-priority real-time applications such as voice and video streams in terms of their bandwidth utilization time (medium time), whereas the traffic control scheme maintains the communication quality of applications permitted admission by restricting other traffic. Owing to the use of contention-based access, a conventional scheme without admission control will degrade the communication quality when the number of terminals using high-priority applications increases. Moreover, only the capabilities (i.e., frame and sequence procedures) of admission control are defined in the IEEE 802.11e standard;the detailed usage in terms of the application characteristics is not specified, and it may be difficult to achieve a sufficient level of quality of service (QoS). The proposed schemes achieve the optimum QoS for actual services. The software used in the proposed schemes was implemented into hardware at the access point, and was evaluated experimentally. Based on the evaluation results, excellent performances with high QoS applications were obtained.

A New Approach to an Automated Air Traffic Control

This paper identifies areas of improvements of the air traffic control system and proposes modification of the concept of automation by using available technologies. With the proposed modification, the current Europe wide en route network structure can be modified in order to make routes more optimal. For this new route network structure, a new concept of automation will be used to manage with the air traffic. The first identified area of improvement is implementation of automation process that will enable decentralization of the air traffic control functionality to each individual aircraft and this will be achieved through automated routing of the aircrafts and CD＆R （conflict detection and resolution）. The FMS （flight management system） at the aircraft will make decisions for the optimal flight route based on the sensor inputs, information on selection of the routes, next hope points and flight levels, all received by ADS-B （automatic dependant surveillance-broadcast）. The second area is processing the information about the deviation from the optimal route as in flight plan due to a traffic management （vectoring, level change） and taking it into consideration when further actions are undertaken. For each action, a cost factor will be calculated from the fuel burned for that action. This factor will be used to select conflict resolution protocol. The proposed concept shall increase the capacity of the network, and enable the air traff^c more efficient and more environmentally friendly while maintaining safe separation.

Human Resource Management:A Case Study of the Air Traffic Controller Strike in 1981

The article discusses several hemispheres of human resource management based on a typical case review. The study presents the main problems of the case from both employees and organizations; the issued problems involve compensations and benefits,restructuring,job design,and training. Based on the analysis of the case,two alternative solutions state that the potential routes for the organizations to avoid serious negative results. The study introduces a number of recommendations that can be used as a reference for other organizations to avoid similar risks.

基于IPSec的CBTC数据安全传输的研究

在研究基于通信的列车控制(CBTC)系统的基础上,分析基于WLAN的数据传输系统的各种可能受到的安全威胁,提出基于IPSec协议的安全加强措施,在此基础上对IPSec协议进行改进和升级,构建分级IPSec数据传输方案,并进行数据传输实验,实验证明系统的安全性得到改进。

一种与IPSec兼容的基于有线/无线混合网络的TCP性能优化机制

传统的TCP协议,假设丢包都是由网络拥塞造成的,这不适用于错误丢包比拥塞丢包更容易发生的无线链路,而且现有的很多改进方案无法用于加密通讯中.在分析现有改进算法的基础上,提出一种适用于有线/无线混合网络IPSec兼容的端到端的优化机制.通过接收端数据包到达时间间隔的变化累积来判断无线链路的状况,用ACK标记ELN通知发送端,避免不必要的拥塞控制而导致性能下降.通过NS2仿真实验表明该机制能有效提高TCP传输性能还与现有的安全机制兼容.

基于IPSec协议的多VPN互通技术在工程实践中的应用研究

本文分析了IPSec VPN的技术特点及在工程应用中的部署过程,阐述了多VPN工程应用场景下实现互通的方法和难点,为大型企业提高网络资源利用率,降低总拥有成本提供参考。