Audio-Text Multimodal Speech Recognition via Dual-Tower Architecture for Mandarin Air Traffic Control Communications

In air traffic control communications (ATCC), misunderstandings between pilots and controllers could result in fatal aviation accidents. Fortunately, advanced automatic speech recognition technology has emerged as a promising means of preventing miscommunications and enhancing aviation safety. However, most existing speech recognition methods merely incorporate external language models on the decoder side, leading to insufficient semantic alignment between speech and text modalities during the encoding phase. Furthermore, it is challenging to model acoustic context dependencies over long distances due to the longer speech sequences than text, especially for the extended ATCC data. To address these issues, we propose a speech-text multimodal dual-tower architecture for speech recognition. It employs cross-modal interactions to achieve close semantic alignment during the encoding stage and strengthen its capabilities in modeling auditory long-distance context dependencies. In addition, a two-stage training strategy is elaborately devised to derive semantics-aware acoustic representations effectively. The first stage focuses on pre-training the speech-text multimodal encoding module to enhance inter-modal semantic alignment and aural long-distance context dependencies. The second stage fine-tunes the entire network to bridge the input modality variation gap between the training and inference phases and boost generalization performance. Extensive experiments demonstrate the effectiveness of the proposed speech-text multimodal speech recognition method on the ATCC and AISHELL-1 datasets. It reduces the character error rate to 6.54% and 8.73%, respectively, and exhibits substantial performance gains of 28.76% and 23.82% compared with the best baseline model. The case studies indicate that the obtained semantics-aware acoustic representations aid in accurately recognizing terms with similar pronunciations but distinctive semantics. The research provides a novel modeling paradigm for semantics-aware speech recognition in air traffic control communications, which could contribute to the advancement of intelligent and efficient aviation safety management.

Cluster DetectionMethod of Endogenous Security Abnormal Attack Behavior in Air Traffic Control Network

In order to enhance the accuracy of Air Traffic Control(ATC)cybersecurity attack detection,in this paper,a new clustering detection method is designed for air traffic control network security attacks.The feature set for ATC cybersecurity attacks is constructed by setting the feature states,adding recursive features,and determining the feature criticality.The expected information gain and entropy of the feature data are computed to determine the information gain of the feature data and reduce the interference of similar feature data.An autoencoder is introduced into the AI(artificial intelligence)algorithm to encode and decode the characteristics of ATC network security attack behavior to reduce the dimensionality of the ATC network security attack behavior data.Based on the above processing,an unsupervised learning algorithm for clustering detection of ATC network security attacks is designed.First,determine the distance between the clustering clusters of ATC network security attack behavior characteristics,calculate the clustering threshold,and construct the initial clustering center.Then,the new average value of all feature objects in each cluster is recalculated as the new cluster center.Second,it traverses all objects in a cluster of ATC network security attack behavior feature data.Finally,the cluster detection of ATC network security attack behavior is completed by the computation of objective functions.The experiment took three groups of experimental attack behavior data sets as the test object,and took the detection rate,false detection rate and recall rate as the test indicators,and selected three similar methods for comparative test.The experimental results show that the detection rate of this method is about 98%,the false positive rate is below 1%,and the recall rate is above 97%.Research shows that this method can improve the detection performance of security attacks in air traffic control network.

A Robust Conformer-Based Speech Recognition Model for Mandarin Air Traffic Control

This study aims to address the deviation in downstream tasks caused by inaccurate recognition results when applying Automatic Speech Recognition(ASR)technology in the Air Traffic Control(ATC)field.This paper presents a novel cascaded model architecture,namely Conformer-CTC/Attention-T5(CCAT),to build a highly accurate and robust ATC speech recognition model.To tackle the challenges posed by noise and fast speech rate in ATC,the Conformer model is employed to extract robust and discriminative speech representations from raw waveforms.On the decoding side,the Attention mechanism is integrated to facilitate precise alignment between input features and output characters.The Text-To-Text Transfer Transformer(T5)language model is also introduced to handle particular pronunciations and code-mixing issues,providing more accurate and concise textual output for downstream tasks.To enhance the model’s robustness,transfer learning and data augmentation techniques are utilized in the training strategy.The model’s performance is optimized by performing hyperparameter tunings,such as adjusting the number of attention heads,encoder layers,and the weights of the loss function.The experimental results demonstrate the significant contributions of data augmentation,hyperparameter tuning,and error correction models to the overall model performance.On the Our ATC Corpus dataset,the proposed model achieves a Character Error Rate(CER)of 3.44%,representing a 3.64%improvement compared to the baseline model.Moreover,the effectiveness of the proposed model is validated on two publicly available datasets.On the AISHELL-1 dataset,the CCAT model achieves a CER of 3.42%,showcasing a 1.23%improvement over the baseline model.Similarly,on the LibriSpeech dataset,the CCAT model achieves a Word Error Rate(WER)of 5.27%,demonstrating a performance improvement of 7.67%compared to the baseline model.Additionally,this paper proposes an evaluation criterion for assessing the robustness of ATC speech recognition systems.In robustness evaluation experiments based on this criterion,the proposed model demonstrates a performance improvement of 22%compared to the baseline model.

Comprehensive Review on Air Pollution Control Measures for Non-Attainment Cities of Uttar Pradesh, India

Introduction: The Indian state of Uttar Pradesh (UP) for the past many years has been reported to have many cities with highly polluted air quality. The state has been taking meticulous steps in combating air pollution in the form of action plans, introduced especially in its 17 non-attainment cities (NAC). To assess the progress and development of these action plans in UP, the present study has done an in-depth analysis and review of the state’s action plans and city micro action plans. Materials and Methods: In this research study, the analysis of the latest action plan reports, micro action plan reports as well as the recommendations for combating air pollution-related issues in the 17 NAC of the UP state has been well documented. Uttar Pradesh Pollution Control Board (UPPCB) has prepared these reports to highlight the progress of the plans in response to the growing air pollution in these cities. The information present in the reports has been used to further study sector-specific, category-specific action plans, institutional responsibility, and the present status of the action plans. Results: On average, the highest weightage in action plans was given to sector-specific categories such as Road dust and construction activities (24%). It was also observed that Urban local bodies (~50%) were majorly responsible to implement the action points and 56% of the action points were jointly implemented by multiple agencies.

Evaluation of mercury speciation and removal through air pollution control devices of a 190 MW boiler

Air pollution control devices （APCDs） are installed at coal-fired power plants for air pollutant regulation. Selective catalytic reduction （SCR） and wet flue gas desulftLrization （FGD） systems have the co-benefits of air pollutant and mercury removal. Configuration and operational conditions of APCDs and mercury speciation affect mercury removal efficiently at coal-fired utilities. The Ontario Hydro Method （OHM） recommended by the U.S. Environmental Protection Agency （EPA） was used to determine mercury speciation simultaneously at five sampling locations through SCR-ESP-FGD at a 190 MW unit. Chlorine in coal had been suggested as a factor affecting the mercury speciation in flue gas; and low-chlorine coal was purported to produce less oxidized mercury （Hg^2＋） and more elemental mercury （Hg^0） at the SCR inlet compared to higher chlorine coal. SCR could oxidize elemental mercury into oxidized mercury when SCR was in service, and oxidation efficiency reached 71.0%. Therefore, oxidized mercury removal efficiency was enhanced through a wet FGD system. In the non-ozone season, about 89.5%-96.8% of oxidized mercury was controlled, but only 54.9%-68.8% of the total mercury was captured through wet FGD. Oxidized mercury removal efficiency was 95.9%-98.0%, and there was a big difference in the total mercury removal efficiencies from 78.0% to 90.2% in the ozone season. Mercury mass balance was evaluated to validate reliability of OHM testing data, and the ratio of mercury input in the coal to mercury output at the stack was from 0.84 to 1.08.

Progress of Air Pollution Control in China and Its Challenges and Opportunities in the Ecological Civilization Era

China’s past economic growth has substantially relied on fossil fuels,causing serious air pollution issues.Decoupling economic growth and pollution has become the focus in developing ecological civilization in China.We have analyzed the three-decade progress of air pollution controls in China,highlighting a strategic transformation from emission control toward air quality management.Emission control of sulfur dioxide(SO2)resolved the deteriorating acid rain issue in China in 2007.Since 2013,control actions on multiple precursors and sectors have targeted the reduction of the concentration of fine particulate matter(PM2.5),marking a transition to an air-quality-oriented strategy.Increasing ozone(O3)pollution further requires O3 and PM2.5 integrated control strategies with an emphasis on their complex photochemical interactions.Fundamental improvement of air quality in China,as a key indicator for the success of ecological civilization construction,demands the deep de-carbonization of China’s energy system as well as more synergistic pathways to address air pollution and global climate change simultaneously.

Hierarchical Control of Ride Height System for Electronically Controlled Air Suspension Based on Variable Structure and Fuzzy Control Theory

The current research of air suspension mainly focuses on the characteristics and design of the air spring. In fact, electronically controlled air suspension （ECAS） has excellent performance in flexible height adjustment during different driving conditions. However, the nonlinearity of the ride height adjusting system and the uneven distribution of payload affect the control accuracy of ride height and the body attitude. Firstly, the three-point measurement system of three height sensors is used to establish the mathematical model of the ride height adjusting system. The decentralized control of ride height and the centralized control of body attitude are presented to design the ride height control system for ECAS. The exact feedback linearization method is adopted for the nonlinear mathematical model of the ride height system. Secondly, according to the hierarchical control theory, the variable structure control （VSC） technique is used to design a controller that is able to adjust the ride height for the quarter-vehicle anywhere, and each quarter-vehicle height control system is independent. Meanwhile, the three-point height signals obtained by three height sensors are tracked to calculate the body pitch and roll attitude over time, and then by calculating the deviation of pitch and roll and its rates, the height control correction is reassigned based on the fuzzy algorithm. Finally, to verify the effectiveness and performance of the proposed combined control strategy, a validating test of ride height control system with and without road disturbance is carried out. Testing results show that the height adjusting time of both lifting and lowering is over 5 s, and the pitch angle and the roll angle of body attitude are less than 0.15°. This research proposes a hierarchical control method that can guarantee the attitude stability, as well as satisfy the ride height tracking system.

Leaching behavior of Pb and Zn in air pollution control residues and their modeling prediction

Increasing attention has been paid to air pollution control （APC） residues in China recently due to the rising proportion of waste incineration and the hazardous characteristics of the residues, among which heavy metal leaching toxicity plays an important role. Leaching behavior and potential risk of Pb and Zn in the APC residues from a Shanghai municipal solid waste （MSW） incinerator was studied, based on the leaching tests under different conditions and theoretical calculation using a geochemical thermodynamic equilibrium model MINTEQA2. Results showed that, extractant species and liquid to solid （L/S） ratio predominantly controlled the leaching toxicity of Pb and Zn, while ionic strength, vibration method and leaching time had less effect on the metals release. Leachate/final pH determined the metal leaching behavior, which changed the speciation of heavy metals in the extraction system. The equilibrium aqueous speciation, precipitation-dissolution of Pb and Zn was investigated according to the model computation, which was well in agreement with the experimental results.

A Hybrid Approach to Modeling and Control of Vehicle Height for Electronically Controlled Air Suspension

The control problems associated with vehicle height adjustment of electronically controlled air suspension （ECAS） still pose theoretical challenges for researchers, which manifest themselves in the publications on this subject over the last years. This paper deals with modeling and control of a vehicle height adjustment system for ECAS, which is an example of a hybrid dynamical system due to the coexistence and coupling of continuous variables and discrete events. A mixed logical dynamical （MLD） modeling approach is chosen for capturing enough details of the vehicle height adjustment process. The hybrid dynamic model is constructed on the basis of some assumptions and piecewise linear approximation for components nonlinearities. Then, the on-off statuses of solenoid valves and the piecewise approximation process are described by propositional logic, and the hybrid system is transformed into the set of linear mixed-integer equalities and inequalities, denoted as MLD model, automatically by HYSDEL. Using this model, a hybrid model predictive controller （HMPC） is tuned based on online mixed-integer quadratic optimization （MIQP）. Two different scenarios are considered in the simulation, whose results verify the height adjustment effectiveness of the proposed approach. Explicit solutions of the controller are computed to control the vehicle height adjustment system in realtime using an offline multi-parametric programming technology （MPT）, thus convert the controller into an equivalent explicit piecewise affine form. Finally, bench experiments for vehicle height lifting, holding and lowering procedures are conducted, which demonstrate that the HMPC can adjust the vehicle height by controlling the on-off statuses of solenoid valves directly. This research proposes a new modeling and control method for vehicle height adjustment of ECAS, which leads to a closed-loop system with favorable dynamical properties.

Integrated Evaluation of Air Traffic Controller Workload Based on Matter-Element Analysis

A model for evaluating the controller workload was presented based on matter-element analysis, particularly from a mansystem engineering perspective. On the basis of a questionnaire survey, 18 kinds of indexes which influence the controller workload were determined. By establishing the classical field and node field of the controller workload, the correlation function of the controller workload grade was obtained; then the correlation degree and estimated grade of controller workload were given. A case study verifies the feasibility of the proposed evaluation method.

DISPLACEMENT CONTROL AND KINETIC ANALYSIS OF A NOVEL VARIABLE DISPLACEMENT COMPRESSOR FOR AUTOMOTIVE AIR CONDITIONER

A novel variable displacement compressor (VDC) for automotive air conditioner (AAC) is introduced, which inherits the advantages of common wobble plate type VDC. It has fewer parts and makes less noise, and instead of pneumatic valve the displacement is controlled by electronic control valve. In order to know the control mechanism well and get a good control effect, a mathematical model for the variable displacement mechanism is developed according to the geometrical and kinematical information of the compressor. Using the model, the effect of relevant parameters on variable displace control is estimated. It is helpful to make the optimum decision in the flow control of AAC. As the novel displacement control device, the structure and control rule of electronic control valve is introduced. It can get better effect than the conventional pneumatic valves. And by using this new electronic control device, the optimum systemic control of AAC is available.

Electronically Controlling the System of Preheating Intake Air by Flame for Diesel Engine Cold-Start

In order to improve the cold start performance of heavy duty diesel engine, electronically controlling the preheating of intake air by flame was researched. According to simulation and thermodynamic analysis about the partial working processes of the diesel engine, the amount of heat energy, enough to make the fuel self ignite at the end of compression process at different temperatures of coolant and intake air, was calculated. Several HY20 preheating plugs were used to heat up the intake air. Meanwhile, an electronic control system based on 8 bit micro controller unit (MCS 8031) was designed to automatically control the process of heating intake air. According to the various temperatures of coolant and ambient air, one plug or two plugs can automatically be selected to heat intake air. The demo experiment validated that the total system could operate successfully and achieve the scheduled function.

Air flow control based on optimal oxygen excess ratio in fuel cells for vehicles

Air flow control is one of the most important control methods for maintaining the stability and reliability of a fuel cell system, which can avoid oxygen starvation or oxygen saturation. The oxygen excess ratio （OER） is often used to indicate the air flow condition. Based on a fuel cell system model for vehicles, OER performance was analyzed for different stack currents and temperatures in this paper, and the results show that the optimal OER was affected weakly by the stack temperature. In order to ensure the system working in optimal OER, a control scheme that includes an optimal OER regulator and a fuzzy control was proposed. According to the stack current, a reference value of air flow rate was obtained with the optimal OER regulator and then the air compressor motor voltage was controlled with the fuzzy controller to adjust the air flow rate provided by the air compressor. Simulation results show that the control method has good dynamic and static characteristics.

Identification of Information-Seeking Behaviors from Air Traffic Controllers′ Eye Movements

Air traffic controllers are the important parts of air traffic management system who are responsible for the safety and efficiency of the system.They make traffic management decisions based on information acquired from various sources.The understanding of their information seeking behaviors is still limited.We aim to identify controllers′ behavior through the examination of the correlations between controllers′eye movements and air traffic.Sixteen air traffic controllers were invited to participate real-time simulation experiments,during which the data of their eye ball movements and air traffic were recorded.Tweny-three air traffic complexity metrics and six eye movements metrics were calculated to examine their relationships.Two correlational methods,Pearson′s correlation and Spearman′s correlation,were tested between every eye-traffic pair of metrics.The results indicate that controllers′two kinds of information-seeking behaviors can be identified from their eye movements:Targets tracking,and confliction recognition.The study on controllers′ eye movements may contribute to the understanding of information-seeking mechanisms leading to the development of more intelligent automations in the future.

Thermodynamic Modeling and Simulation of Air System Control Device

This paper aims to obtain the thermodynamic characteristics of the air system control device sealing part in different compressor bleed air and ambient temperature.On the basis of considering the main factors affecting the heat exchange process and simplifying the physical model of the air system control device,the thermodynamic model of air system control device is established based on the basic theory of laminar flow heat transfer and heat conduction theory.Then the piston motion characteristics and the thermodynamic characteristics of the air system control device seal are simulated.The simulation results show that the valve actuation dynamic time of piston is about 0.13 s in the actual working conditions,and the temperature effect on the dynamic response of the piston rod is only 5 ms when the inlet air temperature at 300 ℃ and 370 ℃.The maximum temperature of the air system control device sealing part is not more than 290 ℃ under long time working condition of compressor air entraining.The highest temperature of the sealing part can reach up to 340 ℃ when the air flow temperature reaches the limit temperature of 370 ℃,and the longest duration working temperature limit is not more than 14 s.Therefore,the selection of control device sealing material should consider the work characteristic of instantaneous temperature limit.

Adaptive Air-Fuel Ratio Control with MLP Network

This paper presents an application of adaptive neural network model-based predictive control (MPC) to the air-fuel ratio of an engine simulation. A multi-layer perceptron (MLP) neural network is trained using two on-line training algorithms: a back propagation algorithm and a recursive least squares (RLS) algorithm. It is used to model parameter uncertainties in the nonlinear dynamics of internal combustion (IC) engines. Based on the adaptive model, an MPC strategy for controlling air-fuel ratio is realized, and its control performance compared with that of a traditional PI controller. A reduced Hessian method, a newly developed sequential quadratic programming (SQP) method for solving nonlinear programming (NLP) problems, is implemented to speed up nonlinear optimization in the MPC. Keywords Air-fuel ratio control - IC engine - adaptive neural networks - nonlinear programming - model predictive control Shi-Wei Wang PhD student, Liverpool John Moores University; MSc in Control Systems, University of Sheffield, 2003; BEng in Automatic Technology, Jilin University, 2000; Current research interests automotive engine control, model predictive control, sliding mode control, neural networks.Ding-Li Yu obtained B.Eng from Harbin Civil Engineering College, Harbin, China in 1981, M.Sc from Jilin University of Technology, Changchun, China in 1986 and PhD from Coventry University, U.K. in 1995, all in control engineering. He is currently a Reader in Process Control at Liverpool John Moores University, U.K. His current research interests are in process control, engine control, fault detection and adaptive neural nets. He is a member of SAFEPROCESS TC in IFAC and an associate editor of the IJMIC and the IJISS.

Effect of Working Experience on Air Traffic Controller Eye Movement

Eye movement is an important indicator of information-seeking behavior and provides insight into cognitive strategies which are vital for decision-making.Various measures based on eye movements have been proposed to capture humans’ability to process information in a complex environment.The effectiveness of these measures has not yet been fully explored in the field of air traffic management.This paper presents a comparative study on eye-movement measures in air traffic controllers with different levels of working experience.Two commonly investigated oculomotor behaviors,fixation and saccades,together with gaze entropy,are examined.By comparing the statistical properties of the relevant metrics,it is shown that working experience has a notable effect on eye-movement patterns.Both fixation and saccades differ between qualified and novice controllers,with the former type of controller employing more efficient searching strategies.These findings are useful in enhancing the quality of controller training and contributing to an understanding of the information-seeking mechanisms humans use when executing complex tasks.

Genetic Optimization Algorithm of PID Decoupling Control for VAV Air-Conditioning System

Variable-air-volume (VAV) air-conditioning system is a multi-variable system and has multi coupling control loops. While all of the control loops are working together, they interfere and influence each other. A multivariable decoupling PID controller is designed for VAV air-conditioning system. Diagonal matrix decoupling method is employed to eliminate the coupling between the loop of supply air temperature and that of thermal-space air temperature. The PID controller parameters are optimized by means of an improved genetic algorithm in floating point representations to obtain better performance. The population in the improved genetic algorithm mutates before crossover, which is helpful for the convergence. Additionally the micro mutation algorithm is proposed and applied to improve the convergence during the later evolution. To search the best parameters, the optimized parameters ranges should be amplified 10 times the initial ideal parameters. The simulation and experiment results show that the decoupling control system is effective and feasible. The method can overcome the strong coupling feature of the system and has shorter governing time and less over-shoot than non-optimization PID control.

Research on the SO_2 Control Technology of Air Pollution

With the rapid development of industry and energy,the emission of a large number of SO2 has brought serious harm to the global environment.This paper introduces several main SO2 control technologies and describes the progress of the advanced desulfurization technologies at home and abroad.At last,higher requirements on desulfurization technology are raised.

Refrigerant Control Strategies for Residential Air-Conditioning and Heat-Pump System

This paper simulated the optimal refrigerant charge inventory of a refrigeration system in air-conditioning operation and heat-pump operation respectively,and studied the refrigerant control strategies in this system.The void fraction in two-phase fluid region was calculated by Harms model.And based on distributed parameter model and Harms model,the refrigerant charge inventory in condenser and evaporator were calculated and analyzed in air-conditioning conditions and heat-pump conditions,respectively.The calculating results of different refrigerant mass between refrigeration and heating conditions indicate that the optimal refrigerant charge inventory in heat-pump conditions is lower than that in air-conditioning conditions.To avoid the decrease of COP due to the surplus refrigerant in heating conditions,we introduced the liquid reservoir control method and associate capillary control method.Both of them could increase the heating capacity of the air-source heat pump.The difference of optimal refrigerant charge inventory in air-conditioning and heat-pump system can be controlled by the liquid reservoir or the associate capillary.