A situation awareness assessment method based on fuzzy cognitive maps

The status of an operator’s situation awareness is one of the critical factors that influence the quality of the missions.Thus the measurement method of the situation awareness status is an important topic to research.So far,there are lots of methods designed for the measurement of situation awareness status,but there is no model that can measure it accurately in real-time,so this work is conducted to deal with such a gap.Firstly,collect the relevant physiological data of operators while they are performing a specific mission,simultaneously,measure their status of situation awareness by using the situation awareness global assessment technique(SAGAT),which is known for accuracy but cannot be used in real-time.And then,after the preprocessing of the raw data,use the physiological data as features,the SAGAT’s results as a label to train a fuzzy cognitive map(FCM),which is an explainable and powerful intelligent model.Also,a hybrid learning algorithm of particle swarm optimization(PSO)and gradient descent is proposed for the FCM training.The final results show that the learned FCM can assess the status of situation awareness accurately in real-time,and the proposed hybrid learning algorithm has better efficiency and accuracy.

Deep Reinforcement Learning Model for Blood Bank Vehicle Routing Multi-Objective Optimization

The overall healthcare system has been prioritized within development top lists worldwide.Since many national populations are aging,combined with the availability of sophisticated medical treatments,healthcare expenditures are rapidly growing.Blood banks are a major component of any healthcare system,which store and provide the blood products needed for organ transplants,emergency medical treatments,and routine surgeries.Timely delivery of blood products is vital,especially in emergency settings.Hence,blood delivery process parameters such as safety and speed have received attention in the literature,as well as other parameters such as delivery cost.In this paper,delivery time and cost are modeled mathematically and marked as objective functions requiring simultaneous optimization.A solution is proposed based on Deep Reinforcement Learning(DRL)to address the formulated delivery functions as Multi-objective Optimization Problems(MOPs).The basic concept of the solution is to decompose the MOP into a scalar optimization sub-problems set,where each one of these sub-problems is modeled as a separate Neural Network(NN).The overall model parameters for each sub-problem are optimized based on a neighborhood parameter transfer and DRL training algorithm.The optimization step for the subproblems is undertaken collaboratively to optimize the overall model.Paretooptimal solutions can be directly obtained using the trained NN.Specifically,the multi-objective blood bank delivery problem is addressed in this research.Onemajor technical advantage of this approach is that once the trainedmodel is available,it can be scaled without the need formodel retraining.The scoring can be obtained directly using a straightforward computation of the NN layers in a limited time.The proposed technique provides a set of technical strength points such as the ability to generalize and solve rapidly compared to othermulti-objective optimizationmethods.The model was trained and tested on 5 major hospitals in Saudi Arabia’s Riyadh region,and the simulation results indicated that time and cost decreased by 35%and 30%,respectively.In particular,the proposed model outperformed other state-of-the-art MOP solutions such as Genetic Algorithms and Simulated Annealing.

Ballistic response of armour plates using Generative Adversarial Networks

It is important to understand how ballistic materials respond to impact from projectiles such that informed decisions can be made in the design process of protective armour systems. Ballistic testing is a standards-based process where materials are tested to determine whether they meet protection, safety and performance criteria. For the V50ballistic test, projectiles are fired at different velocities to determine a key design parameter known as the ballistic limit velocity(BLV), the velocity above which projectiles perforate the target. These tests, however, are destructive by nature and as such there can be considerable associated costs, especially when studying complex armour materials and systems. This study proposes a unique solution to the problem using a recent class of machine learning system known as the Generative Adversarial Network(GAN). The GAN can be used to generate new ballistic samples as opposed to performing additional destructive experiments. A GAN network architecture is tested and trained on three different ballistic data sets, and their performance is compared. The trained networks were able to successfully produce ballistic curves with an overall RMSE of between 10 and 20 % and predicted the V50BLV in each case with an error of less than 5 %. The results demonstrate that it is possible to train generative networks on a limited number of ballistic samples and use the trained network to generate many new samples representative of the data that it was trained on. The paper spotlights the benefits that generative networks can bring to ballistic applications and provides an alternative to expensive testing during the early stages of the design process.

Deep reinforcement learning for wind and energy storage coordination in wholesale energy and ancillary service markets

Wind energy has been increasingly adopted to mitigate climate change.However,the variability of wind energy causes wind curtailment,resulting in considerable economic losses for wind farm owners.Wind curtailment can be reduced using battery energy storage systems(BESS)as onsite backup sources.Yet,this auxiliary role may significantly weaken the economic potential of BESS in energy trading.Ideal BESS scheduling should balance onsite wind curtailment reduction and market bidding,but practical implementation is challenging due to coordination complexity and the stochastic nature of energy prices and wind generation.We investigate the joint-market bidding strategy of a co-located wind-battery system in the spot and Regulation Frequency Control Ancillary Service markets.We propose a novel deep reinforcement learning-based approach that decouples the system’s market participation into two related Markov decision processes for each facility,enabling the BESS to absorb onsite wind curtailment while performing joint-market bidding to maximize overall operational revenues.Using realistic wind farm data,we validated the coordinated bidding strategy,with outcomes surpassing the optimization-based benchmark in terms of higher revenue by approximately 25%and more wind curtailment reduction by 2.3 times.Our results show that joint-market bidding can significantly improve the financial performance of wind-battery systems compared to participating in each market separately.Simulations also show that using curtailed wind generation as a power source for charging the BESS can lead to additional financial gains.The successful implementation of our algorithm would encourage co-location of generation and storage assets to unlock wider system benefits.

Reinforcement learning for whole-building HVAC control and demand response

This paper proposes a novel reinforcement learning(RL)architecture for the efficient scheduling and control of the heating,ventilation and air conditioning(HVAC)system in a commercial building while harnessing its de-mand response(DR)potentials.With advances in automated building management systems,this can be achieved seamlessly by a smart autonomous RL agent which takes the best action,for example,a change in HVAC temper-ature set point,necessary to change the electricity usage pattern of a building in response to demand response signals,and with minimal thermal comfort impact to customers.Previous research in this area has tackled only individual aspects of the problem using RL.Specifically,due to the challenges in implementing demand response with whole-building models,simpler analytical models which poorly capture reality have been used instead.And where whole-building models are applied,RL is used for HVAC control mainly to achieve energy efficiency goals while demand response is neglected.Thus,in this research,we implement a holistic framework by designing an efficient RL controller for a whole-building model which learns to optimise and control the HVAC system for improved energy efficiency and thermal comfort levels in addition to achieving demand response goals.Our simulation results show that by applying reinforcement learning for normal HVAC operation,a maximum weekly energy reduction of up to 22%can be achieved compared to a handcrafted baseline controller.Furthermore,by employing a DR-aware RL controller during demand response periods,average power reductions or increases of up to 50%can be achieved on a weekly basis compared to the default RL controller,while keeping occupant thermal comfort levels within acceptable bounds.

Real-time evaluation method of flight mission load based on sensitivity analysis of physiological factors

As the complexity of flight missions continues to increase,sending a timely warning or providing assistance to pilots helps to reduce the probability of operational errors and flight accidents.Monitoring pilots’physiological data,real-time evaluation of mission load is a feasible technical way to achieve this.In this paper,a set of flight tasks including aircraft control,humancomputer interaction and mental arithmetic tests are designed to simulate five mission loads at different flight difficulty levels.A sensitivity analysis method based on a comprehensive test is proposed to select a set of sensitive physiological factors.Then,based on the SVM hierarchical combination classification method,the pilot mission load real-time evaluation model is established.The test results show significant differences in EMG,respiration rate(abdomen),heart rate,blood oxygen saturation,pupil area,fixation duration,number of fixations,and saccades.The high accuracy obtained from experiments proved that the proposed real-time evaluation model is applicable to meet the requirements of real working environments.The findings can provide methodological references for mission load evaluation research in other fields.