Generating Time-Series Data Using Generative Adversarial Networks for Mobility Demand Prediction

The increasing penetration rate of electric kickboard vehicles has been popularized and promoted primarily because of its clean and efficient features.Electric kickboards are gradually growing in popularity in tourist and education-centric localities.In the upcoming arrival of electric kickboard vehicles,deploying a customer rental service is essential.Due to its freefloating nature,the shared electric kickboard is a common and practical means of transportation.Relocation plans for shared electric kickboards are required to increase the quality of service,and forecasting demand for their use in a specific region is crucial.Predicting demand accurately with small data is troublesome.Extensive data is necessary for training machine learning algorithms for effective prediction.Data generation is a method for expanding the amount of data that will be further accessible for training.In this work,we proposed a model that takes time-series customers’electric kickboard demand data as input,pre-processes it,and generates synthetic data according to the original data distribution using generative adversarial networks(GAN).The electric kickboard mobility demand prediction error was reduced when we combined synthetic data with the original data.We proposed Tabular-GAN-Modified-WGAN-GP for generating synthetic data for better prediction results.We modified The Wasserstein GAN-gradient penalty(GP)with the RMSprop optimizer and then employed Spectral Normalization(SN)to improve training stability and faster convergence.Finally,we applied a regression-based blending ensemble technique that can help us to improve performance of demand prediction.We used various evaluation criteria and visual representations to compare our proposed model’s performance.Synthetic data generated by our suggested GAN model is also evaluated.The TGAN-Modified-WGAN-GP model mitigates the overfitting and mode collapse problem,and it also converges faster than previous GAN models for synthetic data creation.The presented model’s performance is compared to existing ensemble and baseline models.The experimental findings imply that combining synthetic and actual data can significantly reduce prediction error rates in the mean absolute percentage error(MAPE)of 4.476 and increase prediction accuracy.

Prediction model for corrosion rate of low-alloy steels under atmospheric conditions using machine learning algorithms

This work constructed a machine learning(ML)model to predict the atmospheric corrosion rate of low-alloy steels(LAS).The material properties of LAS,environmental factors,and exposure time were used as the input,while the corrosion rate as the output.6 dif-ferent ML algorithms were used to construct the proposed model.Through optimization and filtering,the eXtreme gradient boosting(XG-Boost)model exhibited good corrosion rate prediction accuracy.The features of material properties were then transformed into atomic and physical features using the proposed property transformation approach,and the dominant descriptors that affected the corrosion rate were filtered using the recursive feature elimination(RFE)as well as XGBoost methods.The established ML models exhibited better predic-tion performance and generalization ability via property transformation descriptors.In addition,the SHapley additive exPlanations(SHAP)method was applied to analyze the relationship between the descriptors and corrosion rate.The results showed that the property transformation model could effectively help with analyzing the corrosion behavior,thereby significantly improving the generalization ability of corrosion rate prediction models.

Flood Velocity Prediction Using Deep Learning Approach

Floods are one of the most serious natural disasters that can cause huge societal and economic losses.Extensive research has been conducted on topics like flood monitoring,prediction,and loss estimation.In these research fields,flood velocity plays a crucial role and is an important factor that influences the reliability of the outcomes.Traditional methods rely on physical models for flood simulation and prediction and could generate accurate results but often take a long time.Deep learning technology has recently shown significant potential in the same field,especially in terms of efficiency,helping to overcome the time-consuming associated with traditional methods.This study explores the potential of deep learning models in predicting flood velocity.More specifically,we use a Multi-Layer Perceptron(MLP)model,a specific type of Artificial Neural Networks(ANNs),to predict the velocity in the test area of the Lundesokna River in Norway with diverse terrain conditions.Geographic data and flood velocity simulated based on the physical hydraulic model are used in the study for the pre-training,optimization,and testing of the MLP model.Our experiment indicates that the MLP model has the potential to predict flood velocity in diverse terrain conditions of the river with acceptable accuracy against simulated velocity results but with a significant decrease in training time and testing time.Meanwhile,we discuss the limitations for the improvement in future work.

Modeling urban redevelopment:A novel approach using time-series remote sensing data and machine learning

Accurate mapping and timely monitoring of urban redevelopment are pivotal for urban studies and decisionmakers to foster sustainable urban development.Traditional mapping methods heavily depend on field surveys and subjective questionnaires,yielding less objective,reliable,and timely data.Recent advancements in Geographic Information Systems(GIS)and remote-sensing technologies have improved the identification and mapping of urban redevelopment through quantitative analysis using satellite-based observations.Nonetheless,challenges persist,particularly concerning accuracy and significant temporal delays.This study introduces a novel approach to modeling urban redevelopment,leveraging machine learning algorithms and remote-sensing data.This methodology can facilitate the accurate and timely identification of urban redevelopment activities.The study’s machine learning model can analyze time-series remote-sensing data to identify spatio-temporal and spectral patterns related to urban redevelopment.The model is thoroughly evaluated,and the results indicate that it can accurately capture the time-series patterns of urban redevelopment.This research’s findings are useful for evaluating urban demographic and economic changes,informing policymaking and urban planning,and contributing to sustainable urban development.The model can also serve as a foundation for future research on early-stage urban redevelopment detection and evaluation of the causes and impacts of urban redevelopment.

Hierarchical multihead self-attention for time-series-based fault diagnosis

Fault diagnosis is important for maintaining the safety and effectiveness of chemical process.Considering the multivariate,nonlinear,and dynamic characteristic of chemical process,many time-series-based data-driven fault diagnosis methods have been developed in recent years.However,the existing methods have the problem of long-term dependency and are difficult to train due to the sequential way of training.To overcome these problems,a novel fault diagnosis method based on time-series and the hierarchical multihead self-attention(HMSAN)is proposed for chemical process.First,a sliding window strategy is adopted to construct the normalized time-series dataset.Second,the HMSAN is developed to extract the time-relevant features from the time-series process data.It improves the basic self-attention model in both width and depth.With the multihead structure,the HMSAN can pay attention to different aspects of the complicated chemical process and obtain the global dynamic features.However,the multiple heads in parallel lead to redundant information,which cannot improve the diagnosis performance.With the hierarchical structure,the redundant information is reduced and the deep local time-related features are further extracted.Besides,a novel many-to-one training strategy is introduced for HMSAN to simplify the training procedure and capture the long-term dependency.Finally,the effectiveness of the proposed method is demonstrated by two chemical cases.The experimental results show that the proposed method achieves a great performance on time-series industrial data and outperforms the state-of-the-art approaches.

Missing Value Imputation for Radar-Derived Time-Series Tracks of Aerial Targets Based on Improved Self-Attention-Based Network

The frequent missing values in radar-derived time-series tracks of aerial targets(RTT-AT)lead to significant challenges in subsequent data-driven tasks.However,the majority of imputation research focuses on random missing(RM)that differs significantly from common missing patterns of RTT-AT.The method for solving the RM may experience performance degradation or failure when applied to RTT-AT imputation.Conventional autoregressive deep learning methods are prone to error accumulation and long-term dependency loss.In this paper,a non-autoregressive imputation model that addresses the issue of missing value imputation for two common missing patterns in RTT-AT is proposed.Our model consists of two probabilistic sparse diagonal masking self-attention(PSDMSA)units and a weight fusion unit.It learns missing values by combining the representations outputted by the two units,aiming to minimize the difference between the missing values and their actual values.The PSDMSA units effectively capture temporal dependencies and attribute correlations between time steps,improving imputation quality.The weight fusion unit automatically updates the weights of the output representations from the two units to obtain a more accurate final representation.The experimental results indicate that,despite varying missing rates in the two missing patterns,our model consistently outperforms other methods in imputation performance and exhibits a low frequency of deviations in estimates for specific missing entries.Compared to the state-of-the-art autoregressive deep learning imputation model Bidirectional Recurrent Imputation for Time Series(BRITS),our proposed model reduces mean absolute error(MAE)by 31%~50%.Additionally,the model attains a training speed that is 4 to 8 times faster when compared to both BRITS and a standard Transformer model when trained on the same dataset.Finally,the findings from the ablation experiments demonstrate that the PSDMSA,the weight fusion unit,cascade network design,and imputation loss enhance imputation performance and confirm the efficacy of our design.

An attention-based teacher-student model for multivariate short-term landslide displacement prediction incorporating weather forecast data

Predicting the displacement of landslide is of utmost practical importance as the landslide can pose serious threats to both human life and property.However,traditional methods have the limitation of random selection in sliding window selection and seldom incorporate weather forecast data for displacement prediction,while a single structural model cannot handle input sequences of different lengths at the same time.In order to solve these limitations,in this study,a new approach is proposed that utilizes weather forecast data and incorporates the maximum information coefficient(MIC),long short-term memory network(LSTM),and attention mechanism to establish a teacher-student coupling model with parallel structure for short-term landslide displacement prediction.Through MIC,a suitable input sequence length is selected for the LSTM model.To investigate the influence of rainfall on landslides during different seasons,a parallel teacher-student coupling model is developed that is able to learn sequential information from various time series of different lengths.The teacher model learns sequence information from rainfall intensity time series while incorporating reliable short-term weather forecast data from platforms such as China Meteorological Administration(CMA)and Reliable Prognosis(https://rp5.ru)to improve the model’s expression capability,and the student model learns sequence information from other time series.An attention module is then designed to integrate different sequence information to derive a context vector,representing seasonal temporal attention mode.Finally,the predicted displacement is obtained through a linear layer.The proposed method demonstrates superior prediction accuracies,surpassing those of the support vector machine(SVM),LSTM,recurrent neural network(RNN),temporal convolutional network(TCN),and LSTM-Attention models.It achieves a mean absolute error(MAE)of 0.072 mm,root mean square error(RMSE)of 0.096 mm,and pearson correlation coefficients(PCCS)of 0.85.Additionally,it exhibits enhanced prediction stability and interpretability,rendering it an indispensable tool for landslide disaster prevention and mitigation.

Note on:“Ballistic model for the prediction of penetration depth and residual velocity in adobe:A new interpretation of the ballistic resistance of earthen masonry”

A recently published modeling approach for the penetration into adobe and previous approaches implicitly criticized are reviewed and discussed.This article contains a note on the paper titled“Ballistic model for the prediction of penetration depth and residual velocity in adobe:A new interpretation of the ballistic resistance of earthen masonry”(DOI:https://doi.org/10.1016/j.dt.2018.07.017).Reply to the Note from Li Piani et al is linked to this article.

Cardiovascular computed tomography in cardiovascular disease:An overview of its applications from diagnosis to prediction

Cardiovascular computed tomography angiography(CTA)is a widely used imaging modality in the diagnosis of cardiovascular disease.Advancements in CT imaging technology have further advanced its applications from high diagnostic value to minimising radiation exposure to patients.In addition to the standard application of assessing vascular lumen changes,CTA-derived applications including 3D printed personalised models,3D visualisations such as virtual endoscopy,virtual reality,augmented reality and mixed reality,as well as CT-derived hemodynamic flow analysis and fractional flow reserve(FFRCT)greatly enhance the diagnostic performance of CTA in cardiovascular disease.The widespread application of artificial intelligence in medicine also significantly contributes to the clinical value of CTA in cardiovascular disease.Clinical value of CTA has extended from the initial diagnosis to identification of vulnerable lesions,and prediction of disease extent,hence improving patient care and management.In this review article,as an active researcher in cardiovascular imaging for more than 20 years,I will provide an overview of cardiovascular CTA in cardiovascular disease.It is expected that this review will provide readers with an update of CTA applications,from the initial lumen assessment to recent developments utilising latest novel imaging and visualisation technologies.It will serve as a useful resource for researchers and clinicians to judiciously use the cardiovascular CT in clinical practice.

Development and validation of a model integrating clinical and coronary lesion-based functional assessment for longterm risk prediction in PCI patients

OBJECTIVES To establish a scoring system combining the ACEF score and the quantitative blood flow ratio(QFR) to improve the long-term risk prediction of patients undergoing percutaneous coronary intervention(PCI).METHODS In this population-based cohort study, a total of 46 features, including patient clinical and coronary lesion characteristics, were assessed for analysis through machine learning models. The ACEF-QFR scoring system was developed using 1263consecutive cases of CAD patients after PCI in PANDA Ⅲ trial database. The newly developed score was then validated on the other remaining 542 patients in the cohort.RESULTS In both the Random Forest Model and the Deep Surv Model, age, renal function(creatinine), cardiac function(LVEF)and post-PCI coronary physiological index(QFR) were identified and confirmed to be significant predictive factors for 2-year adverse cardiac events. The ACEF-QFR score was constructed based on the developmental dataset and computed as age(years)/EF(%) + 1(if creatinine ≥ 2.0 mg/d L) + 1(if post-PCI QFR ≤ 0.92). The performance of the ACEF-QFR scoring system was preliminarily evaluated in the developmental dataset, and then further explored in the validation dataset. The ACEF-QFR score showed superior discrimination(C-statistic = 0.651;95% CI: 0.611-0.691, P < 0.05 versus post-PCI physiological index and other commonly used risk scores) and excellent calibration(Hosmer–Lemeshow χ^(2)= 7.070;P = 0.529) for predicting 2-year patient-oriented composite endpoint(POCE). The good prognostic value of the ACEF-QFR score was further validated by multivariable Cox regression and Kaplan–Meier analysis(adjusted HR = 1.89;95% CI: 1.18–3.04;log-rank P < 0.01) after stratified the patients into high-risk group and low-risk group.CONCLUSIONS An improved scoring system combining clinical and coronary lesion-based functional variables(ACEF-QFR)was developed, and its ability for prognostic prediction in patients with PCI was further validated to be significantly better than the post-PCI physiological index and other commonly used risk scores.

A deep multimodal fusion and multitasking trajectory prediction model for typhoon trajectory prediction to reduce flight scheduling cancellation

Natural events have had a significant impact on overall flight activity,and the aviation industry plays a vital role in helping society cope with the impact of these events.As one of the most impactful weather typhoon seasons appears and continues,airlines operating in threatened areas and passengers having travel plans during this time period will pay close attention to the development of tropical storms.This paper proposes a deep multimodal fusion and multitasking trajectory prediction model that can improve the reliability of typhoon trajectory prediction and reduce the quantity of flight scheduling cancellation.The deep multimodal fusion module is formed by deep fusion of the feature output by multiple submodal fusion modules,and the multitask generation module uses longitude and latitude as two related tasks for simultaneous prediction.With more dependable data accuracy,problems can be analysed rapidly and more efficiently,enabling better decision-making with a proactive versus reactive posture.When multiple modalities coexist,features can be extracted from them simultaneously to supplement each other’s information.An actual case study,the typhoon Lichma that swept China in 2019,has demonstrated that the algorithm can effectively reduce the number of unnecessary flight cancellations compared to existing flight scheduling and assist the new generation of flight scheduling systems under extreme weather.

A HEVC Video Steganalysis Method Using the Optimality of Motion Vector Prediction

Among steganalysis techniques,detection against MV(motion vector)domain-based video steganography in the HEVC(High Efficiency Video Coding)standard remains a challenging issue.For the purpose of improving the detection performance,this paper proposes a steganalysis method that can perfectly detectMV-based steganography in HEVC.Firstly,we define the local optimality of MVP(Motion Vector Prediction)based on the technology of AMVP(Advanced Motion Vector Prediction).Secondly,we analyze that in HEVC video,message embedding either usingMVP index orMVD(Motion Vector Difference)may destroy the above optimality of MVP.And then,we define the optimal rate of MVP as a steganalysis feature.Finally,we conduct steganalysis detection experiments on two general datasets for three popular steganographymethods and compare the performance with four state-ofthe-art steganalysis methods.The experimental results demonstrate the effectiveness of the proposed feature set.Furthermore,our method stands out for its practical applicability,requiring no model training and exhibiting low computational complexity,making it a viable solution for real-world scenarios.

Advancing Malaria Prediction in Uganda through AI and Geospatial Analysis Models

The resurgence of locally acquired malaria cases in the USA and the persistent global challenge of malaria transmission highlight the urgent need for research to prevent this disease. Despite significant eradication efforts, malaria remains a serious threat, particularly in regions like Africa. This study explores how integrating Gregor’s Type IV theory with Geographic Information Systems (GIS) improves our understanding of disease dynamics, especially Malaria transmission patterns in Uganda. By combining data-driven algorithms, artificial intelligence, and geospatial analysis, the research aims to determine the most reliable predictors of Malaria incident rates and assess the impact of different factors on transmission. Using diverse predictive modeling techniques including Linear Regression, K-Nearest Neighbor, Neural Network, and Random Forest, the study found that;Random Forest model outperformed the others, demonstrating superior predictive accuracy with an R2 of approximately 0.88 and a Mean Squared Error (MSE) of 0.0534, Antimalarial treatment was identified as the most influential factor, with mosquito net access associated with a significant reduction in incident rates, while higher temperatures correlated with increased rates. Our study concluded that the Random Forest model was effective in predicting malaria incident rates in Uganda and highlighted the significance of climate factors and preventive measures such as mosquito nets and antimalarial drugs. We recommended that districts with malaria hotspots lacking Indoor Residual Spraying (IRS) coverage prioritize its implementation to mitigate incident rates, while those with high malaria rates in 2020 require immediate attention. By advocating for the use of appropriate predictive models, our research emphasized the importance of evidence-based decision-making in malaria control strategies, aiming to reduce transmission rates and save lives.

Development,validation,and transportability of several machine-learned,non-exercise-based VO_(2max)prediction models for older adults

Background:There exist few maximal oxygen uptake(VO_(2max))non-exercise-based prediction equations,fewer using machine learning(ML),and none specifically for older adults.Since direct measurement of VO_(2max)is infeasible in large epidemiologic cohort studies,we sought to develop,validate,compare,and assess the transportability of several ML VO_(2max)prediction algorithms.Methods:The Baltimore Longitudinal Study of Aging(BLSA)participants with valid VO2_(max)tests were included(n=1080).Least absolute shrinkage and selection operator,linear-and tree-boosted extreme gradient boosting,random forest,and support vector machine(SVM)algorithms were trained to predict VO_(2max)values.We developed these algorithms for:(a)the overall BLSA,(b)by sex,(c)using all BLSA variables,and(d)variables common in aging cohorts.Finally,we quantified the associations between measured and predicted VO_(2max)and mortality.Results:The age was 69.0±10.4 years(mean±SD)and the measured VO_(2max)was 21.6±5.9 mL/kg/min.Least absolute shrinkage and selection operator,linear-and tree-boosted extreme gradient boosting,random forest,and support vector machine yielded root mean squared errors of 3.4 mL/kg/min,3.6 mL/kg/min,3.4 mL/kg/min,3.6 mL/kg/min,and 3.5 mL/kg/min,respectively.Incremental quartiles of measured VO_(2max)showed an inverse gradient in mortality risk.Predicted VO_(2max)variables yielded similar effect estimates but were not robust to adjustment.Conclusion:Measured VO_(2max)is a strong predictor of mortality.Using ML can improve the accuracy of prediction as compared to simpler approaches but estimates of association with mortality remain sensitive to adjustment.Future studies should seek to reproduce these results so that VO_(2max),an important vital sign,can be more broadly studied as a modifiable target for promoting functional resiliency and healthy aging.

Privacy-Preserving Federated Mobility Prediction with Compound Data and Model Perturbation Mechanism

Human mobility prediction is important for many applications.However,training an accurate mobility prediction model requires a large scale of human trajectories,where privacy issues become an important problem.The rising federated learning provides us with a promising solution to this problem,which enables mobile devices to collaboratively learn a shared prediction model while keeping all the training data on the device,decoupling the ability to do machine learning from the need to store the data in the cloud.However,existing federated learningbased methods either do not provide privacy guarantees or have vulnerability in terms of privacy leakage.In this paper,we combine the techniques of data perturbation and model perturbation mechanisms and propose a privacy-preserving mobility prediction algorithm,where we add noise to the transmitted model and the raw data collaboratively to protect user privacy and keep the mobility prediction performance.Extensive experimental results show that our proposed method significantly outperforms the existing stateof-the-art mobility prediction method in terms of defensive performance against practical attacks while having comparable mobility prediction performance,demonstrating its effectiveness.

Two-Way Neural Network Performance PredictionModel Based onKnowledge Evolution and Individual Similarity

Predicting students’academic achievements is an essential issue in education,which can benefit many stakeholders,for instance,students,teachers,managers,etc.Compared with online courses such asMOOCs,students’academicrelateddata in the face-to-face physical teaching environment is usually sparsity,and the sample size is relativelysmall.It makes building models to predict students’performance accurately in such an environment even morechallenging.This paper proposes a Two-WayNeuralNetwork(TWNN)model based on the bidirectional recurrentneural network and graph neural network to predict students’next semester’s course performance using only theirprevious course achievements.Extensive experiments on a real dataset show that our model performs better thanthe baselines in many indicators.

Carbon Emission Factors Prediction of Power Grid by Using Graph Attention Network

Advanced carbon emission factors of a power grid can provide users with effective carbon reduction advice,which is of immense importance in mobilizing the entire society to reduce carbon emissions.The method of calculating node carbon emission factors based on the carbon emissions flow theory requires real-time parameters of a power grid.Therefore,it cannot provide carbon factor information beforehand.To address this issue,a prediction model based on the graph attention network is proposed.The model uses a graph structure that is suitable for the topology of the power grid and designs a supervised network using the loads of the grid nodes and the corresponding carbon factor data.The network extracts features and transmits information more suitable for the power system and can flexibly adjust the equivalent topology,thereby increasing the diversity of the structure.Its input and output data are simple,without the power grid parameters.We demonstrated its effect by testing IEEE-39 bus and IEEE-118 bus systems with average error rates of 2.46%and 2.51%.

Classifying rockburst with confidence:A novel conformal prediction approach

The scientific community recognizes the seriousness of rockbursts and the need for effective mitigation measures.The literature reports various successful applications of machine learning(ML)models for rockburst assessment;however,a significant question remains unanswered:How reliable are these models,and at what confidence level are classifications made?Typically,ML models output single rockburst grade even in the face of intricate and out-of-distribution samples,without any associated confidence value.Given the susceptibility of ML models to errors,it becomes imperative to quantify their uncertainty to prevent consequential failures.To address this issue,we propose a conformal prediction(CP)framework built on traditional ML models(extreme gradient boosting and random forest)to generate valid classifications of rockburst while producing a measure of confidence for its output.The proposed framework guarantees marginal coverage and,in most cases,conditional coverage on the test dataset.The CP was evaluated on a rockburst case in the Sanshandao Gold Mine in China,where it achieved high coverage and efficiency at applicable confidence levels.Significantly,the CP identified several“confident”classifications from the traditional ML model as unreliable,necessitating expert verification for informed decision-making.The proposed framework improves the reliability and accuracy of rockburst assessments,with the potential to bolster user confidence.

ASLP-DL—A Novel Approach Employing Lightweight Deep Learning Framework for Optimizing Accident Severity Level Prediction

Highway safety researchers focus on crash injury severity,utilizing deep learning—specifically,deep neural networks(DNN),deep convolutional neural networks(D-CNN),and deep recurrent neural networks(D-RNN)—as the preferred method for modeling accident severity.Deep learning’s strength lies in handling intricate relation-ships within extensive datasets,making it popular for accident severity level(ASL)prediction and classification.Despite prior success,there is a need for an efficient system recognizing ASL in diverse road conditions.To address this,we present an innovative Accident Severity Level Prediction Deep Learning(ASLP-DL)framework,incorporating DNN,D-CNN,and D-RNN models fine-tuned through iterative hyperparameter selection with Stochastic Gradient Descent.The framework optimizes hidden layers and integrates data augmentation,Gaussian noise,and dropout regularization for improved generalization.Sensitivity and factor contribution analyses identify influential predictors.Evaluated on three diverse crash record databases—NCDB 2018–2019,UK 2015–2020,and US 2016–2021—the D-RNN model excels with an ACC score of 89.0281%,a Roc Area of 0.751,an F-estimate of 0.941,and a Kappa score of 0.0629 over the NCDB dataset.The proposed framework consistently outperforms traditional methods,existing machine learning,and deep learning techniques.

Deep Learning Shows Promise for Seasonal Prediction of Antarctic Sea Ice in a Rapid Decline Scenario

The rapidly changing Antarctic sea ice has garnered significant interest. To enhance the prediction skill for sea ice and respond to the Sea Ice Prediction Network-South's latest call, this study presents the reforecast results of Antarctic sea-ice area and extent from December to June of the coming year with a Convolutional Long Short-Term Memory(Conv LSTM)Network. The reforecast experiments demonstrate that Conv LSTM captures the interannual and interseasonal variability of Antarctic sea ice successfully, and performs better than the European Centre for Medium-Range Weather Forecasts. Based on this, we present the prediction from December 2023 to June 2024, indicating that the Antarctic sea ice will remain at lows, but may not create a new record low. This research highlights the promising application of deep learning in Antarctic sea-ice prediction.