Multivariate adaptive regression splines and neural network models for prediction of pile drivability

Piles are long, slender structural elements used to transfer the loads from the superstructure through weak strata onto stiffer soils or rocks. For driven piles, the impact of the piling hammer induces compression and tension stresses in the piles. Hence, an important design consideration is to check that the strength of the pile is sufficient to resist the stresses caused by the impact of the pile hammer. Due to its complexity, pile drivability lacks a precise analytical solution with regard to the phenomena involved.In situations where measured data or numerical hypothetical results are available, neural networks stand out in mapping the nonlinear interactions and relationships between the system’s predictors and dependent responses. In addition, unlike most computational tools, no mathematical relationship assumption between the dependent and independent variables has to be made. Nevertheless, neural networks have been criticized for their long trial-and-error training process since the optimal configuration is not known a priori. This paper investigates the use of a fairly simple nonparametric regression algorithm known as multivariate adaptive regression splines（MARS）, as an alternative to neural networks, to approximate the relationship between the inputs and dependent response, and to mathematically interpret the relationship between the various parameters. In this paper, the Back propagation neural network（BPNN） and MARS models are developed for assessing pile drivability in relation to the prediction of the Maximum compressive stresses（MCS）, Maximum tensile stresses（MTS）, and Blow per foot（BPF）. A database of more than four thousand piles is utilized for model development and comparative performance between BPNN and MARS predictions.

Advanced reliability analysis of slopes in spatially variable soils using multivariate adaptive regression splines

This study aims to extend the multivariate adaptive regression splines(MARS)-Monte Carlo simulation(MCS) method for reliability analysis of slopes in spatially variable soils. This approach is used to explore the influences of the multiscale spatial variability of soil properties on the probability of failure(P_f) of the slopes. In the proposed approach, the relationship between the factor of safety and the soil strength parameters characterized with spatial variability is approximated by the MARS, with the aid of Karhunen-Loeve expansion. MCS is subsequently performed on the established MARS model to evaluate Pf.Finally, a nominally homogeneous cohesive-frictional slope and a heterogeneous cohesive slope, which are both characterized with different spatial variabilities, are utilized to illustrate the proposed approach.Results showed that the proposed approach can estimate the P_f of the slopes efficiently in spatially variable soils with sufficient accuracy. Moreover, the approach is relatively robust to the influence of different statistics of soil properties, thereby making it an effective and practical tool for addressing slope reliability problems concerning time-consuming deterministic stability models with low levels of P_f.Furthermore, disregarding the multiscale spatial variability of soil properties can overestimate or underestimate the P_f. Although the difference is small in general, the multiscale spatial variability of the soil properties must still be considered in the reliability analysis of heterogeneous slopes, especially for those highly related to cost effective and accurate designs.

Using multivariate adaptive regression splines to develop relationship between rock quality designation and permeability

The assessment of in situ permeability of rock mass is challenging for large-scale projects such as reservoirs created by dams,where water tightness issues are of prime importance.The in situ permeability is strongly related to the frequency and distribution of discontinuities in the rock mass and quantified by rock quality designation(RQD).This paper analyzes the data of hydraulic conductivity and discontinuities sampled at different depths during the borehole investigations in the limestone and sandstone formations for the construction of hydraulic structures in Oman.Cores recovered from boreholes provide RQD data,and in situ Lugeon tests elucidate the permeability.A modern technique of multivariate adaptive regression splines(MARS)assisted in correlating permeability and RQD along with the depth.In situ permeability shows a declining trend with increasing RQD,and the depth of investigation is within 50 m.This type of relationship can be developed based on detailed initial investigations at the site where the hydraulic conductivity of discontinuous rocks is required to be delineated.The relationship can approximate the permeability by only measuring the RQD in later investigations on the same site,thus saving the time and cost of the site investigations.The applicability of the relationship developed in this study to another location requires a lithological similarity of the rock mass that can be verified through preliminary investigation at the site.

Multivariate adaptive regression splines based simulation optimization using move-limit strategy

This paper makes an approach to the approximate optimum in structural design,which combines the global response surface（GRS） based multivariate adaptive regression splines（MARS） with Move-Limit strategy（MLS）.MARS is an adaptive regression process,which fits in with the multidimensional problems.It adopts a modified recursive partitioning strategy to simplify high-dimensional problems into smaller highly accurate models.MLS for moving and resizing the search sub-regions is employed in the space of design variables.The quality of the approximation functions and the convergence history of the optimization process are reflected in MLS.The disadvantages of the conventional response surface method（RSM） have been avoided,specifically,highly nonlinear high-dimensional problems.The GRS/MARS with MLS is applied to a high-dimensional test function and an engineering problem to demonstrate its feasibility and convergence,and compared with quadratic response surface（QRS） models in terms of computational efficiency and accuracy.

Mountain permafrost distribution modeling using Multivariate Adaptive Regression Spline (MARS) in the Wenquan area over the Qinghai-Tibet Plateau

In high mountainous areas, the development and distribution of alpine permafrost is greatly affected by macro- and mi- cro-topographic factors. The effects of latitude, altitude, slope, and aspect on the distribution of permafrost were studied to under- stand the dislribution patterns of permafrost in Wenquan on the Qinghai-Tibet Plateau. Cluster and correlation analysis were per- formed based on 30 m Global Digital Elevation Model （GDEM） data and field data obtained using geophysical exploration and borehole drilling methods. A Multivariate Adaptive Regression Spline model （MARS） was developed to simulate permafrost spa- tial distribution over the studied area. A validation was followed by comparing to 201 geophysical exploration sites, as well as by comparing to two other models, i.e., a binary logistic regression model and the Mean Annual Ground Temperature model （IVlAGT）. The MARS model provides a better simulation than the other two models. Besides the control effect of elevation on permafrost distribution, the MARS model also takes into account the impact of direct solar radiation on permafrost distribution.

Physics-based and data-driven modeling for stability evaluation of buried structures in natural clays

This study presents a hybrid framework to predict stability solutions of buried structures under active trapdoor conditions in natural clays with anisotropy and heterogeneity by combining physics-based and data-driven modeling.Finite-element limit analysis(FELA)with a newly developed anisotropic undrained shear(AUS)failure criterion is used to identify the underlying active failure mechanisms as well as to develop a numerical(physics-based)database of stability numbers for both planar and circular trapdoors.Practical considerations are given for natural clays to three linearly increasing shear strengths in compression,extension,and direct simple shear in the AUS material model.The obtained numerical solutions are compared and validated with published solutions in the literature.A multivariate adaptive regression splines(MARS)algorithm is further utilized to learn the numerical solutions to act as fast FELA data-driven surrogates for stability evaluation.The current MARS-based modeling provides both relative importance index and accurate design equations that can be used with confidence by practitioners.

Simulation of Daily Diffuse Solar Radiation Based on Three Machine Learning Models

Solar radiation is an important parameter in the fields of computer modeling,engineering technology and energy development.This paper evaluated the ability of three machine learning models,i.e.,Extreme Gradient Boosting(XGBoost),Support Vector Machine(SVM)and Multivariate Adaptive Regression Splines(MARS),to estimate the daily diffuse solar radiation(Rd).The regular meteorological data of 1966-2015 at five stations in China were taken as the input parameters(including mean average temperature(Ta),theoretical sunshine duration(N),actual sunshine duration(n),daily average air relative humidity(RH),and extra-terrestrial solar radiation(Ra)).And their estimation accuracies were subjected to comparative analysis.The three models were first trained using meteorological data from 1966 to 2000.Then,the 2001-2015 data was used to test the trained machine learning model.The results show that the XGBoost had better accuracy than the other two models in coefficient of determination(R2),root mean square error(RMSE),mean bias error(MBE)and normalized root mean square error(NRMSE).The MARS performed better in the training phase than the testing phase,but became less accurate in the testing phase,with the R2 value falling by 2.7-16.9%on average.By contrast,the R2 values of SVM and XGBoost increased by 2.9-12.2%and 1.9-14.3%,respectively.Despite trailing slightly behind the SVM at the Beijing station,the XGBoost showed good performance at the rest of the stations in the two phases.In the training phase,the accuracy growth is small but observable.In addition,the XGBoost had a slightly lower RMSE than the SVM,a signal of its edge in stability.Therefore,the three machine learning models can estimate the daily Rd based on local inputs and the XGBoost stands out for its excellent performance and stability.

Data-driven intelligent modeling framework for the steam cracking process

Steam cracking is the dominant technology for producing light olefins,which are believed to be the foundation of the chemical industry.Predictive models of the cracking process can boost production efficiency and profit margin.Rapid advancements in machine learning research have recently enabled data-driven solutions to usher in a new era of process modeling.Meanwhile,its practical application to steam cracking is still hindered by the trade-off between prediction accuracy and computational speed.This research presents a framework for data-driven intelligent modeling of the steam cracking process.Industrial data preparation and feature engineering techniques provide computational-ready datasets for the framework,and feedstock similarities are exploited using k-means clustering.We propose LArge-Residuals-Deletion Multivariate Adaptive Regression Spline(LARD-MARS),a modeling approach that explicitly generates output formulas and eliminates potentially outlying instances.The framework is validated further by the presentation of clustering results,the explanation of variable importance,and the testing and comparison of model performance.

ANALYSIS OF BENDING, VIBRATION AND STABILITY FOR THIN PLATE ON ELASTIC FOUNDATION BY THE MULTIVARIABLE SPLINE ELEMENT METHOD

In this paper, the bicubic splines in product form are used to construct the multi-field functions for bending moments, twisting moment and transverse displacement of the plate on elastic foundation. The multivariable spline element equations are derived, based on the mixed variational principle. The analysis and calculations of bending, vibration and stability of the plates on elastic foundation are presented in the paper. Because the field functions of plate on elastic foundation are assumed independently, the precision of the field variables of bending moments and displacement is high.

Some extremal properties of multivariate polynomial splines in the metric L_p(R^d)

We constructed a kind of continuous multivariate spline operators as the approximation tools of the multivariate functions on the Rd instead of the usual multivariate cardinal interpolation oper-ators of splines, and obtained the approximation error by this kind of spline operators. Meantime, by the results, we also obtained that the spaces of multivariate polynomial splines are weakly asymptoti-cally optimal for the Kolmogorov widths and the linear widths of some anlsotropic Sobolev classes of smooth functions on Rd in the metric Lp(Rd).

Downscaling Landsat-8 land surface temperature maps in diverse urban landscapes using multivariate adaptive regression splines and very high resolution auxiliary data

We propose a method for spatial downscaling of Landsat 8-derived LST maps from 100(30 m)resolution down to 2–4 m with the use of the Multiple Adaptive Regression Splines(MARS)models coupled with very high resolution auxiliary data derived from hyperspectral aerial imagery and large-scale topographic maps.We applied the method to four Landsat 8 scenes,two collected in summer and two in winter,for three British towns collectively representing a variety of urban form.We used several spectral indices as well as fractional coverage of water and paved surfaces as LST predictors,and applied a novel method for the correction of temporal mismatch between spectral indices derived from aerial and satellite imagery captured at different dates,allowing for the application of the downscaling method for multiple dates without the need for repeating the aerial survey.Our results suggest that the method performed well for the summer dates,achieving RMSE of 1.40–1.83 K prior to and 0.76–1.21 K after correction for residuals.We conclude that the MARS models,by addressing the non-linear relationship of LST at coarse and fine spatial resolutions,can be successfully applied to produce high resolution LST maps suitable for studies of urban thermal environment at local scales.

A nonparametric regression method for multiple longitudinal phenotypes using multivariate adaptive splines

In genetic studies of complex diseases, particularly mental illnesses, and behavior disorders, two distinct characteristics have emerged in some data sets. First, genetic data sets are collected with a large number of phenotypes that are potentially related to the complex disease under study. Second, each phenotype is collected from the same subject repeatedly over time. In this study, we present a nonparametric regression approach to study multivariate and time-repeated phenotypes together by using the technique of the multivariate adaptive regression splines for analysis of longitudinal data （MASAL）, which makes it possible to identify genes, gene-gene and gene-environment, including time, interactions associated with the phenotypes of interest. Furthermore, we propose a permutation test to assess the associations between the phenotypes and selected markers. Through simulation, we demonstrate that our proposed approach has advantages over the existing methods that examine each longitudinal phenotype separately or analyze the summarized values of phenotypes by compressing them into one-time-point phenotypes. Application of the proposed method to the Framingham Heart Study illustrates that the use of multivariate longitudinal phenotypes enhanced the significance of the association test.

Integrating the artificial intelligence and hybrid machine learning algorithms for improving the accuracy of spatial prediction of landslide hazards in Kurseong Himalayan Region

The aim of the current work is to compare susceptibility maps of landslides produced using machine learning techniques i.e.multilayer perception neural nets(MLP),kernel logistic regression(KLR),random forest(RF),and multivariate adaptive regression splines(MARS);novel ensemble approaches i.e.MLP-Bagging,KLR-Bagging,RFBagging and MARS-Bagging in the Kurseong-Himalayan region.For the ensemble models the RF,KLR,MLP and MARS were used as base classifiers,and Bagging was used as meta classifier.Another objective of the current work is to introduce and evaluate the effectiveness of the novel KLR-Bagging and MARS-Bagging ensembles in susceptibility to landslide.Compiling 303 landslide locations to calibrate and test the models,an inventory map was created.Eighteen LCFs were chosen using the Relief-F and multi-collinearity tests for mapping the landslide susceptibility.Applying receiver operating characteristic(ROC),precision,accuracy,incorrectly categorized proportion,mean-absolute-error(MAE),and root-mean-square-error(RMSE),the LSMs were subsequently verified.The different validation results showed RF-Bagging(AUC training 88.69%&testing 92.28%)with ensemble Meta classifier gives better performance than the MLP,KLR,RF,MARS,MLP-Bagging,KLR-Bagging,and MARSBagging based LSMs.RF model showed that the slope,altitude,rainfall,and geomorphology played the most vital role in landslide occurrence comparing the other LCFs.These results will help to reduce the losses caused by the landslides in the Kurseong and in other areas where geo-environmental and geological conditions more or less similar.

Prediction of interfaces of geological formations using the multivariate adaptive regression spline method

The design and construction of underground structures are significantly affected by the distribution of geological formations.Prediction of the geological interfaces using limited data has been a difficult task.A multivariate adaptive regression spline(MARS)method capable of modeling nonlinearities automatically was used in this study to spatially predict the elevations of geological interfaces.Borehole data from two sites in Singapore were used to evaluate the capability of the MARS method for predicting geological interfaces.By comparing the predicted values with the borehole data,it is shown that the MARS method has a mean of root mean square error of 4.4 m for the predicted elevations of the Kallang Formation–Old Alluvium interface.In addition,the MARS method is able to produce reasonable prediction intervals in the sense that the percentage of testing data covered by 95% prediction intervals was close to the associated confidence level,95%.More importantly,the prediction interval evaluated by the MARS method had a non-constant width that appropriately reflected the data density and geological complexity.

Rectangular tunnel heading stability in three dimensions and its predictive machine learning models

Tunnel heading stability in two dimensions(2D)has been extensively investigated by numerous scholars in the past decade.One significant limitation of 2D analysis is the absence of actual tunnel geometry modeling with a considerable degree of idealization.Nevertheless,it is possible to study the stability of tunnels in three dimensions(3D)with a rectangular shape using finite element limit analysis(FELA)and a nonlinear programming technique.This paper employs 3D FELA to generate rigorous solutions for stability numbers,failure mechanisms,and safety factors for rectangular-shaped tunnels.To further explore the usefulness of the produced results,multivariate adaptive regression spline(MARS)is used for machine learning of big dataset and development of design equations for practical design applications.The study should be of great benefit to tunnel design practices using the developed equations provided in the paper.

Bivariate Splines and Golden Section Based on Theory of Elasticity

Splines are important in both mathematics and mechanics. We investigate the relationships between bivariate splines and mechanics in this paper. The mechanical meanings of some univariate splines were viewed based on the analysis of bending beams. For the 2D case, the relationships between a class of quintic bivariate splines with smoothness 3 and bending of thin plates are presented constructively. Furthermore, the variational property of bivariate splines and golden section in splines are also discussed.

PIECEWISE SEMIALGEBRAIC SETS

Semialgebraic sets are objects which are truly a special feature of real algebraic geometry. This paper presents the piecewise semialgebraic set, which is the subset of Rn satisfying a boolean combination of multivariate spline equations and inequalities with real coefficients. Moreover, the stability under projection and the dimension of C^μ piecewise semialgebraic sets are also discussed.

The Irreducibility and Isomorphism of Piecewise Algebraic Sets

In this paper , we define the piecewise algebraic sets by using multivariatespline functions and discuss their irreducibility and isomorphism problem. We presenttwo equivalent conditions for the irreducibility of piecewise algebraic sets, and turn theisomorphism and classifying problem of piecewise algebraic sets into the isonorphismand classifying problem of commutative algebras.

Multi-dimensional versions of a formula of Popoviciu

In this paper, an explicit formulation for multivariate truncated power functions of degree one is given firstly. Based on multivariate truncated power functions of degree one, a formulation is presented which counts the number of non-negative integer solutions of s×(s + 1) linear Diophantine equations and it can be considered as a multi-dimensional versions of the formula counting the number of non-negative integer solutions of ax + by = n which is given by Popoviciu in 1953.

Algebra-Geometry of Piecewise Algebraic Varieties

Algebraic variety is the most important subject in classical algebraic geometry. As the zero set of multivariate splines, the piecewise algebraic variety is a kind generalization of the classical algebraic variety. This paper studies the correspondence between spline ideals and piecewise algebraic varieties based on the knowledge of algebraic geometry and multivariate splines.