Survey on Deep Learning Approaches for Detection of Email Security Threat

Emailing is among the cheapest and most easily accessible platforms,and covers every idea of the present century like banking,personal login database,academic information,invitation,marketing,advertisement,social engineering,model creation on cyber-based technologies,etc.The uncontrolled development and easy access to the internet are the reasons for the increased insecurity in email communication.Therefore,this review paper aims to investigate deep learning approaches for detecting the threats associated with e-mail security.This study compiles the literature related to the deep learning methodologies,which are applicable for providing safety in the field of cyber security of email in different organizations.Relevant data were extracted from different research depositories.The paper discusses various solutions for handling these threats.Different challenges and issues are also investigated for e-mail security threats including social engineering,malware,spam,and phishing in the existing solutions to identify the core current problem and set the road for future studies.The review analysis showed that communication media is the common platform for attackers to conduct fraudulent activities via spoofed e-mails and fake websites and this research has combined the merit and demerits of the deep learning approaches adaption in email security threat by the usage of models and technologies.The study highlighted the contrasts of deep learning approaches in detecting email security threats.This review study has set criteria to include studies that deal with at least one of the six machine models in cyber security.

Soliton, breather, and rogue wave solutions for solving the nonlinear Schrodinger equation using a deep learning method with physical constraints

The nonlinear Schrodinger equation is a classical integrable equation which contains plenty of significant properties and occurs in many physical areas.However,due to the difficulty of solving this equation,in particular in high dimensions,lots of methods are proposed to effectively obtain different kinds of solutions,such as neural networks among others.Recently,a method where some underlying physical laws are embeded into a conventional neural network is proposed to uncover the equation’s dynamical behaviors from spatiotemporal data directly.Compared with traditional neural networks,this method can obtain remarkably accurate solution with extraordinarily less data.Meanwhile,this method also provides a better physical explanation and generalization.In this paper,based on the above method,we present an improved deep learning method to recover the soliton solutions,breather solution,and rogue wave solutions of the nonlinear Schrodinger equation.In particular,the dynamical behaviors and error analysis about the one-order and two-order rogue waves of nonlinear integrable equations are revealed by the deep neural network with physical constraints for the first time.Moreover,the effects of different numbers of initial points sampled,collocation points sampled,network layers,neurons per hidden layer on the one-order rogue wave dynamics of this equation have been considered with the help of the control variable way under the same initial and boundary conditions.Numerical experiments show that the dynamical behaviors of soliton solutions,breather solution,and rogue wave solutions of the integrable nonlinear Schrodinger equation can be well reconstructed by utilizing this physically-constrained deep learning method.

LexDeep:Hybrid Lexicon and Deep Learning Sentiment Analysis Using Twitter for Unemployment-Related Discussions During COVID-19

The COVID-19 pandemic has spread globally,resulting in financialinstability in many countries and reductions in the per capita grossdomestic product.Sentiment analysis is a cost-effective method for acquiringsentiments based on household income loss,as expressed on social media.However,limited research has been conducted in this domain using theLexDeep approach.This study aimed to explore social trend analytics usingLexDeep,which is a hybrid sentiment analysis technique,on Twitter to capturethe risk of household income loss during the COVID-19 pandemic.First,tweet data were collected using Twint with relevant keywords before(9 March2019 to 17 March 2020)and during(18 March 2020 to 21 August 2021)thepandemic.Subsequently,the tweets were annotated using VADER(lexiconbased)and fed into deep learning classifiers,and experiments were conductedusing several embeddings,namely simple embedding,Global Vectors,andWord2Vec,to classify the sentiments expressed in the tweets.The performanceof each LexDeep model was evaluated and compared with that of a supportvector machine(SVM).Finally,the unemployment rates before and duringCOVID-19 were analysed to gain insights into the differences in unemploymentpercentages through social media input and analysis.The resultsdemonstrated that all LexDeep models with simple embedding outperformedthe SVM.This confirmed the superiority of the proposed LexDeep modelover a classical machine learning classifier in performing sentiment analysistasks for domain-specific sentiments.In terms of the risk of income loss,the unemployment issue is highly politicised on both the regional and globalscales;thus,if a country cannot combat this issue,the global economy will alsobe affected.Future research should develop a utility maximisation algorithmfor household welfare evaluation,given the percentage risk of income lossowing to COVID-19.

Deep Learning Applied to Computational Mechanics:A Comprehensive Review,State of the Art,and the Classics

Three recent breakthroughs due to AI in arts and science serve as motivation:An award winning digital image,protein folding,fast matrix multiplication.Many recent developments in artificial neural networks,particularly deep learning(DL),applied and relevant to computational mechanics(solid,fluids,finite-element technology)are reviewed in detail.Both hybrid and pure machine learning(ML)methods are discussed.Hybrid methods combine traditional PDE discretizations with ML methods either(1)to help model complex nonlinear constitutive relations,(2)to nonlinearly reduce the model order for efficient simulation(turbulence),or(3)to accelerate the simulation by predicting certain components in the traditional integration methods.Here,methods(1)and(2)relied on Long-Short-Term Memory(LSTM)architecture,with method(3)relying on convolutional neural networks.Pure ML methods to solve(nonlinear)PDEs are represented by Physics-Informed Neural network(PINN)methods,which could be combined with attention mechanism to address discontinuous solutions.Both LSTM and attention architectures,together with modern and generalized classic optimizers to include stochasticity for DL networks,are extensively reviewed.Kernel machines,including Gaussian processes,are provided to sufficient depth for more advanced works such as shallow networks with infinite width.Not only addressing experts,readers are assumed familiar with computational mechanics,but not with DL,whose concepts and applications are built up from the basics,aiming at bringing first-time learners quickly to the forefront of research.History and limitations of AI are recounted and discussed,with particular attention at pointing out misstatements or misconceptions of the classics,even in well-known references.Positioning and pointing control of a large-deformable beam is given as an example.

Efficient People Detection with Infrared Images

This work focuses on the problem of monitoring the coastline, which in Portugal’s case means monitoring 3007 kilometers, including 1793 maritime borders with the Atlantic Ocean to the south and west. The human burden on the coast becomes a problem, both because erosion makes the cliffs unstable and because pollution increases, making the fragile dune ecosystem difficult to preserve. It is becoming necessary to increase the control of access to beaches, even if it is not a popular measure for internal and external tourism. The methodology described can also be used to monitor maritime borders. The use of images acquired in the infrared range guarantees active surveillance both day and night, the main objective being to mimic the infrared cameras already installed in some critical areas along the coastline. Using a series of infrared photographs taken at low angles with a modified camera and appropriate filter, a recent deep learning algorithm with the right training can simultaneously detect and count whole people at close range and people almost completely submerged in the water, including partially visible targets, achieving a performance with F1 score of 0.945, with 97% of targets correctly identified. This implementation is possible with ordinary laptop computers and could contribute to more frequent and more extensive coverage in beach/border surveillance, using infrared cameras at regular intervals. It can be partially automated to send alerts to the authorities and/or the nearest lifeguards, thus increasing monitoring without relying on human resources.

A deep learning method for solving high-order nonlinear soliton equations

We propose an effective scheme of the deep learning method for high-order nonlinear soliton equations and explore the influence of activation functions on the calculation results for higherorder nonlinear soliton equations. The physics-informed neural networks approximate the solution of the equation under the conditions of differential operator, initial condition and boundary condition. We apply this method to high-order nonlinear soliton equations, and verify its efficiency by solving the fourth-order Boussinesq equation and the fifth-order Korteweg–de Vries equation. The results show that the deep learning method can be used to solve high-order nonlinear soliton equations and reveal the interaction between solitons.

Number of Solitons Emerged in the Initial Profile of Shallow Water Using Convolutional Neural Networks

The soliton resolution conjecture proposes that the initial value problem can evolve into a dispersion part and a soliton part.However,the problem of determining the number of solitons that form in a given initial profile remains unsolved,except for a few specific cases.In this paper,the authors use the deep learning method to predict the number of solitons in a given initial value of the Korteweg-de Vries(KdV)equation.By leveraging the analytical relationship between Asech^(2)(x)initial values and the number of solitons,the authors train a Convolutional Neural Network(CNN)that can accurately identify the soliton count from spatio-temporal data.The trained neural network is capable of predicting the number of solitons with other given initial values without any additional assistance.Through extensive calculations,the authors demonstrate the effectiveness and high performance of the proposed method.

Intelligent algorithms: new avenues for designing nanophotonic devices [Invited]

The research on nanophotonic devices has made great progress during the past decades. It is the unremitting pursuit of researchers that realize various device functions to meet practical applications. However, most of the traditional methods rely on human experience and physical inspiration for structural design and parameter optimization, which usually require a lot of resources, and the performance of the designed device is limited. Intelligent algorithms, which are composed of rich optimized algorithms, show a vigorous development trend in the field of nanophotonic devices in recent years. The design of nanophotonic devices by intelligent algorithms can break the restrictions of traditional methods and predict novel configurations, which is universal and efficient for different materials, different structures, different modes, different wavelengths, etc. In this review, intelligent algorithms for designing nanophotonic devices are introduced from their concepts to their applications, including deep learning methods, the gradient-based inverse design method, swarm intelligence algorithms, individual inspired algorithms, and some other algorithms. The design principle based on intelligent algorithms and the design of typical new nanophotonic devices are reviewed. Intelligent algorithms can play an important role in designing complex functions and improving the performances of nanophotonic devices, which provide new avenues for the realization of photonic chips.

A Variational Neural Network Approach for Glacier Modelling with Nonlinear Rheology

We propose a mesh-free method to solve the full Stokes equation for modeling the glacier dynamics with nonlinear rheology.Inspired by the Deep-Ritz method proposed in[13],we first formulate the solution to the non-Newtonian Stokes equation as the minimizer of a variational problem with boundary constraints.Then,we approximate its solution space by a deep neural network.The loss function for training the neural network is a relaxed version of the variational form,in which penalty terms are used to present soft constraints due to mixed boundary conditions.Instead of introducing mesh grids or basis functions to evaluate the loss function,our method only requires uniform sampling from the physical domain and boundaries.Furthermore,we introduce a re-normalization technique in the neural network to address the significant variation in the scaling of real-world problems.Finally,we illustrate the performance of our method by several numerical experiments,including a 2D model with the analytical solution,the Arolla glacier model with realistic scaling and a 3D model with periodic boundary conditions.Numerical results show that our proposed method is efficient in solving the non-Newtonian mechanics arising from glacier modeling with nonlinear rheology.

HRW:Hybrid Residual and Weak Form Loss for Solving Elliptic Interface Problems with Neural Network

Deep learning techniques for solving elliptic interface problems have gained significant attentions.In this paper,we introduce a hybrid residual and weak form(HRW)loss aimed at mitigating the challenge of model training.HRW utilizes the functions residual loss and Ritz method in an adversary-system,which enhances the probability of jumping out of the local optimum even when the loss landscape comprises multiple soft constraints(regularization terms),thus improving model’s capability and robustness.For the problem with interface conditions,unlike existing methods that use the domain decomposition,we design a Pre-activated ResNet of ResNet(PRoR)network structure employing a single network to feed both coordinates and corresponding subdomain indicators,thus reduces the number of parameters.The effectiveness and improvements of the PRoR with HRW are verified on two-dimensional interface problems with regular or irregular interfaces.We then apply the PRoR with HRW to solve the size-modified Poisson-Boltzmann equation,an improved dielectric continuum model for predicting the electrostatic potentials in an ionic solvent by considering the steric effects.Our findings demonstrate that the PRoR with HRW accurately approximates solvation free-energies of three proteins with irregular interfaces,showing the competitive results compared to the ones obtained using the finite element method.