Text Simplification Using Transformer and BERT

Reading and writing are the main interaction methods with web content.Text simplification tools are helpful for people with cognitive impairments,new language learners,and children as they might find difficulties in understanding the complex web content.Text simplification is the process of changing complex text intomore readable and understandable text.The recent approaches to text simplification adopted the machine translation concept to learn simplification rules from a parallel corpus of complex and simple sentences.In this paper,we propose two models based on the transformer which is an encoder-decoder structure that achieves state-of-the-art(SOTA)results in machine translation.The training process for our model includes three steps:preprocessing the data using a subword tokenizer,training the model and optimizing it using the Adam optimizer,then using the model to decode the output.The first model uses the transformer only and the second model uses and integrates the Bidirectional Encoder Representations from Transformer(BERT)as encoder to enhance the training time and results.The performance of the proposed model using the transformerwas evaluated using the Bilingual Evaluation Understudy score(BLEU)and recorded(53.78)on the WikiSmall dataset.On the other hand,the experiment on the second model which is integrated with BERT shows that the validation loss decreased very fast compared with the model without the BERT.However,the BLEU score was small(44.54),which could be due to the size of the dataset so the model was overfitting and unable to generalize well.Therefore,in the future,the second model could involve experimenting with a larger dataset such as the WikiLarge.In addition,more analysis has been done on the model’s results and the used dataset using different evaluation metrics to understand their performance.

Analysis of a simplification strategy in a nonhydrostatic model for surface and internal wave problems

This paper examines the simplification strategy of retaining only the nonhydrostatic effect of local acceleration in a three-dimensional fully nonhydrostatic model regarding the submesoscale wave phenomenon in the ocean.Elaborate scale analysis of the vertical component of the Reynold-averaged Navier-Stokes(RANS)equation was performed,confirming the rationalization of this simplification.Then,the simplification was implemented in a RANS equation-based nonhydrostatic model NHWAVE(nonhydrostatic WAVE)to make a simplified nonhydrostatic model.Numerical examples were taken to test its performance,including surface sinusoidal waves propagating on an idealized East China Sea topography,tidally induced internal lee waves and small-scale solitary waves.The results show that in a considerably wide range of nonlinear strengths,the simplified nonhydrostatic model can obtain similar results as those in the fully nonhydrostatic model,even for smaller-scale solitary waves.Nonlinearity influences the applicability of the simplification.The stronger the nonlinearity is,the worse the simplified model describes the nonhydrostatic phenomenon.In general,the simplified nonhydrostatic model can simulate surface waves better than internal waves.Improvement of computational efficiency in the simplified nonhydrostatic model is reasonable,reducing the central processing unit time duration in the fully nonhydrostatic model by 16.4%–20.6%.The specially designed algorithm based on the simplified nonhydrostatic equation can remarkably reduce the computational time.

A Collaborative Simplification Method for Multiple Coastlines Based on the Hierarchical Triangulation Network Partition

For the current automatic coastline generalization method,only one-line element is considered separately,but the relationship between the nearby elements is not effectively considered.A synergistic simplification method for multiple coastlines based on the hierarchical triangulation network partition(HTNP)is proposed in this paper.Firstly,the constrained Delaunay triangulation is constructed to partition the regions that can be simplified.Then,a hierarchical binary tree model to structure the morphological characteristics of the above several coastlines and the spatial proximity between different coastlines is constructed.Finally,the small curved and curved invisible parts of the coastline are deleted according to the visual constraints,and the narrow part between the coastline itself or the different coastlines is exaggerated appropriately,and the automatic simplification of the coastline is realized.The experimental results show that:①Relationships between the different coastlines are considered,and the shortcomings of considering the coastline separately are overcome;②Under the condition of the multiple coastlines in complex sea areas,the problem of collaborative simplification is solved,the quality of the coastlines are improved obviously,and the proposed method can be applied into more types of coastlines.

A Progressive Line Simplification Algorithm

An application of line simplification considering spatial knowledge is described.A method for identifying potential conflict regions,in order to avoid the self_intersection of generalized lines,is also discussed.Furthermore,a new progressive line simplification algorithm is presented.From the view point of spatial cognition,a spatial hierarchical structure is proposed,and its application to construction of spatial knowledge related to a line is explained.

Simplification and Experimental Verification for Temperature and Humidity Field Coupling Model of Conservatory Soil

Based on the surface energy balance model which is widely used abroad, a temperature and humidity field coupling model of conservatory soil without crop vegetation in full illumination was established. Considering the relatively closed environment in conservatory, weak solar radiation and little surface evaporation of soil, the daily variation of water content in different soil layers may be neglected, then the temperature and humidity field coupling model was simplified to a one-dimensional thermal diffusion model. The simplified model and the temperature and humidity field coupling model adopted the same computational method of soil physical parameters and discrete format of heat diffusion differential equations, and were applied to the continuous simulation of temperature field in conservatory soil without crop vegetation in full illumination. Through the comparison between simulation results and experimental data, the precision of the simplified model was verified. The typical rule of soil heat flux variation in a 24 h cycle was also obtained.

An Adaptive SVP Simplification Based on Area Difference

Sound velocity profile(SVP)data is indispensable in the multi-beam data processing.The sampling density is of great importance for SVP to represent the vertical variation of sound velocity accurately and guarantee the accuracy of sound ray tracing(SRT).However,the SVP also affects the SRT efficiency significantly,especially in deep-sea multi-beam sounding data processing.To improve SRT efficiency and ensure SRT accuracy,an adaptive SVP simplification method based on area difference is proposed in this article.Firstly,the relationship between the area difference of the raw SVP and the simplified one and SRT bias is studied,and the relationship model of them is built.Then,by considering the constraint of SRT accuracy,the SVP simplification method and the simplifying SVP procedure SVP are given.Finally,a deep water experiment is conducted to verify the proposed method.Compared to the existing method,the proposed method improves the robustness,feasibility of SVP simplification as well as the accuracy and efficiency of SRT.

Simplification of English Sentence Pattern Structure in the Teaching of Translation and Grammar

In the teaching of translation and grammar,it is essential that the English sentence structure is analyzed and transformation of sentence structures both in English and Chinese in class and after class. However,many kinds of English sentences structures prevent the students who study English from getting the basic idea and concept of a sentence in translation or grammatical analysis. In this paper,the author submitted the basic mould of simplification of English sentence structure,and the students can learn and master the translating technique through the simplified English sentence structure. Thus it helps to improve students' competence of translation.

The Solid-liquid Transformation of Low-grade Solid Potash Deposit in Dalangtan Basin and the Simplification of the Liquid Phase System

We studied the solid-liquid transformation of low-grade solid potash deposit in Dalangtan Basin and simplified the liquid phase system.We did experiments to optimize conditions of the solid-liquid transformation.The Suitable

The Spatial Characteristics of a Line and Their Application to Line Simplification

This paper discusses the spatial knowledge related to a line ,and the characteristic points of lines is detected.According to the requirements of line generalization,new algorithms for identifying characteristic line points are presented.These characteristic points are used to improve the algorithms of line generalization.An algorithm for identifying bends is shown.In this paper,improved algorithms based on those by Douglas_Peucker,Visvalingam and Whyatt are shown.In this test,the progressive process of line generalization is emphasized.

Complex Model Simplification Algorithm with Improved Error Evaluation

Given the framework of incremental mesh simplification based on edgecollapse, the paper proposes a mesh simplification algorithm using an improved approach formeasuring simplification error. The algorithm uses edge collapse to simplify the trianglemesh andmaintains surface error approximations using c-error for the faces which have changed after edgecollapse and d-crror for the faces which become degenerated after edge collapse. Also, we reportsome results using a variety of computer graphics models, which can show that the algorithm canachieve the desired simplification effect.

THE METHOD OF GRAPHIC SIMPLIFICATION OF AREA FEATURE BOUNDARY WITH RIGHT ANGLES

Some rules of simplification of area feature boundary and the method of acquiring spatial knowledge, such as maintaining area and shape of area feature, are discussed. This paper focuses on the progressive method of graphic simplification of area feature boundary with right angles based on its characteristics.

Terrain Simplification Research in Augmented Scene Modeling

Augmented reality is the merging of synthetic sensory information into a user's perception of a real environment. As one of the most important tasks in augmented scene modeling, terrain simplification research has gained more and more attention. In this paper, we mainly focus on point selection problem in terrain simplification using triangulated irregular network. Based on the analysis and comparison of traditional importance measures for each input point, we put forward a new importance measure based on local entropy. The results demonstrate that the local entropy criterion has a better performance than any traditional methods. In addition, it can effectively conquer the 'short-sight' problem associated with the traditional methods.

Application of equivalent resistance to simplification of Sutong Bridge piers in tidal river section modeling

This paper describes some details and procedural steps in the equivalent resistance （E-R） method for simplifying the pier group of the Sutong Bridge, which is located on the tidal reach of the lower Yangtze River, in Jiangsu Province. Using a two-dimensional tidal current numerical model, three different models were established： the non-bridge pier model, original bridge pier model, and simplified bridge pier model. The difference in hydrodynamic parameters, including water level, velocity, and diversion ratio, as well as time efficiency between these three models is discussed in detail. The results show that simplifying the pier group using the E-R method influences the water level and velocity near the piers, but has no influence on the diversion ratio of each cross-section of the Xuliujing reach located in the lower Yangtze River. Furthermore, the simplified bridge pier model takes half the calculation time that the original bridge pier model needs. Thus, it is concluded that the E-R method can be use to simplify bridge piers in tidal river section modeling reasonably and efficiently.

Effect of geometry simplification and boundary condition specification on flow field and aerodynamic noise in the train head and bogie region of high-speed trains

The purpose of this study is to determine a suitable modeling method to make computational fluid dynamics(CFD)simulation more efficient for aeroacoustics optimization of the bogie region of high-speed trains.To this end,four modeling methods are considered,which involve different geometry simplifications and boundary condition specifications.The corresponding models are named the three-car marshalling model,computational domain shortening model,carbody shortening model,and sub-domain model.Combining the detached eddy simulation(DES)model and Ffowcs Williams-Hawkings(FW-H)equation,the unsteady flow field and far-field noise of the four models are predicted.To evaluate the effect of the different modeling methods,the time-averaged flow field,fluctuating flow field,and far-field noise results of the four models are compared and analyzed in detail with the results of the three-car marshalling model used as basis for comparison.The results show that the flow field results of the bogie region predicted by the four models have relatively high consistency.However,the usage of the non-time varying outlet boundary conditions in the computational domain shortening model and sub-domain model could affect the pressure fluctuation on the upstream carbody surface.When only the bogie region is used as the source surface,the differences between the far-field noise results of the three simplified models and the three-car marshalling model are all within 1 dB;when the train head is used as the source surface,the results of the carbody shortening model and the three-car marshalling model are more consistent.

Unsupervised statistical text simplification using pre-trained language modeling for initialization

Unsupervised text simplification has attracted much attention due to the scarcity of high-quality parallel text simplification corpora. Recent an unsupervised statistical text simplification based on phrase-based machine translation system (UnsupPBMT) achieved good performance, which initializes the phrase tables using the similar words obtained by word embedding modeling. Since word embedding modeling only considers the relevance between words, the phrase table in UnsupPBMT contains a lot of dissimilar words. In this paper, we propose an unsupervised statistical text simplification using pre-trained language modeling BERT for initialization. Specifically, we use BERT as a general linguistic knowledge base for predicting similar words. Experimental results show that our method outperforms the state-of-the-art unsupervised text simplification methods on three benchmarks, even outperforms some supervised baselines.

A distributed variable density path search and simplification method for industrial manipulators with end-effector's attitude constraints

In many robot operation scenarios, the end-effector's attitude constraints of movement are indispensable for the task process, such as robotic welding, spraying, handling, and stacking. Meanwhile, the inverse kinematics, collision detection, and space search are involved in the path planning procedure under attitude constraints, making it difficult to achieve satisfactory efficiency and effectiveness in practice. To address these problems, we propose a distributed variable density path planning method with attitude constraints(DVDP-AC) for industrial robots. First, a position – attitude constraints reconstruction(PACR) approach is proposed in the inverse kinematic solution. Then, the distributed signed-distance-field(DSDF) model with single-step safety sphere(SSS) is designed to improve the efficiency of collision detection. Based on this, the variable density path search method is adopted in the Cartesian space. Furthermore, a novel forward sequential path simplification(FSPS) approach is proposed to adaptively eliminate redundant path points considering path accessibility. Finally, experimental results verify the performance and effectiveness of the proposed DVDP-AC method under end-effector's attitude constraints, and its characteristics and advantages are demonstrated by comparison with current mainstream path planning methods.

Numerical Simulation of the Settling Flux of Biodeposition in a Bay with Cage Culture Through Similarity Theory and a Simplified Pollution Source

The settling flux of biodeposition affects the environmental quality of cage culture areas and determines their environmental carrying capacity.Simple and effective simulation of the settling flux of biodeposition is extremely important for determining the spatial distribution of biodeposition.Theoretically,biodeposition in cage culture areas without specific emission rules can be simplified as point source pollution.Fluent is a fluid simulation software that can simulate the dispersion of particulate matter simply and efficiently.Based on the simplification of pollution sources and bays,the settling flux of biodeposition can be easily and effectively simulated by Fluent fluid software.In the present work,the feasibility of this method was evaluated by simulation of the settling flux of biodeposition in Maniao Bay,Hainan Province,China,and 20 sampling sites were selected for determining the settling fluxes.At sampling sites P1,P2,P3,P4,P5,Z1,Z2,Z3,Z4,A1,A2,A3,A4,B1,B2,C1,C2,C3 and C4,the measured settling fluxes of biodeposition were 26.02,15.78,10.77,58.16,6.57,72.17,12.37,12.11,106.64,150.96,22.59,11.41,18.03,7.90,19.23,7.06,11.84,5.19 and 2.57 g d^(−1)m^(−2),respectively.The simulated settling fluxes of biodeposition at the corresponding sites were 16.03,23.98,8.87,46.90,4.52,104.77,16.03,8.35,180.83,213.06,39.10,17.47,20.98,9.78,23.25,7.84,15.90,6.06 and 1.65 g d^(−1)m^(−2),respectively.There was a positive correlation between the simulated settling fluxes and measured ones(R=0.94,P=2.22×10^(−9)<0.05),which implies that the spatial differentiation of biodeposition flux was well simulated.Moreover,the posterior difference ratio of the simulation was 0.38,and the small error probability was 0.94,which means that the simulated results reached an acceptable level from the perspective of relative error.Thus,if nonpoint source pollution is simplified to point source pollution and open waters are simplified based on similarity theory,the setting flux of biodeposition in the open waters can be simply and effectively simulated by the fluid simulation software Fluent.

Motion and Special Relativity in Complex Spaces

A natural extension of the Lorentz transformation to its complex version was constructed together with a parallel extension of the Minkowski M4 model for special relativity (SR) to complex C4 space-time. As the [signed] absolute values of complex coordinates of the underlying motion’s characterization in C4 one obtains a Newtonian-like type of motion whereas as the real parts of the complex motion’s description and of the complex Lorentz transformation, all the SR theory as modeled by M4 real space-time can be recovered. This means all the SR theory is preserved in the real subspace M4 of the space-time C4 while becoming simpler and clearer in the new complex model’s framework. Since velocities in the complex model can be determined geometrically, with no primary use of time, time turns out to be definable within the equivalent theory of the reduced complex C4 model to the C3 “para-space” model. That procedure allows us to separate time from the (para)space and consider all the SR theory as a theory of C3 alone. On the other hand, the complex time defined within the C3 theory is interpreted and modeled by the single separate C1 complex plane. The possibility for application of the C3 model to quantum mechanics is suggested. As such, the model C3 seems to have unifying abilities for application to different physical theories.

A New Mesh Simplification Algorithm Based on Triangle Collapses

In this paper a new mesh simplification algorithm based on triangle collapses is presented. The algorithm can provide efficient error management and simplify the original mesh greatly. Progressive meshes may be constructed with triangle collapsing operation. To make continuous transition between level of detail (LOD) models possible, a method for interpolating is also presented. Examples illustrate the efficiency of the algorithm.

Feature Preserving Mesh Simplification Using Feature Sensitive Metric

We present a new method for feature preserving mesh simplification based on feature sensitive （FS） metric. Previous quadric error based approach is extended to a high-dimensional FS space so as to measure the geometric distance together with normal deviation. As the normal direction of a surface point is uniquely determined by the position in Euclidian space, we employ a two-step linear optimization scheme to efficiently derive the constrained optimal target point. We demonstrate that our algorithm can preserve features more precisely under the global geometric properties, and can naturally retain more triangular patches on the feature regions without special feature detection procedure during the simplification process. Taking the advantage of the blow-up phenomenon in FS space, we design an error weight that can produce more suitable results. We also show that Hausdorff distance is markedly reduced during FS simplification.