ARHCS (Automatic Rainfall Half-Life Cluster System): A Landslides Early Warning System (LEWS) Using Cluster Analysis and Automatic Threshold Definition

A significant portion of Landslide Early Warning Systems (LEWS) relies on the definition of operational thresholds and the monitoring of cumulative rainfall for alert issuance. These thresholds can be obtained in various ways, but most often they are based on previous landslide data. This approach introduces several limitations. For instance, there is a requirement for the location to have been previously monitored in some way to have this type of information recorded. Another significant limitation is the need for information regarding the location and timing of incidents. Despite the current ease of obtaining location information (GPS, drone images, etc.), the timing of the event remains challenging to ascertain for a considerable portion of landslide data. Concerning rainfall monitoring, there are multiple ways to consider it, for instance, examining accumulations over various intervals (1 h, 6 h, 24 h, 72 h), as well as in the calculation of effective rainfall, which represents the precipitation that actually infiltrates the soil. However, in the vast majority of cases, both the thresholds and the rain monitoring approach are defined manually and subjectively, relying on the operators’ experience. This makes the process labor-intensive and time-consuming, hindering the establishment of a truly standardized and rapidly scalable methodology on a large scale. In this work, we propose a Landslides Early Warning System (LEWS) based on the concept of rainfall half-life and the determination of thresholds using Cluster Analysis and data inversion. The system is designed to be applied in extensive monitoring networks, such as the one utilized by Cemaden, Brazil’s National Center for Monitoring and Early Warning of Natural Disasters.

Slope deformation partitioning and monitoring points optimization based on cluster analysis

The scientific and fair positioning of monitoring locations for surface displacement on slopes is a prerequisite for early warning and forecasting.However,there is no specific provision on how to effectively determine the number and location of monitoring points according to the actual deformation characteristics of the slope.There are still some defects in the layout of monitoring points.To this end,based on displacement data series and spatial location information of surface displacement monitoring points,by combining displacement series correlation and spatial distance influence factors,a spatial deformation correlation calculation model of slope based on clustering analysis was proposed to calculate the correlation between different monitoring points,based on which the deformation area of the slope was divided.The redundant monitoring points in each partition were eliminated based on the partition's outcome,and the overall optimal arrangement of slope monitoring points was then achieved.This method scientifically addresses the issues of slope deformation zoning and data gathering overlap.It not only eliminates human subjectivity from slope deformation zoning but also increases the efficiency and accuracy of slope monitoring.In order to verify the effectiveness of the method,a sand-mudstone interbedded CounterTilt excavation slope in the Chongqing city of China was used as the research object.Twenty-four monitoring points deployed on this slope were monitored for surface displacement for 13 months.The spatial location of the monitoring points was discussed.The results show that the proposed method of slope deformation zoning and the optimized placement of monitoring points are feasible.

Fuzzy cluster analysis of water mass in the western Taiwan Strait in spring 2019

The classification of the springtime water mass has an important influence on the hydrography,regional climate change and fishery in the Taiwan Strait.Based on 58 stations of CTD profiling data collected in the western and southwestern Taiwan Strait during the spring cruise of 2019,we analyze the spatial distributions of temperature(T)and salinity(S)in the investigation area.Then by using the fuzzy cluster method combined with the T-S similarity number,we classify the investigation area into 5 water masses:the Minzhe Coastal Water(MZCW),the Taiwan Strait Mixed Water(TSMW),the South China Sea Surface Water(SCSSW),the South China Sea Subsurface Water(SCSUW)and the Kuroshio Branch Water(KBW).The MZCW appears in the near surface layer along the western coast of Taiwan Strait,showing low-salinity(<32.0)tongues near the Minjiang River Estuary and the Xiamen Bay mouth.The TSMW covers most upper layer of the investigation area.The SCSSW is mainly distributed in the upper layer of the southwestern Taiwan Strait,beneath which is the SCSUW.The KBW is a high temperature(core value of 26.36℃)and high salinity(core value of 34.62)water mass located southeast of the Taiwan Bank and partially in the central Taiwan Strait.

A Shared Natural Neighbors Based-Hierarchical Clustering Algorithm for Discovering Arbitrary-Shaped Clusters

In clustering algorithms,the selection of neighbors significantly affects the quality of the final clustering results.While various neighbor relationships exist,such as K-nearest neighbors,natural neighbors,and shared neighbors,most neighbor relationships can only handle single structural relationships,and the identification accuracy is low for datasets with multiple structures.In life,people’s first instinct for complex things is to divide them into multiple parts to complete.Partitioning the dataset into more sub-graphs is a good idea approach to identifying complex structures.Taking inspiration from this,we propose a novel neighbor method:Shared Natural Neighbors(SNaN).To demonstrate the superiority of this neighbor method,we propose a shared natural neighbors-based hierarchical clustering algorithm for discovering arbitrary-shaped clusters(HC-SNaN).Our algorithm excels in identifying both spherical clusters and manifold clusters.Tested on synthetic datasets and real-world datasets,HC-SNaN demonstrates significant advantages over existing clustering algorithms,particularly when dealing with datasets containing arbitrary shapes.

CPSO: Chaotic Particle Swarm Optimization for Cluster Analysis

Background:To solve the cluster analysis better,we propose a new method based on the chaotic particle swarm optimization(CPSO)algorithm.Methods:In order to enhance the performance in clustering,we propose a novel method based on CPSO.We first evaluate the clustering performance of this model using the variance ratio criterion(VRC)as the evaluation metric.The effectiveness of the CPSO algorithm is compared with that of the traditional particle swarm optimization(PSO)algorithm.The CPSO aims to improve the VRC value while avoiding local optimal solutions.The simulated dataset is set at three levels of overlapping:non-overlapping,partial overlapping,and severe overlapping.Finally,we compare CPSO with two other methods.Results:By observing the comparative results,our proposed CPSO method performs outstandingly.In the conditions of non-overlapping,partial overlapping,and severe overlapping,our method has the best VRC values of 1683.2,620.5,and 275.6,respectively.The mean VRC values in these three cases are 1683.2,617.8,and 222.6.Conclusion:The CPSO performed better than other methods for cluster analysis problems.CPSO is effective for cluster analysis.

Study Progress Analysis of Effluent Quality Prediction in Activated Sludge Process Based on CiteSpace

In this paper, CiteSpace, a bibliometrics software, was adopted to collect research papers published on the Web of Science, which are relevant to biological model and effluent quality prediction in activated sludge process in the wastewater treatment. By the way of trend map, keyword knowledge map, and co-cited knowledge map, specific visualization analysis and identification of the authors, institutions and regions were concluded. Furthermore, the topics and hotspots of water quality prediction in activated sludge process through the literature-co-citation-based cluster analysis and literature citation burst analysis were also determined, which not only reflected the historical evolution progress to a certain extent, but also provided the direction and insight of the knowledge structure of water quality prediction and activated sludge process for future research.

Composition Analysis and Identification of Ancient Glass Products Based on L1 Regularization Logistic Regression

In view of the composition analysis and identification of ancient glass products, L1 regularization, K-Means cluster analysis, elbow rule and other methods were comprehensively used to build logical regression, cluster analysis, hyper-parameter test and other models, and SPSS, Python and other tools were used to obtain the classification rules of glass products under different fluxes, sub classification under different chemical compositions, hyper-parameter K value test and rationality analysis. Research can provide theoretical support for the protection and restoration of ancient glass relics.

Analysis of the Employment Situation of Non Private Enterprises in Various Regions of China

In the past 30 years, Chinese enterprises have been a hot topic of discussion and concern among the general public in terms of economic and social status, ownership structure, business mechanism, and management level. Solving the problem of employment for the people is an important prerequisite for their peaceful living and work, as well as a prerequisite and foundation for building a harmonious society. The employment situation of private enterprises has always been of great concern to the outside world, and these two major jobs have always occupied an important position in the employment field of China that cannot be ignored. With the establishment of the market economy system, individual and private enterprises have become important components of the socialist economy, making significant contributions to economic development and social progress. The rapid development of China’s economy, on the one hand, is the embodiment of the superiority of China’s socialist market economic system, and on the other hand, it is the role of the tertiary industry and private enterprises in promoting the national economy. Since the 1990s, China’s private enterprises have become a new economic growth point for local and even national countries, and are one of the important ways to arrange employment and achieve social stability. This paper studies the employment of private enterprises and individuals from the perspective of statistics, extracts relevant data from China statistical Yearbook, uses the relevant knowledge of statistics to process the data, obtains the conclusion and puts forward relevant constructive suggestions.

Group decision-making method based on entropy and experts cluster analysis

According to the aggregation method of experts＇ evaluation information in group decision-making,the existing methods of determining experts＇ weights based on cluster analysis take into account the expert＇s preferences and the consistency of expert＇s collating vectors,but they lack of the measure of information similarity.So it may occur that although the collating vector is similar to the group consensus,information uncertainty is great of a certain expert.However,it is clustered to a larger group and given a high weight.For this,a new aggregation method based on entropy and cluster analysis in group decision-making process is provided,in which the collating vectors are classified with information similarity coefficient,and the experts＇ weights are determined according to the result of classification,the entropy of collating vectors and the judgment matrix consistency.Finally,a numerical example shows that the method is feasible and effective.

Cluster analysis on summer precipitation field over Qinghai-Tibet Plateau from 1961 to 2004

The summer day-by-day precipitation data of 97 meteorological stations on the Qinghai-Tibet Plateau from 1961 to 2004 were selected to analyze the temporal-spatial distribution through accumulated variance,correlation analysis,regression analysis,empirical orthogonal function,power spectrum function and spatial analysis tools of GIS.The result showed that summer precipitation occupied a relatively high proportion in the area with less annual precipitation on the Plateau and the correlation between summer precipitation and annual precipitation was strong.The altitude of these stations and summer precipitation tendency presented stronger positive correlation below 2000 m,with correlation value up to 0.604（α=0.01）.The subtracting tendency values between 1961-1983 and 1984-2004 at five altitude ranges（2000-2500 m,2500-3000 m,3500-4000 m,4000-4500 m and above 4500 m）were above zero and accounted for 71.4%of the total.Using empirical orthogonal function, summer precipitation could be roughly divided into three precipitation pattern fields：the Southeast Plateau Pattern Field,the Northeast Plateau Pattern field and the Three Rivers＇ Headstream Regions Pattern Field.The former two ones had a reverse value from the north to the south and opposite line was along 35°N.The potential cycles of the three pattern fields were 5.33a,21.33a and 2.17a respectively,tested by the confidence probability of 90%.The station altitudes and summer precipitation potential cycles presented strong negative correlation in the stations above 4500 m,with correlation value of-0.626（α=0.01）.In Three Rivers Headstream Regions summer precipitation cycle decreased as the altitude rose in the stations above 3500 m and increased as the altitude rose in those below 3500 m.The empirical orthogonal function analysis in June precipitation,July precipitation and August precipitation showed that the June precipitation pattern field was similar to the July＇s,in which southern Plateau was positive and northern Plateau negative.But positive value area in July precipitation pattern field was obviously less than June＇s.The August pattern field was totally opposite to June＇s and July＇s.The positive area in August pattern field jumped from the southern Plateau to the northern Plateau.

Cluster Analysis on Japonica Rice(Oryza sativa L.) with Good Eating Quality Based on SSR Markers and Phenotypic Traits

Diversity of 60 conventional japonica rice accessions with good eating quality at home and abroad was analyzed using SSR molecular markers, agronomic traits and taste characteristics. A total of 290 alleles were detected in the 60 accessions at 72 SSR loci with the high similarity coefficients varying between 0.600 and 0.924. The loci on chromosome 5 showed the greatest value in average allele number. Additionally, most of the SSR loci could detect 3 to 4 alleles. An UPGMA dendrogram based on the cluster analysis of the genetic similarity coefficients showed that the grouping trend of part of the rice accessions was geographic-related and most of the rice accessions in Jiangsu Province, China were clustered together. Furthermore, many domestic accessions from south and north origins in China were close to the foreign japonica rice varieties, as proved by their pedigree origin from the foreign high-quality sources. For taste characteristics, part of the accessions with excellent taste were clearly clustered into one category though they came from different geographical regions, which indicates that taste characteristics of some varieties were mainly genetically determined. In addition, the agronomic traits of japonica rice with good taste might be closely related with their geographical origins, but the relationship between superior taste characteristics and agronomic traits should be further clarified.

Bohai crude oil identification by gas chromatogram fingerprinting quantitative analysis coupled with cluster analysis

By gas chromatogram, six crude oils fingerprinting distributed in four oilfields and four oil platforms were analyzed and the corre- sponding normal paraffin hydrocarbon （ including pristane and phytane） concentration was obtained by the internal standard methed. The normal paraffin hydrocarbon distribution patterns of six crude oils were built and compared. The cluster analysis on the normal paraffin hydrocarbon concentration was conducted for classification and some ratios of oils were used for oils comparison. The results indicated： there was a clear difference within different crude oils in different oil fields and a small difference between the crude oils in the same oil platform. The normal paraffin hydrocarbon distribution pattern and ratios, as well as the cluster analysis on the nomad paraffin hydrocarbon concentration can have a better differentiation result for the crude oils with small difference than the original gas chromatogram.

Optimization of constitutive parameters of foundation soils k-means clustering analysis

The goal of this study was to optimize the constitutive parameters of foundation soils using a k-means algorithm with clustering analysis. A database was collected from unconfined compression tests, Proctor tests and grain distribution tests of soils taken from three different types of foundation pits： raft foundations, partial raft foundations and strip foundations. k-means algorithm with clustering analysis was applied to determine the most appropriate foundation type given the un- confined compression strengths and other parameters of the different soils.

Genetic Diversity among Parents of Hybrid Rice Based on Cluster Analysis of Morphological Traits and Simple Sequence Repeat Markers

The genetic diversity of 41 parental lines popularized in commercial hybrid rice production in China was studied by using cluster analysis of morphological traits and simple sequence repeat （SSR） markers. Forty-one entries were assigned into two clusters （i.e. early or medium-maturing cluster; medium or late-maturing cluster） and further assigned into six sub-clusters based on morphological trait cluster analysis, The early or medium-maturing cluster was composed of 15 maintainer lines, four early-maturing restorer lines and two thermo-sensitive genic male sterile lines, and the medium or late-maturing cluster included 16 restorer lines and 4 medium or late-maturing maintainer lines. Moreover, the SSR cluster analysis classified 41 entries into two groups （i.e, maintainer line group and restorer line group） and seven sub-groups. The maintainer line group consisted of all 19 maintainer lines, two thermo-sensitive genic male sterile lines, while the restorer line group was composed of all 20 restorer lines. The SSR analysis fitted better with the pedigree information. From the views on hybrid rice breeding, the results suggested that SSR analysis might be a better method to study the diversity of parental lines in indica hybrid rice.

Vertical Migrating and Cluster Analysis of Soil Mesofauna at Dongying Halophytes Garden in Yellow River Delta

For the first time, we used Tullgren method made a study on vertical migrating and cluster analysis of the soil mesofauna in Dongying Halophytes Garden in the Yellow River Delta （YRD）, Shandong Province. The results showed that the soil mesofauna tended to gather on soil surface in most samples at most times, but the vertical migrating greatly varied in different seasons or environment conditions. Acari was the dominant group. The index of diversity of the soil fauna was correlated with the index of evenness. The Acari＇s number of individuals infected other species and numbers. Dominant group-Aeari made greater contribution to the result of cluster analysis, and there were significant differences between communities in different habitats by cluster analysis with both Bray-Curtis and Jaccard similarity coefficient.

Caries Patterns in the Primary Dentition: Cluster Analysis of a Sample of 5,169 Arizona Children 5-59 Months of Age

Aim Cluster analysis was conducted on data from 5,169 United States （U.S.） Arizona children, age＇s 5-59-months with the goal of delineating patterns of caries in the primary dentition of pre-school children without a priori pattern definitions. Methodology Cluster analyses were conducted using all data for children ages 0-4 years in aggregate： 1） for all subjects, and 2） for subjects without crowned restored teeth. Each of these two sets of analyses consisted of 8 differently specified cluster analyses as a validation procedure. Results The caries patterns identified from the clustering analysis are： 1） smooth surfaces （other than the maxillary incisor）, 2） maxillary incisor, 3） occlusal surfaces of first molars, and 4） pit and fissure surfaces of second molars. Conclusion The cluster analysis findings were consistent with results produced by multidimensional scaling. These cross-validated patterns may represent resulting disease conditions from different risks or the timing of various risk factor exposures. As such, the patterns may be useful case definitions for caries risk factor investigations in children under 60 months of age.

The cluster analysis of the water masses in western Taiwan Strait from hydrologic And chemical factors

On the basis of mixture theory of concentration of Helland-Hansen (Mao et al, 1964; Helland-Hansen, 1916), this paper takes salinity as a conservative factor in the process of dilution and mixture and selects by relating analysis the bydrological and chemical factors which are closely related to salinity. Then making use of the Q type multi-dimensions cluster analysis, we get the results that the water masses in the western Taiwan Strait include the follying: the coastal water along Fujian, Zhejiang and Guangdong Provinces, the diluted fresh water of Minjiang, Jiulong and Hanjiang Rivers; the mixing water in the Taiwan Strait; upwelling cold/warm water to the northwest of the Taiwan Shoal and the upwelling water to the east of Guangdong. The mixing weter in the Taiwan Strait during spring and summer is composed of a Kuroshio branch, the surface weter of the South China Sea, outal wier along Fujian, Zhejiang and Guangdong Provinces. While in autunm and winter, it is mixed up from Kuroshio branch, the shelf weter in the East China Sea, and the coastal water along Fujian, Zhejiang and Guangdong. There is an obvious seasonal change of growth and decline in these water masses.

Massive Power Device Condition Monitoring Data Feature Extraction and Clustering Analysis using MapReduce and Graph Model

Effective storage,processing and analyzing of power device condition monitoring data faces enormous challenges.A framework is proposed that can support both MapReduce and Graph for massive monitoring data analysis at the same time based on Aliyun DTplus platform.First,power device condition monitoring data storage based on MaxCompute table and parallel permutation entropy feature extraction based on MaxCompute MapReduce are designed and implemented on DTplus platform.Then,Graph based k-means algorithm is implemented and used for massive condition monitoring data clustering analysis.Finally,performance tests are performed to compare the execution time between serial program and parallel program.Performance is analyzed from CPU cores consumption,memory utilization and parallel granularity.Experimental results show that the designed framework and parallel algorithms can efficiently process massive power device condition monitoring data.

A New Species of Cupressinocladus from the Lower Cretaceous of Guyang Basin,Inner Mongolia,China and Cluster Analysis

Cupressinocladus Seward is a fossil genus of conifers and conifer fossils with reproductive organs are very rare. In general, it is difficult to understand the natural affinities with other conifers. In this paper, a new species, Cupressinocladus guyangensis P.H. Jin et B.N. Sun sp. nov., is reported based on branches with immature female cones from the Lower Cretaceous Guyang Formation of the Guyang Basin in Inner Mongolia, northern China. The foliage shoots are decussate. Leaves are decussate, imbricate, scale-like, weakly dimorphic, and bear longitudinal glands on the abaxial view. Stomata complexes are haplocheilic, monocyclic, irregularly arranged, and spread along the leaf margin. Immature female cones are subglobose with 6-8 cone scales, and three subglobose ovules arranged in a row at the base of the cone scales. Moreover, we performed cluster analysis using a statistics and machine learning toolbox for 23 fossils and extant species based on 16 morphological characters. The result implies that the new species bears a close resemblance to the extant Cupressusfunebris Endl. and might have nearest systematic affinities to it.

Feature Selection for Cluster Analysis in Spectroscopy

Cluster analysis in spectroscopy presents some unique challenges due to the specific data characteristics in spectroscopy,namely,high dimensionality and small sample size.In order to improve cluster analysis outcomes,feature selection can be used to remove redundant or irrelevant features and reduce the dimensionality.However,for cluster analysis,this must be done in an unsupervised manner without the benefit of data labels.This paper presents a novel feature selection approach for cluster analysis,utilizing clusterability metrics to remove features that least contribute to a dataset’s tendency to cluster.Two versions are presented and evaluated:The Hopkins clusterability filter which utilizes the Hopkins test for spatial randomness and the Dip clusterability filter which utilizes the Dip test for unimodality.These new techniques,along with a range of existing filter and wrapper feature selection techniques were evaluated on eleven real-world spectroscopy datasets using internal and external clustering indices.Our newly proposed Hopkins clusterability filter performed the best of the six filter techniques evaluated.However,it was observed that results varied greatly for different techniques depending on the specifics of the dataset and the number of features selected,with significant instability observed for most techniques at low numbers of features.It was identified that the genetic algorithm wrapper technique avoided this instability,performed consistently across all datasets and resulted in better results on average than utilizing the all the features in the spectra.