Attribute Reduction of Hybrid Decision Information Systems Based on Fuzzy Conditional Information Entropy

The presence of numerous uncertainties in hybrid decision information systems(HDISs)renders attribute reduction a formidable task.Currently available attribute reduction algorithms,including those based on Pawlak attribute importance,Skowron discernibility matrix,and information entropy,struggle to effectively manages multiple uncertainties simultaneously in HDISs like the precise measurement of disparities between nominal attribute values,and attributes with fuzzy boundaries and abnormal values.In order to address the aforementioned issues,this paper delves into the study of attribute reduction withinHDISs.First of all,a novel metric based on the decision attribute is introduced to solve the problem of accurately measuring the differences between nominal attribute values.The newly introduced distance metric has been christened the supervised distance that can effectively quantify the differences between the nominal attribute values.Then,based on the newly developed metric,a novel fuzzy relationship is defined from the perspective of“feedback on parity of attribute values to attribute sets”.This new fuzzy relationship serves as a valuable tool in addressing the challenges posed by abnormal attribute values.Furthermore,leveraging the newly introduced fuzzy relationship,the fuzzy conditional information entropy is defined as a solution to the challenges posed by fuzzy attributes.It effectively quantifies the uncertainty associated with fuzzy attribute values,thereby providing a robust framework for handling fuzzy information in hybrid information systems.Finally,an algorithm for attribute reduction utilizing the fuzzy conditional information entropy is presented.The experimental results on 12 datasets show that the average reduction rate of our algorithm reaches 84.04%,and the classification accuracy is improved by 3.91%compared to the original dataset,and by an average of 11.25%compared to the other 9 state-of-the-art reduction algorithms.The comprehensive analysis of these research results clearly indicates that our algorithm is highly effective in managing the intricate uncertainties inherent in hybrid data.

Information Entropy Squeezing for a Atom in Mode-Mode Competition System

The entropy squeezing properties for a two-level atom interacting with a two-mode field via two differentcompeting transitions are investigated from a quantum information point of view.The influences of the initial state of thesystem and the relative coupling strength between the atom and the field on the atomic information entropy squeezingare discussed.Our results show that the squeezed direction and the frequency of the information entropy squeezing canbe controlled by choosing the phase of the atom dipole and the relative competing strength of atom-field,respectively.We find that,under the same condition,no atomic variance squeezing is predicted from the HUR while optimal entropysqueezing is obtained from the EUR,so the quantum information entropy is a remarkable precision measure for theatomic squeezing in the considered system.

Novel Fault Detection Optimization Algorithm for Single Event Effect system Based on Multi-information Entropy Fusion

Fault detection caused by single event effect( SEE) in system was studied,and an improved fault detection algorithm by fusing multi-information entropy for detecting soft error was proposed based on multi-objective detection approach and classification management method. In the improved fault detection algorithm, the analysis model of posteriori information with corresponding multi-fault alternative detection points was formulated through correlation information matrix, and the maximum incremental information entropy was chosen as the classification principle for the optimal detection points. A system design example was given to prove the rationality and feasibility of this algorithm.This fault detection algorithm can achieve the purpose of fault detection and resource configuration with high efficiency.

Integrating unascertained measurement and information entropy theory to assess blastability of rock mass

Due to the complex features of rock mass blastability assessment systems, an evaluation model of rock mass blastability was established on the basis of the unascertained measurement （UM） theory and the actual characteristics of the project. Considering a comprehensive range of intact rock properties and discontinuous structures of rock mass, twelve main factors influencing the evaluation blastability of rock mass were taken into account in the UM model, and the blastability evaluation index system of rock mass was constructed. The unascertained evaluation indices corresponding to the selected factors for the actual situation were solved both qualitatively and quantitatively. Then, the UM function of each evaluation index was obtained based on the initial data for the analysis of the blastability of six rock mass at a highway improvement cutting site in North Wales. The index weights of the factors were calculated by entropy theory, and credible degree identification （CDI） criteria were established according to the UM theory. The results of rock mass blastability evaluation were obtained by the CDI criteria. The results show that the UM model assessment results agree well with the actual records, and are consistent with those of the fuzzy sets evaluation method. Meanwhile, the unascertained superiority degree of rock mass blastability of samples S1-$6 which can be calculated by scoring criteria are 3.428 5, 3.453 3, 4.058 7, 3.675 9, 3.516 7 and 3.289 7, respectively. Furthermore, the proposed method can take into account large amount of uncertain information in blastability evaluation, which can provide an effective, credible and feasible way for estimating the blastability of rock mass. Engineering practices show that it can complete the blastability assessment systematically and scientifically without any assumption by the proposed model, which can be applied to practical engineering.

Novel detection method for infrared small targets using weighted information entropy

This paper presents a method for detecting the small infrared target under complex background. An algorithm, named local mutation weighted information entropy （LMWIE）, is proposed to suppress background. Then, the grey value of targets is enhanced by calculating the local energy. Image segmentation based on the adaptive threshold is used to solve the problems that the grey value of noise is enhanced with the grey value improvement of targets. Experimental results show that compared with the adaptive Butterworth high-pass filter method, the proposed algorithm is more effective and faster for the infrared small target detection.

Determination of neutron-skin thickness using configurational information entropy

Configurational information entropy(CIE)theory was employed to determine the neutron-skin thickness of neutron-rich calcium isotopes.The nuclear density distributions and fragment cross sections in 350 MeV/u ^(40-60)Ca+^(9)Be projectile fragmentation reactions were calculated using a modified statistical abrasion-ablation model.CIE quantities were determined from the nuclear density,isotopic,mass,and charge distributions.The linear correlations between the CIE determined using the isotopic,mass,and charge distributions and the neutron-skin thickness of the projectile nucleus show that CIE provides new methods to extract the neutron-skin thickness of neutron-rich nuclei.

An Intelligent Fault Diagnosis Method of Multi-Scale Deep Feature Fusion Based on Information Entropy

For a single-structure deep learning fault diagnosis model,its disadvantages are an insufficient feature extraction and weak fault classification capability.This paper proposes a multi-scale deep feature fusion intelligent fault diagnosis method based on information entropy.First,a normal autoencoder,denoising autoencoder,sparse autoencoder,and contractive autoencoder are used in parallel to construct a multi-scale deep neural network feature extraction structure.A deep feature fusion strategy based on information entropy is proposed to obtain low-dimensional features and ensure the robustness of the model and the quality of deep features.Finally,the advantage of the deep belief network probability model is used as the fault classifier to identify the faults.The effectiveness of the proposed method was verified by a gearbox test-bed.Experimental results show that,compared with traditional and existing intelligent fault diagnosis methods,the proposed method can obtain representative information and features from the raw data with higher classification accuracy.

Configurational information entropy analysis of fragment mass cross distributions to determine the neutron skin thickness of projectile nuclei

Configurational information entropy(CIE)analysis has been shown to be applicable for determining the neutron skin thickness(δnp)of neutron-rich nuclei from fragment production in projectile fragmentation reactions.The BNN+FRACS machine learning model was adopted to predict the fragment mass cross-sections(σ_(A))of the projectile fragmentation reactions induced by calcium isotopes from ^(36)Ca to ^(56)Ca on a ^(9)Be target at 140MeV/u.The fast Fourier transform was adopted to decompose the possible information compositions inσA distributions and determine the quantity of CIE(S_(A)[f]).It was found that the range of fragments significantly influences the quantity of S_(A)[f],which results in different trends of S_(A)[f]~δnp correlation.The linear S_(A)[f]~δnp correlation in a previous study[Nucl.Sci.Tech.33,6(2022)]could be reproduced using fragments with relatively large mass fragments,which verifies that S_(A)[f]determined from fragmentσAis sensitive to the neutron skin thickness of neutron-rich isotopes.

Multi-objectives fuzzy optimization model for ship form demonstration based on information entropy

Selecting optimization ship form scheme is an important content in the process of concept design of ship. Multi-objective fuzzy decision-making model for ship form demonstration is set up according to the fuzzy pattern-recognition theory. Weight coefficients of each target of ship form scheme are determined by information entropy and individual subjective partiality. This model is used to select the optimal ship form scheme, the example shows that the model is exact and the resuh is credible. It can provide a reference for choosing the optimization scheme of ship form.

A Heuristic Clustering Algorithm forIntrusion Detection Based on Information Entropy

This paper studied on the clustering problem for intrusion detection with the theory of information entropy, it was put forward that the clustering problem for exact intrusion detection based on information entropy is NP complete, therefore, the heuristic algorithm to solve the clustering problem for intrusion detection was designed, this algorithm has the characteristic of incremental development, it can deal with the database with large connection records from the internet.

Time evolution of information entropy for a stochastic system with double singularities driven by quasimonochromatic noise

This paper deals with the time evolution of information entropy for a stochastic system with double singularities driven by quasimonochromatic noise. The dimension of the Fokker Planck equation is reduced by the linear transfor- mation. The exact expression of the time dependence of information entropy is obtained based on the definition of Shannon＇s information entropy. The relationships between the properties of dissipative parameters, system singularity strength parameter, quasimonochromatic noise, and their effects on information entropy are discussed.

An outlier recognition approach in surveying data based on information entropy

A novel outlier recognition method in surveying data is presented based on Shannon information entropy. The probability distribution of surveying data does not need to be known or hypothesized in this method, and it is not only accurate but also convenient to calculate in this method compared with statistical recognition method.

A Method of Using Information Entropy of an Image as an Effective Feature for Com-puter-Aided Diagnostic Applications

Computer-aided detection and diagnosis (CAD) systems are increasingly being used as an aid by clinicians for detection and interpretation of diseases. In general, a CAD system employs a classifier to detect or distinguish between abnormal and normal tissues on images. In the phase of classification, a set of image features and/or texture features extracted from the images are commonly used. In this article, we investigated the characteristic of the output entropy of an image and demonstrated the usefulness of the output entropy acting as a texture feature in CAD systems. In order to validate the effectiveness and superiority of the output-entropy-based texture feature, two well-known texture features, i.e., mean and standard deviation were used for comparison. The database used in this study comprised 50 CT images obtained from 10 patients with pulmonary nodules, and 50 CT images obtained from 5 normal subjects. We used a support vector machine for classification. A leave-one-out method was employed for training and classification. Three combinations of texture features, i.e., mean and entropy, standard deviation and entropy, and standard deviation and mean were used as the inputs to the classifier. Three different regions of interest (ROI) sizes, i.e., 11 × 11, 9 × 9 and 7 × 7 pixels from the database were selected for computation of the feature values. Our experimental results show that the combination of entropy and standard deviation is significantly better than both the combination of mean and entropy and that of standard deviation and mean in the case of the ROI size of 11 × 11 pixels (p < 0.05). These results suggest that information entropy of an image can be used as an effective feature for CAD applications.

Fault Diagnosis of a Rotary Machine Based on Information Entropy and Rough Set

There exists some discord or contradiction of information during the process of fault diagnosis for rotary machine. But the traditional methods used in fault diagnosis can not dispose of the information. A model of fault diagnosis for a rotary machine based on information entropy theory and rough set theory is presented in this paper. The model has clear mathematical definition and can dispose both complete unification information and complete inconsistent information of vibration faults. By using the model, decision rules of six typical vibration faults of a steam turbine and electric generating set are deduced from experiment samples. Finally, the decision rules are validated by selected samples and good identification results are acquired.

A Method of Rotating Machinery Fault Diagnosis Based on the Close Degree of Information Entropy

This paper presents a method of rotating machinery fault diagnosis based on the close degree of information entropy. In the view of the information entropy, we introduce four information entropy features of the rotating machinery, which describe the vibration condition of the machinery. The four features are, respectively, denominated as singular spectrum entropy, power spectrum entropy, wavelet space state feature entropy and wavelet power spectrum entropy. The value scopes of the four information entropy features of the rotating machinery in some typical fault conditions are gained by experiments, which can be acted as the standard features of fault diagnosis. According to the principle of the shorter distance between the more similar models, the decision-making method based on the close degree of information entropy is put forward to deal with the recognition of fault patterns. We demonstrate the effectiveness of this approach in an instance involving the fault pattern recognition of some rotating machinery.

The remote sensing composite information entropy and types of Nansha coral reef atolls

In the viempint that the coral reef atolls' growth index of the Nansha Islands is influenced by many factors, the measured remote sensing comopite information including some mutually related factors is divided into 10 geographic events as N1, N2 ..., N10, and the analysis of the atolls' information entropy is made. From the value of theentropy, the closed related factors with the index of the emerged atolls are shown. In proper order, the factors are reeftop's area(0. 319), lagoon's area(0. 324), open-degree of atoll(0. 336), trend of atoll(0. 551 ). On the basis of thiswork, a new description function of the emerged atoll growth index is proposed. This function can be used to identifythe open my of Nansha atoll growth.

Effect of time delay on the upper bound of the time derivative of information entropy in a stochastic dynamical system

The effects of the time delay on the upper bound of the time derivative of information entropy are investigated in a time-delayed dynamical system driven by correlated noise. Using the Markov approximation of the stochastic delay differential equations and the Schwartz inequality principle, we obtain an analytical expression for the upper bound UB（t） of the time derivative of the information entropy. The results show that there is a critical value of T （delay time）, and UB（t） presents opposite behaviours on difference sides of the critical value. For the case of the weak additive noise, T can induce a reentrance transition. Delay time T also causes a reversal behaviour in UB（t）-λplot, where λ denotes the degree of the correlation between the two noises.

Information entropy for static spherically symmetric black holes

By using the new equation of state density derived from the generalized uncertainty relation, the number of the quantum states near event horizon is obtained, with which then the information entropy of static spherically symmetric black holes has been discussed. It is found that the divergent integral of quantum states near the event horizon can be naturally avoided if using the new equation of state density without introducing the ultraviolet cut-off. The information entropy of black holes can be obtained precisely by the residue theorem, which is shown to be proportional to the horizon area. The information entropy of black holes obtained agrees with the Bechenstein-Hawking entropy when the suitable cutoff factor is adopted.

Quantum information entropy for one-dimensional system undergoing quantum phase transition

Calculations of the quantum information entropy have been extended to a non-analytically solvable situation. Specifically, we have investigated the information entropy for a one-dimensional system with a schematic ＂Landau＂ potential in a numerical way. Particularly, it is found that the phase transitional behavior of the system can be well expressed by the evolution of quantum information entropy. The calculated results also indicate that the position entropy S_x and the momentum entropy S_p at the critical point of phase transition may vary with the mass parameter M but their sum remains as a constant independent of M for a given excited state. In addition, the entropy uncertainty relation is proven to be robust during the whole process of the phase transition.

Extension of information entropy-based measures in incomplete information systems

It is helpful for people to understand the essence of rough set theory to study the concepts and operations of rough set theory from its information view. In this paper we address knowledge expression and knowledge reduction in incomplete infolvnation systems from the information view of rough set theory. First, by extending information entropy-based measures in complete information systems, two new measures of incomplete entropy and incomplete conditional entropy are presented for incomplete information systems. And then, based on these measures the problem of knowledge reduction in incomplete information systems is analyzed and the reduct definitions in incomplete information system and incomplete decision table are proposed respectively. Finally, the reduct definitions based on incomplete entropy and the reduct definitions based on similarity relation are compared. Two equivalent relationships between them are proved by theorems and an in equivalent relationship between them is illustrated by an example. The work of this paper extends the research of rough set theory from information view to incomplete information systems and establishes the theoretical basis for seeking efficient algorithm of knowledge acquisition in incomplete information systems.