A Novel Multivalued Associative Memory System

Globally coupled map (GCM) model can evolve through chaotic searching into several stable periodic orbits under properly controlled parameters. This can be exploited in information processing such as associative memory and optimization. In this paper, we propose a novel covariance learning rule for multivalue patterns and apply it in memorization of gray scale images based on modified GCM model (S GCM). Analysis of retrieval results are given finally.

DISCRETE BIDIRECTIONAL ASSOCIATIVE MEMORY WITH LEARNING FUNCTION

In this paper we propose a new discrete bidirectional associative memory (DBAM) which is derived from our previous continuous linear bidirectional associative memory (LBAM). The DBAM performs bidirectionally the optimal associative mapping proposed by Kohonen. Like LBAM and NBAM proposed by one of the present authors,the present BAM ensures the guaranteed recall of all stored patterns,and possesses far higher capacity compared with other existing BAMs,and like NBAM, has the strong ability to suppress the noise occurring in the output patterns and therefore reduce largely the spurious patterns. The derivation of DBAM is given and the stability of DBAM is proved. We also derive a learning algorithm for DBAM,which has iterative form and make the network learn new patterns easily. Compared with NBAM the present BAM can be easily implemented by software.

BIDIRECTIONAL ASSOCIATIVE MEMORY ENSEMBLE

The multiple classifier system （MCS）, composed of multiple diverse classifiers or feed-forward neural networks, can significantly improve the classification or generalization ability of a single classifier. Enlightened by the fundamental idea of MCS, the ensemble is introduced into the quick learning for bidirectional associative memory （QLBAM） to construct a BAM ensemble, for improving the storage capacity and the error-correction capability without destroying the simple structure of the component BAM. Simulations show that, with an appropriate ＂overproduce and choose＂ strategy or ＂thinning＂ algorithm, the proposed BAM ensemble significantly outperforms the single QLBAM in both storage capacity and noise-tolerance capability.

STABILITY OF BIDIRECTIONAL ASSOCIATIVE MEMORY NEURAL NETWORKS WITH DELAYS

In this paper the globally asymptotic stability of more general two-layer nonlinear feedback associative memory neural networks with time delays is examined. The sufficient conditions of existence, uniqueness and globally asymptotic stability of the equilibrum position are given. Finally, two interesting examples to illustrate the theory are given.

QUALITATIVE ANALYSIS OF BIDIRECTIONAL ASSOCIATIVE MEMORY NEURAL NETWORKS

In this paper, the global exponential stability of an equilibrium position for general bidirectional associative memory neural networks are studied. The sufficient conditions of existence and uniqueness of the equilibrium position are given. The method of energy function is examined. Two examples are given to illustrate the theory.

Multi-Valued Associative Memory Neural Network

A novel learning method for multi-valued associative memory network is introduced, which is based on Hebb rule, but utilizes more information. According to the current probe vector, the connection weights matrix could be chosen dynamically. Double-valued and multi-valued associative memory are all realized in our simulation experiment. The experimental results show that the method could enhance the associative success rate.

CHAOTIC NEURAL NETWORK FOR ASSOCIATIVE MEMORY

Based on current research on applications of chaotic neuron network for information processing, the stability and convergence of chaotic neuron network are proved from the viewpoint of energy function. Moreover, a new auto-associative matrix is devised for artificial neural network composed of chaotic neurons, thus, an improved chaotic neuron network for associative memory is built up. Finally, the associative recalling process of the network is analyzed in detail and explanations of improvement are given.

Synthesization of high-capacity auto-associative memories using complex-valued neural networks

In this paper, a novel design procedure is proposed for synthesizing high-capacity auto-associative memories based on complex-valued neural networks with real-imaginary-type activation functions and constant delays. Stability criteria dependent on external inputs of neural networks are derived. The designed networks can retrieve the stored patterns by external inputs rather than initial conditions. The derivation can memorize the desired patterns with lower-dimensional neural networks than real-valued neural networks, and eliminate spurious equilibria of complex-valued neural networks. One numerical example is provided to show the effectiveness and superiority of the presented results.

ESTIMATION OF ATTRACTION DOMAIN AND EXPONENTIAL CONVERGENCE RATE OF CONTINUOUS FEEDBACK ASSOCIATIVE MEMORY AND ITS APPLICATIONS

The attraction domains of memory patterns and exponential convergence rate of the network trajectories to memory patterns for continuous feedback associative memory are estimated. These results can be used for evaluation of error-correction capability and the synthesis procedures for continuous-time associative memory neural networks.

Properties and Stability of Max-Product Fuzzy Bi-Directional Associative Memory

In this paper, a fuzzy operator of max-product is defined at first, and the fuzzy bi-directional associative memory (FBAM) based on the fuzzy operator of max-product is given. Then the properties and the Lyapunov stability of equilibriums of the networks are studied.

A UNIFIED BIDIRECTIONAL ASSOCIATIVEMEMORY MODEL

A unified bidirectional associative memory model (UBAM) isproposed- Its two special cases, UHOBAM and UEBAM, are the modifica-tions of intraconnected BAM (IBAM) and higher-order BAM (HOBAM),exponential BAM (EBAM) and modified exponential BAM (MEBAM) , re-

NEW EXPONENTIAL BIDIRECTIONAL ASSOCIATIVE MEMORY

A new exponential bidirectional associative memory model is introduced. It offers an even better recall performance than the modified exponential bidirectional associative memory (MEBAM). Only a little complexity of realization is spent for the improvement.

SOME STATISTICAL ANALYSIS OF THE RECALL PROBABILITY OF PARALLEL INTRACONNECTED BIDIRECTIONAL ASSOCIATIVE MEMORY

This paper addressed a statistical analysis for the recall of parallel intraconnected bidirectional associative memory-Modified Intraconnected Bidirectional Associative Memory (MIBAM) and proved the conclusions: two MIBAM with the equal total number of neurons have the equal recalling probability for m pairs of stored pattern pairs if m is not too large. So they have the same capacity and same error correcting ability, i. e., their performances are statistically equivalent. The results of simulation support the conclusions well.

Comments on″Capacity Analysis of the Asymptotically Stable Multi-Valued Exponential Bidirectinal Associative Memory″

Asymptotical stability is an important property of the associative memory neural networks.In this comment,we demonstrate that the asymptotical stability analyses of the MVECAM and MV-eBAM in the asynchronous update mode by Wang et al are not rigorous,and then we modify the errors and further prove that the two models are all asymptotically stable in both synchronous and asynchronous update modes.

Double-pattern associative memory neural network with pattern loop

A double-pattern associative memory neural network with “pattern loop” is proposed. It can store 2N bit bipolar binary patterns up to the order of 2 2N , retrieve part or all of the stored patterns which all have the minimum Hamming distance with input pattern, completely eliminate spurious patterns, and has higher storing efficiency and reliability than conventional associative memory. The length of a pattern stored in this associative memory can be easily extended from 2N to kN.

A NEW BIDIRECTIONAL ASSOCIATIVE MEMORY MODEL-HOMIBAM

A new bidirectional associative memory model named as HOMIBAM is introduced. The relationships of HOMIBAM with the models existed are pointed out. Both theoretical analysis and simulations show that the capacity and recall performance of HOMIBAM are superior to that of modified intraconnected BAM (MIBAM), higher-order BAM (HOBAM ) greatly.

GLOBAL DYNAMICS OF DELAYED BIDIRECTIONAL ASSOCIATIVE MEMORY (BAM) NEURAL NETWORKS

Without assuming the smoothness,monotonicity and boundedness of the activation functions, some novel criteria on the existence and global exponential stability of equilibrium point for delayed bidirectional associative memory (BAM) neural networks are established by applying the Liapunov functional methods and matrix_algebraic techniques. It is shown that the new conditions presented in terms of a nonsingular M matrix described by the networks parameters,the connection matrix and the Lipschitz constant of the activation functions,are not only simple and practical,but also easier to check and less conservative than those imposed by similar results in recent literature.

A Hopfield-like hippocampal CA3 neural network model for studying associative memory in Alzheimer's disease

Associative memory, one of the major cognitive functions in the hippocampal CA3 region, includes auto-associative memory and hetero-associative memory. Many previous studies have shown that Alzheimer＇s disease （AD） can lead to loss of functional synapses in the central nervous system, and associative memory functions in patients with AD are often impaired, but few studies have addressed the effect of AD on hetero-associative memory in the hippocampal CA3 region. In this study, based on a simplified anatomical structure and synaptic connections in the hippocampal CA3 region, a three-layered Hopfield-like neural network model of hippocampal CA3 was proposed and then used to simulate associative memory functions in three circumstances： normal, synaptic deletion and synaptic compensation, according to Ruppin＇s synaptic deletion and compensation theory. The influences of AD on hetero-associative memory were further analyzed. The simulated results showed that the established three-layered Hopfield-like neural network model of hippocampal CA3 has both auto-associative and hetero-associative memory functions. With increasing synaptic deletion level, both associative memory functions were gradually impaired and the mean firing rates of the neurons within the network model were decreased. With gradual increasing synaptic compensation, the associative memory functions of the network were improved and the mean firing rates were increased. The simulated results suggest that the Hopfield-like neural network model can effectively simulate both associative memory functions of the hippocampal CA3 region. Synaptic deletion affects both auto-associative and hetero-associative memory functions in the hippocampal CA3 region, and can also result in memory dysfunction. To some extent, synaptic compensation measures can offset two kinds of associative memory dysfunction caused by synaptic deletion in the hippocampal CA3 area.

Memory Chain in a Chaotic Autoassociative Neural Network

Memory chain is observed in a chaotic autoassociative neural network. The network recalls first stored pattern from a fragment of a memory, stays at this pattern for a while, transits to the second stored pattern that overlaps with the first recalled pattern.Then it stays at the second recalled pattern for a while, transits to the third stored pattern that overlaps with the second recalled pattern, and so on. Thus a memory chain is generated. The memory chain ends with the pattern that overlaps no other stored patten. This phenomenon is similar to the way of recalling process of human beings in some respects.

Using Quantum Associative Memory to Simulate the Brain Functions

To simulate the brain functions,a quantum associative memory combined with information preprocessing by a sparse coding model is presented. The sparse coding scheme is used to simulate the information transformation from retina up to primary visual cortex (V1) along the visual path and the quantum associative memory is used to simulate the pattern processing functions of the brain such as the pattern storing,forgetting and retrieving. Experimental results show that the model exhibits good associative ability on face recognition. Considering the huge storage capacity,mass parallel-distributed processing ability and oscillatory phenomena of the quantum system,this model might be a biological plausible implementation.