Cross-modal semantic mapping and cross-media retrieval are key problems of the multimedia search engine.This study analyzes the hierarchy,the functionality,and the structure in the visual and auditory sensations of co...Cross-modal semantic mapping and cross-media retrieval are key problems of the multimedia search engine.This study analyzes the hierarchy,the functionality,and the structure in the visual and auditory sensations of cognitive system,and establishes a brain-like cross-modal semantic mapping framework based on cognitive computing of visual and auditory sensations.The mechanism of visual-auditory multisensory integration,selective attention in thalamo-cortical,emotional control in limbic system and the memory-enhancing in hippocampal were considered in the framework.Then,the algorithms of cross-modal semantic mapping were given.Experimental results show that the framework can be effectively applied to the cross-modal semantic mapping,and also provides an important significance for brain-like computing of non-von Neumann structure.展开更多
The correct use of information in science and technology is very important for its progress. Nowadays, the equipment used for the scientific and technological development provides results that are later interpreted by...The correct use of information in science and technology is very important for its progress. Nowadays, the equipment used for the scientific and technological development provides results that are later interpreted by the researchers, in most of the above mentioned equipment the results are images full of information which has to be analyzed. A powerful stage with multiple benefits in this field is the image pre-processing by means of intelligent systems, which are capable to do image analysis throwing very useful results that enhance the scientific and technological information. There are currently more than 500 functions in the computational vision specialized open source library OpenCV, which associated with the C++ programming language. These functions are used for application development in many areas of computer vision such as products inspection, medical images, safety, user's interfaces, camera calibration, stereoscopic vision and robotics. In this development and research work, by using the available functions and modifying the exposed methods, we present a proposal for signal detection in images originated in the transmission electron microscope (known as diffraction patterns), which are attached to the detailed analysis of crystalline structures used in the study of the materials science, the results show a profit of at least 18% in the detection of signs by means of the method proposed in this work.展开更多
基金Supported by the National Natural Science Foundation of China(No.61305042,61202098)Projects of Center for Remote Sensing Mission Study of China National Space Administration(No.2012A03A0939)Science and Technological Research of Key Projects of Education Department of Henan Province of China(No.13A520071)
文摘Cross-modal semantic mapping and cross-media retrieval are key problems of the multimedia search engine.This study analyzes the hierarchy,the functionality,and the structure in the visual and auditory sensations of cognitive system,and establishes a brain-like cross-modal semantic mapping framework based on cognitive computing of visual and auditory sensations.The mechanism of visual-auditory multisensory integration,selective attention in thalamo-cortical,emotional control in limbic system and the memory-enhancing in hippocampal were considered in the framework.Then,the algorithms of cross-modal semantic mapping were given.Experimental results show that the framework can be effectively applied to the cross-modal semantic mapping,and also provides an important significance for brain-like computing of non-von Neumann structure.
文摘The correct use of information in science and technology is very important for its progress. Nowadays, the equipment used for the scientific and technological development provides results that are later interpreted by the researchers, in most of the above mentioned equipment the results are images full of information which has to be analyzed. A powerful stage with multiple benefits in this field is the image pre-processing by means of intelligent systems, which are capable to do image analysis throwing very useful results that enhance the scientific and technological information. There are currently more than 500 functions in the computational vision specialized open source library OpenCV, which associated with the C++ programming language. These functions are used for application development in many areas of computer vision such as products inspection, medical images, safety, user's interfaces, camera calibration, stereoscopic vision and robotics. In this development and research work, by using the available functions and modifying the exposed methods, we present a proposal for signal detection in images originated in the transmission electron microscope (known as diffraction patterns), which are attached to the detailed analysis of crystalline structures used in the study of the materials science, the results show a profit of at least 18% in the detection of signs by means of the method proposed in this work.