Understanding an image goes beyond recognizing and locating the objects in it,the relationships between objects also very important in image understanding.Most previous methods have focused on recognizing local predic...Understanding an image goes beyond recognizing and locating the objects in it,the relationships between objects also very important in image understanding.Most previous methods have focused on recognizing local predictions of the relationships.But real-world image relationships often determined by the surrounding objects and other contextual information.In this work,we employ this insight to propose a novel framework to deal with the problem of visual relationship detection.The core of the framework is a relationship inference network,which is a recurrent structure designed for combining the global contextual information of the object to infer the relationship of the image.Experimental results on Stanford VRD and Visual Genome demonstrate that the proposed method achieves a good performance both in efficiency and accuracy.Finally,we demonstrate the value of visual relationship on two computer vision tasks:image retrieval and scene graph generation.展开更多
Objective: Information visualization is the study of interactive depictions of abstract and data to strengthen the human cognition. Designing an appropriate information visualization system may be very useful techniqu...Objective: Information visualization is the study of interactive depictions of abstract and data to strengthen the human cognition. Designing an appropriate information visualization system may be very useful technique for scholars, who intent to get scientific information from digital libraries. The objective of current study was to map and visualize the key-information of dissertations in academic libraries. To achieve the aim, an information retrieval system was designed to present the interactive graphic view of dissertations’ subjects in academic. Methods: An information retrieval system was designed by information visualization toolkit that presents the related subjects of dissertations in academic libraries. In addition, the satisfaction-levels of library-users were analyzed by administrating a standard questionnaire (QUIS Questionnaire). Results: The study indicated that the designed IR system helped to provide a user-friendly environment through displaying subjective relations of dissertations, overwhelming variety of colors in displaying information. Fast and easy access to the cover-to-cover information of dissertations and user-interaction facilities are the advantages of designed IR. Analysis of data furthermore indicated that the users’ satisfaction from the system was from medium to high grade. Conclusion: Designing the IR-system revealed an excessive influence on users’ satisfaction;therefore, proposing such systems for employing in academic libraries is very suitable and its implementation is necessary.展开更多
In medical research and clinical diagnosis, automated or computer-assisted classification and retrieval methods are highly desirable to offset the high cost of manual classification and manipulation by medical experts...In medical research and clinical diagnosis, automated or computer-assisted classification and retrieval methods are highly desirable to offset the high cost of manual classification and manipulation by medical experts. To facilitate the decision-making in the health-care and the related areas, in this paper, a two-step content-based medical image retrieval algorithm is proposed. Firstly, in the preprocessing step, the image segmentation is performed to distinguish image objects, and on the basis of the ...展开更多
Neural attention-based encoders,which effectively attend sentence tokens to their associated context without being restricted by long-term distance or dependency,have demonstrated outstanding performance in embedding ...Neural attention-based encoders,which effectively attend sentence tokens to their associated context without being restricted by long-term distance or dependency,have demonstrated outstanding performance in embedding sentences into meaningful representations(embeddings).The Universal Sentence Encoder(USE)is one of the most well-recognized deep neural network(DNN)based solutions,which is facilitated with an attention-driven transformer architecture and has been pre-trained on a large number of sentences from the Internet.Besides the fact that USE has been widely used in many downstream applications,including information retrieval(IR),interpreting its complicated internal working mechanism remains challenging.In this work,we present a visual analytics solution towards addressing this challenge.Specifically,focused on semantics and syntactics(concepts and relations)that are critical to domain clinical IR,we designed and developed a visual analytics system,i.e.,USEVis.The system investigates the power of USE in effectively extracting sentences’semantics and syntactics through exploring and interpreting how linguistic properties are captured by attentions.Furthermore,by thoroughly examining and comparing the inherent patterns of these attentions,we are able to exploit attentions to retrieve sentences/documents that have similar semantics or are closely related to a given clinical problem in IR.By collaborating with domain experts,we demonstrate use cases with inspiring findings to validate the contribution of our work and the effectiveness of our system.展开更多
文摘Understanding an image goes beyond recognizing and locating the objects in it,the relationships between objects also very important in image understanding.Most previous methods have focused on recognizing local predictions of the relationships.But real-world image relationships often determined by the surrounding objects and other contextual information.In this work,we employ this insight to propose a novel framework to deal with the problem of visual relationship detection.The core of the framework is a relationship inference network,which is a recurrent structure designed for combining the global contextual information of the object to infer the relationship of the image.Experimental results on Stanford VRD and Visual Genome demonstrate that the proposed method achieves a good performance both in efficiency and accuracy.Finally,we demonstrate the value of visual relationship on two computer vision tasks:image retrieval and scene graph generation.
文摘Objective: Information visualization is the study of interactive depictions of abstract and data to strengthen the human cognition. Designing an appropriate information visualization system may be very useful technique for scholars, who intent to get scientific information from digital libraries. The objective of current study was to map and visualize the key-information of dissertations in academic libraries. To achieve the aim, an information retrieval system was designed to present the interactive graphic view of dissertations’ subjects in academic. Methods: An information retrieval system was designed by information visualization toolkit that presents the related subjects of dissertations in academic libraries. In addition, the satisfaction-levels of library-users were analyzed by administrating a standard questionnaire (QUIS Questionnaire). Results: The study indicated that the designed IR system helped to provide a user-friendly environment through displaying subjective relations of dissertations, overwhelming variety of colors in displaying information. Fast and easy access to the cover-to-cover information of dissertations and user-interaction facilities are the advantages of designed IR. Analysis of data furthermore indicated that the users’ satisfaction from the system was from medium to high grade. Conclusion: Designing the IR-system revealed an excessive influence on users’ satisfaction;therefore, proposing such systems for employing in academic libraries is very suitable and its implementation is necessary.
文摘In medical research and clinical diagnosis, automated or computer-assisted classification and retrieval methods are highly desirable to offset the high cost of manual classification and manipulation by medical experts. To facilitate the decision-making in the health-care and the related areas, in this paper, a two-step content-based medical image retrieval algorithm is proposed. Firstly, in the preprocessing step, the image segmentation is performed to distinguish image objects, and on the basis of the ...
文摘Neural attention-based encoders,which effectively attend sentence tokens to their associated context without being restricted by long-term distance or dependency,have demonstrated outstanding performance in embedding sentences into meaningful representations(embeddings).The Universal Sentence Encoder(USE)is one of the most well-recognized deep neural network(DNN)based solutions,which is facilitated with an attention-driven transformer architecture and has been pre-trained on a large number of sentences from the Internet.Besides the fact that USE has been widely used in many downstream applications,including information retrieval(IR),interpreting its complicated internal working mechanism remains challenging.In this work,we present a visual analytics solution towards addressing this challenge.Specifically,focused on semantics and syntactics(concepts and relations)that are critical to domain clinical IR,we designed and developed a visual analytics system,i.e.,USEVis.The system investigates the power of USE in effectively extracting sentences’semantics and syntactics through exploring and interpreting how linguistic properties are captured by attentions.Furthermore,by thoroughly examining and comparing the inherent patterns of these attentions,we are able to exploit attentions to retrieve sentences/documents that have similar semantics or are closely related to a given clinical problem in IR.By collaborating with domain experts,we demonstrate use cases with inspiring findings to validate the contribution of our work and the effectiveness of our system.
