To reuse and share the valuable knowledge embedded in repositories of engineering models for accelerating the design process, improving product quality, and reducing costs, it is crucial to devise search engines capab...To reuse and share the valuable knowledge embedded in repositories of engineering models for accelerating the design process, improving product quality, and reducing costs, it is crucial to devise search engines capable of matching 3D models efficiently and effectively. In this paper, an enhanced shape distributions-based technique of using geometrical and topological information to search 3D engineering models represented by polygonal meshes was presented. A simplification method of polygonal meshes was used to simplify engineering model as the pretreatment for generation of sample points. The method of sampling points was improved and a pair of functions that was more sensitive to shape was employed to construct a 2D shape distribution. Experiments were conducted to evaluate the proposed algorithm utilizing the Engineering Shape Benchmark (ESB) database. The experiential results suggest that the search effectiveness is significantly improved by enforcing the simplification and enhanced shape distributions to engineering model retrieval.展开更多
In this paper, we present a novel Support Vector Machine active learning algorithm for effective 3D model retrieval using the concept of relevance feedback. The proposed method learns from the most informative objects...In this paper, we present a novel Support Vector Machine active learning algorithm for effective 3D model retrieval using the concept of relevance feedback. The proposed method learns from the most informative objects which are marked by the user, and then creates a boundary separating the relevant models from irrelevant ones. What it needs is only a small number of 3D models labelled by the user. It can grasp the user's semantic knowledge rapidly and accurately. Experimental results showed that the proposed algorithm significantly improves the retrieval effectiveness. Compared with four state-of-the-art query refinement schemes for 3D model retrieval, it provides superior retrieval performance after no more than two rounds of relevance feedback.展开更多
Content-based 3D model retrieval is of great help to facilitate the reuse of existing designs and to inspire designers during conceptual design. However, there is still a gap to apply it in industry due to the low tim...Content-based 3D model retrieval is of great help to facilitate the reuse of existing designs and to inspire designers during conceptual design. However, there is still a gap to apply it in industry due to the low time efficiency. This paper presents two new methods with high efficiency to build a Content-based 3D model retrieval system. First, an improvement is made on the "Shape Distribution (D2)" algorithm, and a new algorithm named "Quick D2" is proposed. Four sample 3D mechanical models are used in an experiment to compare the time cost of the two algorithms. The result indicates that the time cost of Quick D2 is much lower than that of D2, while the descriptors extracted by the two algorithms are almost the same. Second, an expandable 3D model repository index method with high performance, namely, RBK index, is presented. On the basis of RBK index, the search space is pruned effectively during the search process, leading to a speed up of the whole system. The factors that influence the values of the key parameters of RBK index are discussed and an experimental method to find the optimal values of the key parameters is given. Finally, "3D Searcher", a content-based 3D model retrieval system is developed. By using the methods proposed, the time cost for the system to respond one query online is reduced by 75% on average. The system has been implemented in a manufacturing enterprise, and practical query examples during a case of the automobile rear axle design are also shown. The research method presented shows a new research perspective and can effectively improve the content-based 3D model retrieval efficiency.展开更多
3D model retrieval virtual reality applications. In can benefit many downstream this paper, we propose a new sketch-based 3D model retrieval framework by coupling local features and manifold ranking. At technical fron...3D model retrieval virtual reality applications. In can benefit many downstream this paper, we propose a new sketch-based 3D model retrieval framework by coupling local features and manifold ranking. At technical fronts, we exploit spatial pyramids based local structures to facilitate the efficient construction of feature descriptors. Meanwhile, we propose an improved manifold ranking method, wherein all the categories between arbitrary model pairs will be taken into account. Since the smooth and detail-preserving line drawings of 3D model are important for sketch-based 3D model retrieval, the Difference of Gaussians (DOG) method is employed to extract the line drawings over the projected depth images of 3D model, and Bezier Curve is then adopted to further optimize the extracted line drawing. On that basis, we develop a 3D model retrieval engine to verify our method. We have conducted extensive experiments over various public benchmarks, and have made comprehensive comparisons with some state-of-the-art 3D retrieval methods. All the evaluation results based on the widely-used indicators prove the superiority of our method in accuracy, reliability, robustness, and versatility.展开更多
Content-based shape retrieval techniques can facilitate 3D model resource reuse, 3D model modeling, object recognition, and 3D content classification. Recently more and more researchers have attempted to solve the pro...Content-based shape retrieval techniques can facilitate 3D model resource reuse, 3D model modeling, object recognition, and 3D content classification. Recently more and more researchers have attempted to solve the problems of partial retrieval in the domain of computer graphics, vision, CAD, and multimedia. Unfortunately, in the literature, there is little comprehensive discussion on the state-of-the-art methods of partial shape retrieval. In this article we focus on reviewing the partial shape retrieval methods over the last decade, and help novices to grasp latest developments in this field. We first give the definition of partial retrieval and discuss its desirable capabilities. Secondly, we classify the existing methods on partial shape retrieval into three classes by several criteria, describe the main ideas and techniques for each class, and detailedly compare their advantages and limits. We also present several relevant 3D datasets and corresponding evaluation metrics, which are necessary for evaluating partial retrieval performance. Finally, we discuss possible research directions to address partial shape retrieval.展开更多
With the rapid development of Web3 D technologies, sketch-based model retrieval has become an increasingly important challenge, while the application of Virtual Reality and 3 D technologies has made shape retrieval of...With the rapid development of Web3 D technologies, sketch-based model retrieval has become an increasingly important challenge, while the application of Virtual Reality and 3 D technologies has made shape retrieval of furniture over a web browser feasible. In this paper, we propose a learning framework for shape retrieval based on two Siamese VGG-16 Convolutional Neural Networks(CNNs), and a CNN-based hybrid learning algorithm to select the best view for a shape. In this algorithm, the AlexNet and VGG-16 CNN architectures are used to perform classification tasks and to extract features, respectively. In addition, a feature fusion method is used to measure the similarity relation of the output features from the two Siamese networks. The proposed framework can provide new alternatives for furniture retrieval in the Web3 D environment. The primary innovation is in the employment of deep learning methods to solve the challenge of obtaining the best view of 3 D furniture,and to address cross-domain feature learning problems. We conduct an experiment to verify the feasibility of the framework and the results show our approach to be superior in comparison to many mainstream state-of-the-art approaches.展开更多
With the rapid development of photogrammetry,computer vision and three-dimensional(3D)modeling technologies,it is possible to efficiently construct detailed 3D urban models.Accordingly,large corpora of 3D models,such ...With the rapid development of photogrammetry,computer vision and three-dimensional(3D)modeling technologies,it is possible to efficiently construct detailed 3D urban models.Accordingly,large corpora of 3D models,such as the Google 3D Warehouse,are now becoming freely available on the web.How to find the proper 3D urban models is a challenging research issue.In this paper,we join shape descriptors and color descriptors for 3D urban model retrieval.The query objects are localized and segmented automatically from the input images by using a new selective search voting algorithm.Through combining the normalization with the light field descriptor,the Horizontal Light Descriptor is introduced to measure the shape similarity among the normalized urban models.The color descriptors are used to represent the color information of the urban models.The two types of descriptors are joined to search 3D urban models similar to the query objects.Experimental results have shown the effectiveness of our approach.展开更多
In this paper, a content based descriptor is pro- posed to retrieve 3D models, which employs histogram of local orientation (HLO) as a geometric property of the shape. The proposed 3D model descriptor scheme consist...In this paper, a content based descriptor is pro- posed to retrieve 3D models, which employs histogram of local orientation (HLO) as a geometric property of the shape. The proposed 3D model descriptor scheme consists of three steps. In the first step, Poisson equation is utilized to define a 3D model signature. Next, the local orientation is calculated for each voxel of the model using Hessian matrix. As the final step, a histogram-based 3D model descriptor is extracted by accumulating the values of the local orientation in bins. Due to efficiency of Poisson equation in describing the models with various structures, the proposed descriptor is capable of discriminating these models accurately. Since, the inner vox- els have a dominant contribution in the formation of the de- scriptor, sufficient robustness against noise can be achieved. This is because the noise mostly influences the boundary vox- els. Furthermore, we improve the retrieval performance us- ing support vector machine based one-shot score (SVM-OSS) similarity measure, which is more efficient than the conven- tional methods to compute the distance of feature vectors. The rotation normalization is performed employing the prin- cipal component analysis. To demonstrate the applicability of HLO, we implement experimental evaluations of precision- recall curve on ESB, PSB and WM-SHREC databases of 3D models. Experimental results validate the effectiveness of the proposed descriptor compared to some current methods.展开更多
This paper presents Symm Sketch—a system for creating symmetric 3D free-form shapes from 2D sketches. The reconstruction task usually separates a 3D symmetric shape into two types of shape components, that is, the se...This paper presents Symm Sketch—a system for creating symmetric 3D free-form shapes from 2D sketches. The reconstruction task usually separates a 3D symmetric shape into two types of shape components, that is, the self-symmetric shape component and the mutual-symmetric shape components. Each type can be created in an intuitive manner. Using a uniform symmetry plane, the user first draws 2D sketch lines for each shape component on a sketching plane. The z-depth information of the hand-drawn input sketches can be calculated using their property of mirror symmetry to generate 3D construction curves. In order to provide more freedom for controlling the local geometric features of the reconstructed free-form shapes(e.g., non-circular crosssections), our modeling system creates each shape component from four construction curves. Using one pair of symmetric curves and one pair of general curves, an improved cross-sectional surface blending scheme is applied to generate a parametric surface for each component. The final symmetric free-form shape is progressively created, and is represented by 3D triangular mesh. Experimental results illustrate that our system can generate complex symmetric free-form shapes effectively and conveniently.展开更多
In this paper,we explore the use of the diffusion geometry framework for the fusion of geometric and photometric information in local and global shape descriptors.Our construction is based on the definition of a diffu...In this paper,we explore the use of the diffusion geometry framework for the fusion of geometric and photometric information in local and global shape descriptors.Our construction is based on the definition of a diffusion process on the shape manifold embedded into a high-dimensional space where the embedding coordinates represent the photometric information.Experimental results show that such data fusion is useful in coping with different challenges of shape analysis where pure geometric and pure photometric methods fail.展开更多
基金The Basic Research of COSTIND,China (No.D0420060521)
文摘To reuse and share the valuable knowledge embedded in repositories of engineering models for accelerating the design process, improving product quality, and reducing costs, it is crucial to devise search engines capable of matching 3D models efficiently and effectively. In this paper, an enhanced shape distributions-based technique of using geometrical and topological information to search 3D engineering models represented by polygonal meshes was presented. A simplification method of polygonal meshes was used to simplify engineering model as the pretreatment for generation of sample points. The method of sampling points was improved and a pair of functions that was more sensitive to shape was employed to construct a 2D shape distribution. Experiments were conducted to evaluate the proposed algorithm utilizing the Engineering Shape Benchmark (ESB) database. The experiential results suggest that the search effectiveness is significantly improved by enforcing the simplification and enhanced shape distributions to engineering model retrieval.
基金the National Basic Research Program (973) of China (No. 2004CB719401)the National Research Foundation for the Doctoral Program of Higher Education of China (No.20060003060)
文摘In this paper, we present a novel Support Vector Machine active learning algorithm for effective 3D model retrieval using the concept of relevance feedback. The proposed method learns from the most informative objects which are marked by the user, and then creates a boundary separating the relevant models from irrelevant ones. What it needs is only a small number of 3D models labelled by the user. It can grasp the user's semantic knowledge rapidly and accurately. Experimental results showed that the proposed algorithm significantly improves the retrieval effectiveness. Compared with four state-of-the-art query refinement schemes for 3D model retrieval, it provides superior retrieval performance after no more than two rounds of relevance feedback.
基金supported by National Natural Science Foundation of China(Grant No. 51175287)National Science and Technology Major Project(Grant No. 2011ZX02403)
文摘Content-based 3D model retrieval is of great help to facilitate the reuse of existing designs and to inspire designers during conceptual design. However, there is still a gap to apply it in industry due to the low time efficiency. This paper presents two new methods with high efficiency to build a Content-based 3D model retrieval system. First, an improvement is made on the "Shape Distribution (D2)" algorithm, and a new algorithm named "Quick D2" is proposed. Four sample 3D mechanical models are used in an experiment to compare the time cost of the two algorithms. The result indicates that the time cost of Quick D2 is much lower than that of D2, while the descriptors extracted by the two algorithms are almost the same. Second, an expandable 3D model repository index method with high performance, namely, RBK index, is presented. On the basis of RBK index, the search space is pruned effectively during the search process, leading to a speed up of the whole system. The factors that influence the values of the key parameters of RBK index are discussed and an experimental method to find the optimal values of the key parameters is given. Finally, "3D Searcher", a content-based 3D model retrieval system is developed. By using the methods proposed, the time cost for the system to respond one query online is reduced by 75% on average. The system has been implemented in a manufacturing enterprise, and practical query examples during a case of the automobile rear axle design are also shown. The research method presented shows a new research perspective and can effectively improve the content-based 3D model retrieval efficiency.
基金The authors would like to thank Zhang Dongdong for his great help in experiments. This work was supported by the National Natural Science Foundation of China (Grant No. 61602324), the Scientific Research Project of Beijing Educational Committeen (KM201710028018), the open funding project of State Key Laboratory of Virtual Reality Technology and Systems, Beihang University (BUAA-VR-17KF-12) and Beijing Advanced Innovation Center for Imaging Technology (BAlCIT-2016004).
文摘3D model retrieval virtual reality applications. In can benefit many downstream this paper, we propose a new sketch-based 3D model retrieval framework by coupling local features and manifold ranking. At technical fronts, we exploit spatial pyramids based local structures to facilitate the efficient construction of feature descriptors. Meanwhile, we propose an improved manifold ranking method, wherein all the categories between arbitrary model pairs will be taken into account. Since the smooth and detail-preserving line drawings of 3D model are important for sketch-based 3D model retrieval, the Difference of Gaussians (DOG) method is employed to extract the line drawings over the projected depth images of 3D model, and Bezier Curve is then adopted to further optimize the extracted line drawing. On that basis, we develop a 3D model retrieval engine to verify our method. We have conducted extensive experiments over various public benchmarks, and have made comprehensive comparisons with some state-of-the-art 3D retrieval methods. All the evaluation results based on the widely-used indicators prove the superiority of our method in accuracy, reliability, robustness, and versatility.
基金supported by the National Natural Science Foundation of China under Grant Nos. 61003137, 61202185, 61005018,91120005the Fundamental Fund of Research of Northwestern Polytechnical University of China under Grant Nos. JC201202,JC201220,JC20120237+2 种基金the Natural Science Foundation of Shaanxi Province of China under Grant No. 2012JQ8037the Open Fund from the State Key Lab of CAD&CG of Zhejiang University of Chinathe Program for New Century Excellent Talents in University of China under grant No. NCET-10-0079
文摘Content-based shape retrieval techniques can facilitate 3D model resource reuse, 3D model modeling, object recognition, and 3D content classification. Recently more and more researchers have attempted to solve the problems of partial retrieval in the domain of computer graphics, vision, CAD, and multimedia. Unfortunately, in the literature, there is little comprehensive discussion on the state-of-the-art methods of partial shape retrieval. In this article we focus on reviewing the partial shape retrieval methods over the last decade, and help novices to grasp latest developments in this field. We first give the definition of partial retrieval and discuss its desirable capabilities. Secondly, we classify the existing methods on partial shape retrieval into three classes by several criteria, describe the main ideas and techniques for each class, and detailedly compare their advantages and limits. We also present several relevant 3D datasets and corresponding evaluation metrics, which are necessary for evaluating partial retrieval performance. Finally, we discuss possible research directions to address partial shape retrieval.
基金supported in part by the Fundamental Research Funds for the Central Universities in China (No. 2100219066)the Key Fundamental Research Funds for the Central Universities in China (No. 0200219153)
文摘With the rapid development of Web3 D technologies, sketch-based model retrieval has become an increasingly important challenge, while the application of Virtual Reality and 3 D technologies has made shape retrieval of furniture over a web browser feasible. In this paper, we propose a learning framework for shape retrieval based on two Siamese VGG-16 Convolutional Neural Networks(CNNs), and a CNN-based hybrid learning algorithm to select the best view for a shape. In this algorithm, the AlexNet and VGG-16 CNN architectures are used to perform classification tasks and to extract features, respectively. In addition, a feature fusion method is used to measure the similarity relation of the output features from the two Siamese networks. The proposed framework can provide new alternatives for furniture retrieval in the Web3 D environment. The primary innovation is in the employment of deep learning methods to solve the challenge of obtaining the best view of 3 D furniture,and to address cross-domain feature learning problems. We conduct an experiment to verify the feasibility of the framework and the results show our approach to be superior in comparison to many mainstream state-of-the-art approaches.
基金supported by the National Natural Science Foundation of China[Grant 41371324].
文摘With the rapid development of photogrammetry,computer vision and three-dimensional(3D)modeling technologies,it is possible to efficiently construct detailed 3D urban models.Accordingly,large corpora of 3D models,such as the Google 3D Warehouse,are now becoming freely available on the web.How to find the proper 3D urban models is a challenging research issue.In this paper,we join shape descriptors and color descriptors for 3D urban model retrieval.The query objects are localized and segmented automatically from the input images by using a new selective search voting algorithm.Through combining the normalization with the light field descriptor,the Horizontal Light Descriptor is introduced to measure the shape similarity among the normalized urban models.The color descriptors are used to represent the color information of the urban models.The two types of descriptors are joined to search 3D urban models similar to the query objects.Experimental results have shown the effectiveness of our approach.
文摘In this paper, a content based descriptor is pro- posed to retrieve 3D models, which employs histogram of local orientation (HLO) as a geometric property of the shape. The proposed 3D model descriptor scheme consists of three steps. In the first step, Poisson equation is utilized to define a 3D model signature. Next, the local orientation is calculated for each voxel of the model using Hessian matrix. As the final step, a histogram-based 3D model descriptor is extracted by accumulating the values of the local orientation in bins. Due to efficiency of Poisson equation in describing the models with various structures, the proposed descriptor is capable of discriminating these models accurately. Since, the inner vox- els have a dominant contribution in the formation of the de- scriptor, sufficient robustness against noise can be achieved. This is because the noise mostly influences the boundary vox- els. Furthermore, we improve the retrieval performance us- ing support vector machine based one-shot score (SVM-OSS) similarity measure, which is more efficient than the conven- tional methods to compute the distance of feature vectors. The rotation normalization is performed employing the prin- cipal component analysis. To demonstrate the applicability of HLO, we implement experimental evaluations of precision- recall curve on ESB, PSB and WM-SHREC databases of 3D models. Experimental results validate the effectiveness of the proposed descriptor compared to some current methods.
基金supported by the National Natural Science Foundation of China under Grant Nos. 61272309 and 61303138
文摘This paper presents Symm Sketch—a system for creating symmetric 3D free-form shapes from 2D sketches. The reconstruction task usually separates a 3D symmetric shape into two types of shape components, that is, the self-symmetric shape component and the mutual-symmetric shape components. Each type can be created in an intuitive manner. Using a uniform symmetry plane, the user first draws 2D sketch lines for each shape component on a sketching plane. The z-depth information of the hand-drawn input sketches can be calculated using their property of mirror symmetry to generate 3D construction curves. In order to provide more freedom for controlling the local geometric features of the reconstructed free-form shapes(e.g., non-circular crosssections), our modeling system creates each shape component from four construction curves. Using one pair of symmetric curves and one pair of general curves, an improved cross-sectional surface blending scheme is applied to generate a parametric surface for each component. The final symmetric free-form shape is progressively created, and is represented by 3D triangular mesh. Experimental results illustrate that our system can generate complex symmetric free-form shapes effectively and conveniently.
基金The author would like to thank the referees for the helpful suggestionsThis work has been supported in part by the Israeli Science Foundation grant 615/11,the German-Israeli Foundation grant 2269/2010the Swiss High Performance and High Productivity Computing(HP2C)grant and grant agreement No.267414 of European Community’s FP7-ERC program.
文摘In this paper,we explore the use of the diffusion geometry framework for the fusion of geometric and photometric information in local and global shape descriptors.Our construction is based on the definition of a diffusion process on the shape manifold embedded into a high-dimensional space where the embedding coordinates represent the photometric information.Experimental results show that such data fusion is useful in coping with different challenges of shape analysis where pure geometric and pure photometric methods fail.