Augmented reality is the merging of synthetic sensory information into a user's perception of a real environment. As one of the most important tasks in augmented scene modeling, terrain simplification research has...Augmented reality is the merging of synthetic sensory information into a user's perception of a real environment. As one of the most important tasks in augmented scene modeling, terrain simplification research has gained more and more attention. In this paper, we mainly focus on point selection problem in terrain simplification using triangulated irregular network. Based on the analysis and comparison of traditional importance measures for each input point, we put forward a new importance measure based on local entropy. The results demonstrate that the local entropy criterion has a better performance than any traditional methods. In addition, it can effectively conquer the 'short-sight' problem associated with the traditional methods.展开更多
This paper presents a method for structured scene modeling using micro stereo vision system with large field of view. The proposed algorithm includes edge detection with Canny detector, line fitting with principle axi...This paper presents a method for structured scene modeling using micro stereo vision system with large field of view. The proposed algorithm includes edge detection with Canny detector, line fitting with principle axis based approach, finding corresponding lines using feature based matching method, and 3D line depth computation.展开更多
Well-designed indoor scenes incorporate interior design knowledge,which has been an essential prior for most indoor scene modeling methods.However,the layout qualities of indoor scene datasets are often uneven,and mos...Well-designed indoor scenes incorporate interior design knowledge,which has been an essential prior for most indoor scene modeling methods.However,the layout qualities of indoor scene datasets are often uneven,and most existing data-driven methods do not differentiate indoor scene examples in terms of quality.In this work,we aim to explore an approach that leverages datasets with differentiated indoor scene examples for indoor scene modeling.Our solution conducts subjective evaluations on lightweight datasets having various room configurations and furniture layouts,via pairwise comparisons based on fuzzy set theory.We also develop a system to use such examples to guide indoor scene modeling using user-specified objects.Specifically,we focus on object groups associated with certain human activities,and define room features to encode the relations between the position and direction of an object group and the room configuration.To perform indoor scene modeling,given an empty room,our system first assesses it in terms of the user-specified object groups,and then places associated objects in the room guided by the assessment results.A series of experimental results and comparisons to state-of-the-art indoor scene synthesis methods are presented to validate the usefulness and effectiveness of our approach.展开更多
3D scene modeling has long been a fundamental problem in computer graphics and computer vision. With the popularity of consumer-level RGB-D cameras,there is a growing interest in digitizing real-world indoor 3D scenes...3D scene modeling has long been a fundamental problem in computer graphics and computer vision. With the popularity of consumer-level RGB-D cameras,there is a growing interest in digitizing real-world indoor 3D scenes. However,modeling indoor3 D scenes remains a challenging problem because of the complex structure of interior objects and poor quality of RGB-D data acquired by consumer-level sensors.Various methods have been proposed to tackle these challenges. In this survey,we provide an overview of recent advances in indoor scene modeling techniques,as well as public datasets and code libraries which can facilitate experiments and evaluation.展开更多
With the support of edge computing,the synergy and collaboration among central cloud,edge cloud,and terminal devices form an integrated computing ecosystem known as the cloud-edge-client architecture.This integration ...With the support of edge computing,the synergy and collaboration among central cloud,edge cloud,and terminal devices form an integrated computing ecosystem known as the cloud-edge-client architecture.This integration unlocks the value of data and computational power,presenting significant opportunities for large-scale 3D scene modeling and XR presentation.In this paper,we explore the perspectives and highlight new challenges in 3D scene modeling and XR presentation based on point cloud within the cloud-edge-client integrated architecture.We also propose a novel cloud-edge-client integrated technology framework and a demonstration of municipal governance application to address these challenges.展开更多
Creating proper 3D models plays an important pole in the development of scene simulation system based on multigen creator and Vega software. However, it is very difficult to construct complex structures by multigen cr...Creating proper 3D models plays an important pole in the development of scene simulation system based on multigen creator and Vega software. However, it is very difficult to construct complex structures by multigen creator. In this paper, an approach is proposed which is utilizing 3dsmax as assistant modeling software. 3D models developed in 3dsmax could be saved in 3ds format and then imported into multigen creator software. The models are revised and then saved in fit format by creator. For reducing model's data, simplification strategy is proposed. The problem of constructing complex models in creator is solved smoothly. In the development of digital rocket simulation project, the models constructed by this method have good visual effect, small size, and could be driven by Vega correctly.展开更多
For target detection algorithm under global motion scene, this paper suggests a target detection algorithm based on motion attention fusion model. Firstly, the motion vector field is pre-processed by accumulation and ...For target detection algorithm under global motion scene, this paper suggests a target detection algorithm based on motion attention fusion model. Firstly, the motion vector field is pre-processed by accumulation and median filter;Then, according to the temporal and spatial character of motion vector, the attention fusion model is defined, which is used to detect moving target;Lastly, the edge of video moving target is made exactly by morphologic operation and edge tracking algorithm. The experimental results of different global motion video sequences show the proposed algorithm has a better veracity and speedup than other algorithm.展开更多
The increasing scale and complexity of 3D scene design work urge an efficient way to understand the design in multi-disciplinary team and exploit the experiences and underlying knowledge in previous works for reuse.Ho...The increasing scale and complexity of 3D scene design work urge an efficient way to understand the design in multi-disciplinary team and exploit the experiences and underlying knowledge in previous works for reuse.However the previous researches lack of concerning on relationship maintaining and design reuse in knowledge level.We propose a novel semantic driven design reuse system,including a property computation algorithm that enables our system to compute the properties while modeling process to maintain the semantic consistency,and a vertex statics based algorithm that enables the system to recognize scene design pattern as universal semantic model for the same type of scenes.With the universal semantic model,the system conducts the modeling process of future design works by suggestions and constraints on operation.The proposed framework empowers the reuse of 3D scene design on both model level and knowledge level.展开更多
The radiation budget at the top of the atmosphere plays a critical role in climate research. Compared to the broadband flux, the spectrally resolved outgoing longwave radiation or flux (OLR), with rich atmospheric i...The radiation budget at the top of the atmosphere plays a critical role in climate research. Compared to the broadband flux, the spectrally resolved outgoing longwave radiation or flux (OLR), with rich atmospheric information in different bands, has obvious advantages in the evaluation of GCMs. Unlike methods that need auxiliary measurements and information, here we take atmospheric infrared sounder (AIRS) observations as an example to build a self-consistent algorithm by an angular distribution model (ADM), based solely on radiance observations, to estimate clear-sky spectrally resolved fluxes over tropical oceans. As the key step for such an ADM, scene type estimations are obtained from radiance and brightness temperature in selected AIRS channels. Then, broadband OLR as well as synthetic spectral fluxes are derived by the spectral ADM and validated using both synthetic spectra and CERES (Clouds and the Earth's Radiant Energy System) observations. In most situations, the mean OLR differences between the spectral ADM products and the CERES observations are within -4-2 W m-2, which is less than 1% of the typical mean clear-sky OLR over tropical oceans. The whole algorithm described in this study can be easily extended to other similar hyperspectral radiance measurements.展开更多
The process of human natural scene categorization consists of two correlated stages: visual perception and visual cognition of natural scenes.Inspired by this fact,we propose a biologically plausible approach for natu...The process of human natural scene categorization consists of two correlated stages: visual perception and visual cognition of natural scenes.Inspired by this fact,we propose a biologically plausible approach for natural scene image classification.This approach consists of one visual perception model and two visual cognition models.The visual perception model,composed of two steps,is used to extract discriminative features from natural scene images.In the first step,we mimic the oriented and bandpass properties of human primary visual cortex by a special complex wavelets transform,which can decompose a natural scene image into a series of 2D spatial structure signals.In the second step,a hybrid statistical feature extraction method is used to generate gist features from those 2D spatial structure signals.Then we design a cognitive feedback model to realize adaptive optimization for the visual perception model.At last,we build a multiple semantics based cognition model to imitate human cognitive mode in rapid natural scene categorization.Experiments on natural scene datasets show that the proposed method achieves high efficiency and accuracy for natural scene classification.展开更多
基金This paper is supported by the State Key Laboratory for Image Processing & Intelligent Control (No. TKLJ9903) National Defe
文摘Augmented reality is the merging of synthetic sensory information into a user's perception of a real environment. As one of the most important tasks in augmented scene modeling, terrain simplification research has gained more and more attention. In this paper, we mainly focus on point selection problem in terrain simplification using triangulated irregular network. Based on the analysis and comparison of traditional importance measures for each input point, we put forward a new importance measure based on local entropy. The results demonstrate that the local entropy criterion has a better performance than any traditional methods. In addition, it can effectively conquer the 'short-sight' problem associated with the traditional methods.
文摘This paper presents a method for structured scene modeling using micro stereo vision system with large field of view. The proposed algorithm includes edge detection with Canny detector, line fitting with principle axis based approach, finding corresponding lines using feature based matching method, and 3D line depth computation.
基金This work was partially supported by grants from the National Natural Science Foundation of China(61902032)Research Grants Council of the Hong Kong Special Administrative Region,China(CityU 11237116)City University of Hong Kong(7004915).
文摘Well-designed indoor scenes incorporate interior design knowledge,which has been an essential prior for most indoor scene modeling methods.However,the layout qualities of indoor scene datasets are often uneven,and most existing data-driven methods do not differentiate indoor scene examples in terms of quality.In this work,we aim to explore an approach that leverages datasets with differentiated indoor scene examples for indoor scene modeling.Our solution conducts subjective evaluations on lightweight datasets having various room configurations and furniture layouts,via pairwise comparisons based on fuzzy set theory.We also develop a system to use such examples to guide indoor scene modeling using user-specified objects.Specifically,we focus on object groups associated with certain human activities,and define room features to encode the relations between the position and direction of an object group and the room configuration.To perform indoor scene modeling,given an empty room,our system first assesses it in terms of the user-specified object groups,and then places associated objects in the room guided by the assessment results.A series of experimental results and comparisons to state-of-the-art indoor scene synthesis methods are presented to validate the usefulness and effectiveness of our approach.
基金supported by the National Natural Science Foundation of China(Project No.61120106007)Research Grant of Beijing Higher Institution Engineering Research CenterTsinghua University Initiative Scientific Research Program
文摘3D scene modeling has long been a fundamental problem in computer graphics and computer vision. With the popularity of consumer-level RGB-D cameras,there is a growing interest in digitizing real-world indoor 3D scenes. However,modeling indoor3 D scenes remains a challenging problem because of the complex structure of interior objects and poor quality of RGB-D data acquired by consumer-level sensors.Various methods have been proposed to tackle these challenges. In this survey,we provide an overview of recent advances in indoor scene modeling techniques,as well as public datasets and code libraries which can facilitate experiments and evaluation.
基金the National Natural Science Foundation of China(U22B2034)the Fundamental Research Funds for the Central Universities(226-2022-00064).
文摘With the support of edge computing,the synergy and collaboration among central cloud,edge cloud,and terminal devices form an integrated computing ecosystem known as the cloud-edge-client architecture.This integration unlocks the value of data and computational power,presenting significant opportunities for large-scale 3D scene modeling and XR presentation.In this paper,we explore the perspectives and highlight new challenges in 3D scene modeling and XR presentation based on point cloud within the cloud-edge-client integrated architecture.We also propose a novel cloud-edge-client integrated technology framework and a demonstration of municipal governance application to address these challenges.
文摘Creating proper 3D models plays an important pole in the development of scene simulation system based on multigen creator and Vega software. However, it is very difficult to construct complex structures by multigen creator. In this paper, an approach is proposed which is utilizing 3dsmax as assistant modeling software. 3D models developed in 3dsmax could be saved in 3ds format and then imported into multigen creator software. The models are revised and then saved in fit format by creator. For reducing model's data, simplification strategy is proposed. The problem of constructing complex models in creator is solved smoothly. In the development of digital rocket simulation project, the models constructed by this method have good visual effect, small size, and could be driven by Vega correctly.
文摘For target detection algorithm under global motion scene, this paper suggests a target detection algorithm based on motion attention fusion model. Firstly, the motion vector field is pre-processed by accumulation and median filter;Then, according to the temporal and spatial character of motion vector, the attention fusion model is defined, which is used to detect moving target;Lastly, the edge of video moving target is made exactly by morphologic operation and edge tracking algorithm. The experimental results of different global motion video sequences show the proposed algorithm has a better veracity and speedup than other algorithm.
基金the National Natural Science Foundation of China(Nos.61073086 and 70871078)the National High Technology Research and Development Program (863) of China(No.2008AA04Z126)
文摘The increasing scale and complexity of 3D scene design work urge an efficient way to understand the design in multi-disciplinary team and exploit the experiences and underlying knowledge in previous works for reuse.However the previous researches lack of concerning on relationship maintaining and design reuse in knowledge level.We propose a novel semantic driven design reuse system,including a property computation algorithm that enables our system to compute the properties while modeling process to maintain the semantic consistency,and a vertex statics based algorithm that enables the system to recognize scene design pattern as universal semantic model for the same type of scenes.With the universal semantic model,the system conducts the modeling process of future design works by suggestions and constraints on operation.The proposed framework empowers the reuse of 3D scene design on both model level and knowledge level.
基金supported by the National Natural Science Foundation of China (Grant No. 41105015)
文摘The radiation budget at the top of the atmosphere plays a critical role in climate research. Compared to the broadband flux, the spectrally resolved outgoing longwave radiation or flux (OLR), with rich atmospheric information in different bands, has obvious advantages in the evaluation of GCMs. Unlike methods that need auxiliary measurements and information, here we take atmospheric infrared sounder (AIRS) observations as an example to build a self-consistent algorithm by an angular distribution model (ADM), based solely on radiance observations, to estimate clear-sky spectrally resolved fluxes over tropical oceans. As the key step for such an ADM, scene type estimations are obtained from radiance and brightness temperature in selected AIRS channels. Then, broadband OLR as well as synthetic spectral fluxes are derived by the spectral ADM and validated using both synthetic spectra and CERES (Clouds and the Earth's Radiant Energy System) observations. In most situations, the mean OLR differences between the spectral ADM products and the CERES observations are within -4-2 W m-2, which is less than 1% of the typical mean clear-sky OLR over tropical oceans. The whole algorithm described in this study can be easily extended to other similar hyperspectral radiance measurements.
文摘The process of human natural scene categorization consists of two correlated stages: visual perception and visual cognition of natural scenes.Inspired by this fact,we propose a biologically plausible approach for natural scene image classification.This approach consists of one visual perception model and two visual cognition models.The visual perception model,composed of two steps,is used to extract discriminative features from natural scene images.In the first step,we mimic the oriented and bandpass properties of human primary visual cortex by a special complex wavelets transform,which can decompose a natural scene image into a series of 2D spatial structure signals.In the second step,a hybrid statistical feature extraction method is used to generate gist features from those 2D spatial structure signals.Then we design a cognitive feedback model to realize adaptive optimization for the visual perception model.At last,we build a multiple semantics based cognition model to imitate human cognitive mode in rapid natural scene categorization.Experiments on natural scene datasets show that the proposed method achieves high efficiency and accuracy for natural scene classification.