With the development of digital library technology, library books made of paper can be digital released and read, and Endangered Cultural Heritages can be preserved. Traditional library＇s contents and functions can b...With the development of digital library technology, library books made of paper can be digital released and read, and Endangered Cultural Heritages can be preserved. Traditional library＇s contents and functions can be greatly enhanced by digital technologies. For these new library objects, the primary key problem is precisely reconstructing their 3D models. When constructing complete 3D models, multiple color texture maps are often necessary. A commonly encountered problem uncounted during fusing of textures from multiple color images is color distortion. Each texture of a single 3D model may be obtained under possibly different lighting conditions and color response of the camera. To remove any visible seam and improve color consistency between the textures while avoiding color distortion, we propose a new efficient algorithm to relight all the texture images globally, spread residual light difference, and recolor each image by homogeneous transformation. A relative illumination model was adopted to obtain the relighting function. We choose lαβ color space with minimal correlation between channels for many natural scenes, for calculating the relighting result. Looking into two overlapped images A and B, we can pairwise relight B into A＇s luminosity condition in two steps. We first scale B＇s l channel by the lA/lB ratio of the overlapped region. We can assume A and B are in a same color plane now. Then a homogeneous transformation is applied to B＇s a and fl channels which moves B into A＇s hue and saturation condition. For multiple overlapped color textures, a patch based weighted global relighting method was proposed to minimize the total color difference. The pairwise relighting method was used between each two overlapped images, and the difference in every overlapped region after relighting was weighted and summed up to construct an energy value. We used Nelder-Mead method to find a minimal energy value and the relighting parameters for every image. After global relighting, textures become almost coherent. We simply blended the overlapped region along the texture border to remove small visual seams and get a final result. We illustrate our method by calibrating textures of a painted sculpture acquired with laser scanner. Experimental results were realistic and reliable and showed how this method can fuse multiple textures without color distortion.展开更多
A colored 3D surface reconstruction method which effectively fuses the information of both depth and color image using Microsoft Kinect is proposed and demonstrated by experiment.Kinect depth images are processed with...A colored 3D surface reconstruction method which effectively fuses the information of both depth and color image using Microsoft Kinect is proposed and demonstrated by experiment.Kinect depth images are processed with the improved joint-bilateral filter based on region segmentation which efficiently combines the depth and color data to improve its quality.The registered depth data are integrated to achieve a surface reconstruction through the colored truncated signed distance fields presented in this paper.Finally,the improved ray casting for rendering full colored surface is implemented to estimate color texture of the reconstruction object.Capturing the depth and color images of a toy car,the improved joint-bilateral filter based on region segmentation is used to improve the quality of depth images and the peak signal-to-noise ratio(PSNR)is approximately 4.57 d B,which is better than 1.16 d B of the joint-bilateral filter.The colored construction results of toy car demonstrate the suitability and ability of the proposed method.展开更多
基金Project supported by the National Basic Research Program (973) ofChina (No. 2002CB312106)
文摘With the development of digital library technology, library books made of paper can be digital released and read, and Endangered Cultural Heritages can be preserved. Traditional library＇s contents and functions can be greatly enhanced by digital technologies. For these new library objects, the primary key problem is precisely reconstructing their 3D models. When constructing complete 3D models, multiple color texture maps are often necessary. A commonly encountered problem uncounted during fusing of textures from multiple color images is color distortion. Each texture of a single 3D model may be obtained under possibly different lighting conditions and color response of the camera. To remove any visible seam and improve color consistency between the textures while avoiding color distortion, we propose a new efficient algorithm to relight all the texture images globally, spread residual light difference, and recolor each image by homogeneous transformation. A relative illumination model was adopted to obtain the relighting function. We choose lαβ color space with minimal correlation between channels for many natural scenes, for calculating the relighting result. Looking into two overlapped images A and B, we can pairwise relight B into A＇s luminosity condition in two steps. We first scale B＇s l channel by the lA/lB ratio of the overlapped region. We can assume A and B are in a same color plane now. Then a homogeneous transformation is applied to B＇s a and fl channels which moves B into A＇s hue and saturation condition. For multiple overlapped color textures, a patch based weighted global relighting method was proposed to minimize the total color difference. The pairwise relighting method was used between each two overlapped images, and the difference in every overlapped region after relighting was weighted and summed up to construct an energy value. We used Nelder-Mead method to find a minimal energy value and the relighting parameters for every image. After global relighting, textures become almost coherent. We simply blended the overlapped region along the texture border to remove small visual seams and get a final result. We illustrate our method by calibrating textures of a painted sculpture acquired with laser scanner. Experimental results were realistic and reliable and showed how this method can fuse multiple textures without color distortion.
文摘A colored 3D surface reconstruction method which effectively fuses the information of both depth and color image using Microsoft Kinect is proposed and demonstrated by experiment.Kinect depth images are processed with the improved joint-bilateral filter based on region segmentation which efficiently combines the depth and color data to improve its quality.The registered depth data are integrated to achieve a surface reconstruction through the colored truncated signed distance fields presented in this paper.Finally,the improved ray casting for rendering full colored surface is implemented to estimate color texture of the reconstruction object.Capturing the depth and color images of a toy car,the improved joint-bilateral filter based on region segmentation is used to improve the quality of depth images and the peak signal-to-noise ratio(PSNR)is approximately 4.57 d B,which is better than 1.16 d B of the joint-bilateral filter.The colored construction results of toy car demonstrate the suitability and ability of the proposed method.
