期刊文献+

3D Face Reconstruction Using Images from Cameras with Varying Parameters

3D Face Reconstruction Using Images from Cameras with Varying Parameters
原文传递
导出
摘要 In this paper, we present a new technique of 3D face reconstruction from a sequence of images taken with cameras having varying parameters without the need to grid. This method is based on the estimation of the projection matrices of the cameras from a symmetry property which characterizes the face, these projections matrices are used with points matching in each pair of images to determine the 3D points cloud, subsequently, 3D mesh of the face is constructed with 3D Crust algorithm. Lastly, the 2D image is projected on the 3D model to generate the texture mapping. The strong point of the proposed approach is to minimize the constraints of the calibration system: we calibrated the cameras from a symmetry property which characterizes the face, this property gives us the opportunity to know some points of 3D face in a specific well-chosen global reference, to formulate a system of linear and nonlinear equations according to these 3D points, their projection in the image plan and the elements of the projections matrix. Then to solve these equations, we use a genetic algorithm which consists of finding the global optimum without the need of the initial estimation and allows to avoid the local minima of the formulated cost function. Our study is conducted on real data to demonstrate the validity and the performance of the proposed approach in terms of robustness, simplicity, stability and convergence. In this paper, we present a new technique of 3D face reconstruction from a sequence of images taken with cameras having varying parameters without the need to grid. This method is based on the estimation of the projection matrices of the cameras from a symmetry property which characterizes the face, these projections matrices are used with points matching in each pair of images to determine the 3D points cloud, subsequently, 3D mesh of the face is constructed with 3D Crust algorithm. Lastly, the 2D image is projected on the 3D model to generate the texture mapping. The strong point of the proposed approach is to minimize the constraints of the calibration system: we calibrated the cameras from a symmetry property which characterizes the face, this property gives us the opportunity to know some points of 3D face in a specific well-chosen global reference, to formulate a system of linear and nonlinear equations according to these 3D points, their projection in the image plan and the elements of the projections matrix. Then to solve these equations, we use a genetic algorithm which consists of finding the global optimum without the need of the initial estimation and allows to avoid the local minima of the formulated cost function. Our study is conducted on real data to demonstrate the validity and the performance of the proposed approach in terms of robustness, simplicity, stability and convergence.
机构地区 LIIAN LIIAN LSI
出处 《International Journal of Automation and computing》 EI CSCD 2017年第6期661-671,共11页 国际自动化与计算杂志(英文版)
关键词 Camera calibration genetic algorithm 3D face 3D mesh 3D reconstruction Camera calibration genetic algorithm 3D face 3D mesh 3D reconstruction
  • 相关文献

参考文献1

二级参考文献22

  • 1Jia B, Zhang Y, Lin X. General and fast algorithm for disparity error detection and correction. J. Tsinghua University, 2000, 40(1): 28-31. (in Chinese).
  • 2Zhang Z, Deriche R, Faugeras O et aL A robust technique for matching two uncalibrated images through the recovery of the unknown epipolar geometry. Artificial Intelligence, 1995, 78(1-2): 87-119.
  • 3Lee Y C, Terzopoulos D, Waters K. Realistic modeling for facial animation, In Proc. ACM SIGGRAPH 95,Los Angeles, USA, 1995, pp.56-62.
  • 4DeCarlo D, Metaxaz D, Stone M. An anthropometric face model using variational techniques. In Proc. ACM SIGGRAPH 98, Orlando, USA, 1998, pp.67-74.
  • 5Parke F I, Waters K. Computer Facial Animation, AK Peters, 1996.
  • 6Hong P. An integrated framework for face modeling, facial motion analysis and synthesis [Dissertation]. University of Illinois at Urbana Champaign, 2001.
  • 7Fua P, Leclerc Y G. Object-centered surface reconstruction: Combining multi-image stereo and shading. Int.J. Computer Vision, 1995, 16(1): 35-56.
  • 8Samaras D, Metaxas D. Incorporating illumination constraints in deformable models. In Proc. the IEEE 1998 Conf. Computer Vision and Pattern Recognition(CVPR), i998, Santa Barbara, USA, pp.322-329.
  • 9Tang L, Huang T S. Analysis-based facial expression synthesis. In 1996 IEEE Int. Conf. Image Processing (ICIP), 1996, Lausanne, Switzerland, ICIP-III (94):98-102.
  • 10Wong K, Cipolla R. Structure and motion from Silhouettes. In Proc. 8th IEEE Int. Conf. Computer Vision(ICCV), 2001, Vancouver, Canada, pp.217-222.

共引文献2

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部