Image-based virtual try-on systems have significant commercial value in online garment shopping.However,prior methods fail to appropriately handle details,so are defective in maintaining the original appearance of org...Image-based virtual try-on systems have significant commercial value in online garment shopping.However,prior methods fail to appropriately handle details,so are defective in maintaining the original appearance of organizational items including arms,the neck,and in-shop garments.We propose a novel high fidelity virtual try-on network to generate realistic results.Specifically,a distributed pipeline is used for simultaneous generation of organizational items.First,the in-shop garment is warped using thin plate splines(TPS)to give a coarse shape reference,and then a corresponding target semantic map is generated,which can adaptively respond to the distribution of different items triggered by different garments.Second,organizational items are componentized separately using our novel semantic map-based image adjustment network(SMIAN)to avoid interference between body parts.Finally,all components are integrated to generatethe overall result by SMIAN.A priori dual-modalinformation is incorporated in the tail layers of SMIAN to improve the convergence rate of the network.Experiments demonstrate that the proposed method can retain better details of condition information than current methods.Our method achieves convincing quantitative and qualitative results on existing benchmark datasets.展开更多
A virtual cosmetics try-on system provides a realistic try-on experience for consumers and helps them efficiently choose suitable cosmetics.In this article,we propose a real-time augmented reality virtual cosmetics tr...A virtual cosmetics try-on system provides a realistic try-on experience for consumers and helps them efficiently choose suitable cosmetics.In this article,we propose a real-time augmented reality virtual cosmetics try-on system for smartphones(ARCosmetics),taking speed,accuracy,and stability into consideration at each step to ensure a better user experience.A novel and very fast face tracking method utilizes the face detection box and the average position of facial landmarks to estimate the faces in continuous frames.A dynamic weight Wing loss is introduced to assign a dynamic weight to every landmark by the estimated error during training.It balances the attention between small,medium,and large range error and thus increases the accuracy and robustness.We also designed a weighted average method to utilize the information of the adjacent frame for landmark refinement,guaranteeing the stability of the generated landmarks.Extensive experiments conducted on a large 106-point facial landmark dataset and the 300-VW dataset demonstrate the superior performance of the proposed method compared to other state-of-the-art methods.We also conducted user satisfaction studies further to verify the efficiency and effectiveness of our ARCosmetics system.展开更多
基金supported by Young Talents Programme of Scientific Research Program of Hubei Education Department(Project No.Q20201709)Research on the Key Technology of Flexible Intelligent Manufacturing of Clothing based on Digital Twin of Hubei Key Research and Development Program(Project No.2021BAA042)Open Topic of Engineering Research Center of Hubei Province for Clothing Information(Project No.900204).
文摘Image-based virtual try-on systems have significant commercial value in online garment shopping.However,prior methods fail to appropriately handle details,so are defective in maintaining the original appearance of organizational items including arms,the neck,and in-shop garments.We propose a novel high fidelity virtual try-on network to generate realistic results.Specifically,a distributed pipeline is used for simultaneous generation of organizational items.First,the in-shop garment is warped using thin plate splines(TPS)to give a coarse shape reference,and then a corresponding target semantic map is generated,which can adaptively respond to the distribution of different items triggered by different garments.Second,organizational items are componentized separately using our novel semantic map-based image adjustment network(SMIAN)to avoid interference between body parts.Finally,all components are integrated to generatethe overall result by SMIAN.A priori dual-modalinformation is incorporated in the tail layers of SMIAN to improve the convergence rate of the network.Experiments demonstrate that the proposed method can retain better details of condition information than current methods.Our method achieves convincing quantitative and qualitative results on existing benchmark datasets.
基金supported in part by the National Key R&D Program of China(2021ZD0140407)in part by the National Natural Science Foundation of China(Grant No.U21A20523).
文摘A virtual cosmetics try-on system provides a realistic try-on experience for consumers and helps them efficiently choose suitable cosmetics.In this article,we propose a real-time augmented reality virtual cosmetics try-on system for smartphones(ARCosmetics),taking speed,accuracy,and stability into consideration at each step to ensure a better user experience.A novel and very fast face tracking method utilizes the face detection box and the average position of facial landmarks to estimate the faces in continuous frames.A dynamic weight Wing loss is introduced to assign a dynamic weight to every landmark by the estimated error during training.It balances the attention between small,medium,and large range error and thus increases the accuracy and robustness.We also designed a weighted average method to utilize the information of the adjacent frame for landmark refinement,guaranteeing the stability of the generated landmarks.Extensive experiments conducted on a large 106-point facial landmark dataset and the 300-VW dataset demonstrate the superior performance of the proposed method compared to other state-of-the-art methods.We also conducted user satisfaction studies further to verify the efficiency and effectiveness of our ARCosmetics system.
