结合面料属性和触觉感测的织物识别

Cloth recognition based on fabric properties and tactile sensing

目的织物识别是提高纺织业竞争力的重要计算机辅助技术。与通用图像相比,织物图像通常只在纹理和形状特征方面呈现细微差异。目前常见的织物识别算法仅考虑图像特征,未结合织物面料的视觉和触觉特征,不能反映出织物本身面料属性,导致识别准确率较低。本文以常见服用织物为例,针对目前常见织物面料识别准确率不高的问题,提出一种结合面料属性和触觉感测的织物图像识别算法。方法针对输入的织物样本,建立织物图像的几何测量方法,量化分析影响织物面料属性的3个关键因素,即恢复性、拉伸性和弯曲性,并进行面料属性的参数化建模,得到面料属性的几何度量。通过传感器设置对织物进行触感测量,采用卷积神经网络(convolutional neural network,CNN)提取测量后的织物触感图像的底层特征。将面料属性几何度量与提取的底层特征进行匹配,通过CNN训练得到织物面料识别模型,学习织物面料属性的不同参数,实现织物面料的识别并输出识别结果。结果在构建的常见服用织物样本上验证了本文方法,与同任务的方法比较,本文方法识别率更高,平均识别率达到89.5%。结论提出了一种基于面料属性和触觉感测的织物图像识别方法,能准确识别常用的服装织物面料,有效提高了织物识别的准确率,能较好地满足实际应用需求。

Objective With the development of the textile industry,the manual identification of cloth has been unable to meet the growing demand for production.More and more image recognition technologies are applied to cloth recognition.Image recognition is a technology that combines feature extraction and feature learning;it plays an important role in improving the competitiveness of the clothing industry.Compared with general-purpose images,cloth images usually only show subtle differences in texture and shape.Current clothing recognition algorithms are based on machine learning;that is,they learn the features of clothing images through machine learning and compare the features of known fabric to determine the clothing category.However,these clothing recognition algorithms usually have low recognition rates because they only consider the vision attribute,which cannot fully describe the fabric and ignores the properties of the fabric itself.Touch and vision are two important sensing modalities for humans,and they offer complementary information for sensing cloth.Machine learning can also benefit from such multimodal sensing ability.To solve the problem of low recognition accuracy of common fabrics,a fabric image recognition method based on fabric properties and tactile sensing is proposed.Method The proposed method involves four steps,including image measurement,tactile sensing,fabric learning,and fabric recognition.The main idea of the method is to use AlexNet to extract tactile image features adaptively and match the fabric properties extracted by MATLAB morphology.First,the geometric measurement method is established to measure the input fabric image samples,and a parametric model is obtained after quantitatively analyzing the three key factors by testing the recovery,stretching,and bending behavior of different real cloth samples.The geometric measures of fabric properties can be obtained through parametric modeling.Second,fabric tactile sensing is measured through tactile sensor settings,and the low-level features of tactile images are extracted using convolutional neural network(CNN).Third,the fabric identification model is trained by matching the fabric geometric measures with the extracted features of tactile image and parameter learning through the CNN to learn the different parameters of fabric properties.Finally,the fabric is recognized,and results are obtained.In this study,the issue on cloth recognition is addressed by the basis of tactile image and vision;in this manner,missing sensory information can be avoided.Furthermore,a new fusion method named deep maximum covariance analysis(DMCA)is utilized to learn a joint latent space for sharing features through vision and tactile sensing,which can match weak paired vision and tactile data.Considering that the current fabric dataset contains only a few fabric types,which cannot be classified as everyday fabric,two fabric sample datasets are constructed.The first is a fabric image dataset for fabric property measurement,including the recovery,stretching,and bending images of 12 kinds of fabric types,such as coarse cotton,fine cotton,and canvas.Each type of fabric has 10 images,thus having a total of 360 images.The second is a fabric tactile image dataset,which includes 12 fabric types,each comprising 500 images with a total of 6000 images.The size of all images are set to 227×227 pixels for the convenience of the experiment.Result To verify the effectiveness of the proposed method,experiments are performed on 12 common fabric samples.Experimental results show that the recognition average accuracy can reach 89.5%.Compared with the method of using only a single and three kinds of fabric attributes,the proposed method obtains a higher recognition rate.The proposed method also possesses better recognition effect compared with that of the mainstream methods.For example,compared with recognition accuracy of sparse coding(SC)combined with support vector machine(SVM),that of the proposed method increases to 89.5%.Conclusion A fabric image recognition method of combining vision and tactile sensing is proposed.The method can accurately identify fabric for clothing and improve the accuracy of fabric recognition.For the feature extraction task,the AlexNet network achieves simplified high-dimensional features,which can adaptively extract effective features to avoid manual screening.Moreover,the DMCA model performs well in cross-modal matching.Compared with other clothing recognition methods,our method shows several advantages in terms of accuracy,without the cost of expensive equipment.However,our method does not consider the recognition accuracy problem,which is influenced by a small number of samples,a low image measurement data dimension,and a lack of tactile information.In the future,the issues to improve the recognition accuracy of various fabric types will be focused on further.