With the rapid increase in social websites that has dramatically increased the volume of social media, which includes the use of images and videos, visual understanding has attracted great interest in several areas su...With the rapid increase in social websites that has dramatically increased the volume of social media, which includes the use of images and videos, visual understanding has attracted great interest in several areas such as multimedia, computer vision, and pattern recognition. Valuable auxiliary resources available on social websites, such as user-provided tags, aid in the tasks of visual understanding. Therefore, sev- eral methods have been proposed for exploring the auxiliary resources for tag refinement, image retrieval, and media sum- marization. This work conducts a comprehensive survey of recent advances in visual understanding by mining social media in order to discuss their merits and limitations. We then analyze the difficulties and challenges of visual understanding followed by several possible future research directions.展开更多
基金This work was partially supported by the National Basic Research Program of China （973 Program） （2014CB347600）, the National Natural Science Foundation of China （Grant Nos. 61522203 and U1611461）, the Natural Science Foundation of Jiangsu Province （Bird0140058）, and the National Ten Thousand Talent Program of China （Young Top-Notch Talent）.
文摘With the rapid increase in social websites that has dramatically increased the volume of social media, which includes the use of images and videos, visual understanding has attracted great interest in several areas such as multimedia, computer vision, and pattern recognition. Valuable auxiliary resources available on social websites, such as user-provided tags, aid in the tasks of visual understanding. Therefore, sev- eral methods have been proposed for exploring the auxiliary resources for tag refinement, image retrieval, and media sum- marization. This work conducts a comprehensive survey of recent advances in visual understanding by mining social media in order to discuss their merits and limitations. We then analyze the difficulties and challenges of visual understanding followed by several possible future research directions.
