基于CLIP模型的军事领域图片资源多模态搜索工具研究

Research on multimodal search tool for domain image resources based on CLIP

深入调研梳理了OpenAI CLIP多模态模型和相关应用研究。借助CLIP模型,通过大规模军事相关图片数据集开展实验,设计开发了具有以文搜图和以图搜图功能的多模态搜索工具,且在实际测试中表现良好,可以为后续围绕军事相关图片的事件分类、目标检测、任务轨迹跟踪等方面的分析研究奠定基础。

The Open AI′ multimodal model Contrastive Language-image Pre-training(CLIP) and relevant application research were thoroughly analyzed and sorted out. With the help of CLIP, a multimodal search tool with the functions of text search and image search was designed and developed through experiments with military-related image datasets on a large scale. The tool performed well in practical tests, which can lay a foundation for further analyses and research on event classification, target detection, task trajectory tracking of military-related images.