Realtime analyzing the feeding behavior of fish is the premise and key to accurate guidance on feeding.The identification of fish behavior using a single information is susceptible to various factors.To overcome the p...Realtime analyzing the feeding behavior of fish is the premise and key to accurate guidance on feeding.The identification of fish behavior using a single information is susceptible to various factors.To overcome the problems,this paper proposes an adaptive deep modular co-attention unified multi-modal transformers(DMCA-UMT).By fusing the video,audio and water quality parameters,the whole process of fish feeding behavior could be identified.Firstly,for the input video,audio and water quality parameter information,features are extracted to obtain feature vectors of different modalities.Secondly,deep modular co-attention(DMCA)is introduced on the basis of the original cross-modal encoder,and the adaptive learnable weights are added.The feature vector of video and audio joint representation is obtained by automatic learning based on fusion contribution.Finally,the information of visual-audio modality fusion and text features are used to generate clip-level moment queries.The query decoder decodes the input features and uses the prediction head to obtain the final joint moment retrieval,which is the start-end time of feeding the fish.The results show that the mAP Avg of the proposed algorithm reaches 75.3%,which is37.8%higher than that of unified multi-modal transformers(UMT)algorithm.展开更多
1996年WIPO制定的《世界知识产权组织版权条约》(WCT)和《世界知识产权组织表演和音像制品条约》(WPPT)两个条约,要求各签约方保护版权作品的技术措施要象保护权利管理信息一样。因此,大多数签约国在执行两个条约的这方面要求时,纷纷仿...1996年WIPO制定的《世界知识产权组织版权条约》(WCT)和《世界知识产权组织表演和音像制品条约》(WPPT)两个条约,要求各签约方保护版权作品的技术措施要象保护权利管理信息一样。因此,大多数签约国在执行两个条约的这方面要求时,纷纷仿效美国1998年出台的《数字千年版权法》(the Digital Millennium Copyright Act,以下简称DMCA)制定版权法。然而,在不同国家的现行版权法范围内,如何执行这些条约的特别条款,每一个国家都有很大的自由。主要对欧盟、加拿大、日本、印度等DMCA型国家在履行WCT和WPPT两个条约方面进行简要介绍。展开更多
基金supported by the Beijing Natural Science Foundation(No.6212007)the National Key Technology R&D Program of China(No.2022YFD2001701)the Youth Research Fund of Beijing Academy of Agricultural and Forestry Sciences(No.QNJJ202014)。
文摘Realtime analyzing the feeding behavior of fish is the premise and key to accurate guidance on feeding.The identification of fish behavior using a single information is susceptible to various factors.To overcome the problems,this paper proposes an adaptive deep modular co-attention unified multi-modal transformers(DMCA-UMT).By fusing the video,audio and water quality parameters,the whole process of fish feeding behavior could be identified.Firstly,for the input video,audio and water quality parameter information,features are extracted to obtain feature vectors of different modalities.Secondly,deep modular co-attention(DMCA)is introduced on the basis of the original cross-modal encoder,and the adaptive learnable weights are added.The feature vector of video and audio joint representation is obtained by automatic learning based on fusion contribution.Finally,the information of visual-audio modality fusion and text features are used to generate clip-level moment queries.The query decoder decodes the input features and uses the prediction head to obtain the final joint moment retrieval,which is the start-end time of feeding the fish.The results show that the mAP Avg of the proposed algorithm reaches 75.3%,which is37.8%higher than that of unified multi-modal transformers(UMT)algorithm.
文摘1996年WIPO制定的《世界知识产权组织版权条约》(WCT)和《世界知识产权组织表演和音像制品条约》(WPPT)两个条约,要求各签约方保护版权作品的技术措施要象保护权利管理信息一样。因此,大多数签约国在执行两个条约的这方面要求时,纷纷仿效美国1998年出台的《数字千年版权法》(the Digital Millennium Copyright Act,以下简称DMCA)制定版权法。然而,在不同国家的现行版权法范围内,如何执行这些条约的特别条款,每一个国家都有很大的自由。主要对欧盟、加拿大、日本、印度等DMCA型国家在履行WCT和WPPT两个条约方面进行简要介绍。
