CNN-Transformer结合对比学习的高光谱与LiDAR数据协同分类

针对高光谱图像(hyperspectral images,HSI)与LiDAR数据多模态分类任务中的跨模态信息表达和特征对齐等问题,提出一种基于对比学习CNN-Transformer高光谱和LiDAR数据协同分类网络(Contrastive Learning based CNNTransformer Network,CLCT-Net)。CLCT-Net通过由ConvNeXt V2 Block构成的共有特征提取模块,获得不同模态间的共性特征,解决异构传感器数据之间语义对齐的问题。构建了包含空间-通道分支和光谱上下文分支的双分支HSI编码器,以及结合频域自注意力机制的LiDAR编码器,以获取更丰富的特征表示。利用集成对比学习进行分类,进一步提升多模态数据协同分类的精度。在Houston 2013和Trento数据集上的实验结果表明,相较于其他高光谱图像和Li‐DAR数据分类模型,本文所提模型获得了更高的地物分类精度,分别达到了92.01%和98.90%,实现了跨模态数据特征的深度挖掘和协同提取。

Classroom Teaching Effect Monitoring and Evaluation System with Deep Integration of Artificial Intelligence

With the progress and development of the times,education informatization has become the primary content to promote the progress of education.However,with the rapid advancement of technology,many problems have arisen in the integration of online education and information technology.From a practical point of view,advanced information technology should be fully integrated with school education activities to promote education reform and development,and students will definitely obtain a better learning experience.This study aimed to introduce a classroom teaching effect monitoring and evaluation system that incorporates artificial intelligence.In view of the background conditions for the development of this system,reforming measures and specific implementation methods for the integration of information technology and online classroom education are proposed.