The rapid processing,analysis,and mining of remote-sensing big data based on intelligent interpretation technology using remote-sensing cloud computing platforms(RS-CCPs)have recently become a new trend.The existing R...The rapid processing,analysis,and mining of remote-sensing big data based on intelligent interpretation technology using remote-sensing cloud computing platforms(RS-CCPs)have recently become a new trend.The existing RS-CCPs mainly focus on developing and optimizing high-performance data storage and intelligent computing for common visual representation,which ignores remote sensing data characteristics such as large image size,large-scale change,multiple data channels,and geographic knowledge embedding,thus impairing computational efficiency and accuracy.We construct a LuoJiaAI platform composed of a standard large-scale sample database(LuoJiaSET)and a dedicated deep learning framework(LuoJiaNET)to achieve state-of-the-art performance on five typical remote sensing interpretation tasks,including scene classification,object detection,land-use classification,change detection,and multi-view 3D reconstruction.The details of the LuoJiaAI application experiment can be found at the white paper for LuoJiaAI industrial application.In addition,LuoJiaAI is an open-source RS-CCP that supports the latest Open Geospatial Consortium(OGC)standards for better developing and sharing Earth Artificial Intelligence(AI)algorithms and products on benchmark datasets.LuoJiaAI narrows the gap between the sample database and deep learning frameworks through a user-friendly data-framework collaboration mechanism,showing great potential in high-precision remote sensing mapping applications.展开更多
Near real-time spatial prediction of earthquake-induced landslides(EQILs)can rapidly forecast the occurrence position of widespread landslides just after a violent earthquake;thus,EQIL prediction is very crucial to th...Near real-time spatial prediction of earthquake-induced landslides(EQILs)can rapidly forecast the occurrence position of widespread landslides just after a violent earthquake;thus,EQIL prediction is very crucial to the 72-hour‘golden window’for survivors.This work focuses on a series of earthquake events from 2008 to 2022 occurring in the Tibetan Plateau,a famous seismically-active zone,and proposes a novel interpretable self-supervised learning(ISeL)method for the near real-time spatial prediction of EQILs.This new method innovatively introduces swap noise at the unsupervised mechanism,which can improve the generalization performance and transferability of the model,and can effectively reduce false alarm and improve accuracy through supervisedfine-tuning.An interpretable module is built based on a self-attention mechanism to reveal the importance and contribution of various influencing factors to EQIL spatial distribution.Experimental results demonstrate that the ISeL model is superior to the excellent state-of-the-art machine learning and deep learning methods.Furthermore,according to the interpretable module in the ISeL method,the critical controlling and triggering factors are revealed.The ISeL method can also be applied in other earthquake-frequent regions worldwide because of its good generalization and transferability.展开更多
This paper reviews recent studies in understanding neural-network representations and learning neural networks with interpretable/disentangled middle-layer representations.Although deep neural networks have exhibited ...This paper reviews recent studies in understanding neural-network representations and learning neural networks with interpretable/disentangled middle-layer representations.Although deep neural networks have exhibited superior performance in various tasks,interpretability is always Achilles' heel of deep neural networks.At present,deep neural networks obtain high discrimination power at the cost of a low interpretability of their black-box representations.We believe that high model interpretability may help people break several bottlenecks of deep learning,e.g.,learning from a few annotations,learning via human–computer communications at the semantic level,and semantically debugging network representations.We focus on convolutional neural networks(CNNs),and revisit the visualization of CNN representations,methods of diagnosing representations of pre-trained CNNs,approaches for disentangling pre-trained CNN representations,learning of CNNs with disentangled representations,and middle-to-end learning based on model interpretability.Finally,we discuss prospective trends in explainable artificial intelligence.展开更多
基金supported by the Chinese National Natural Science Foundation Projects[grant number 41901265]Major Program of the National Natural Science Foundation of China[grant number 92038301]supported in part by the Special Fund of Hubei Luojia Laboratory[grant number 220100028].
文摘The rapid processing,analysis,and mining of remote-sensing big data based on intelligent interpretation technology using remote-sensing cloud computing platforms(RS-CCPs)have recently become a new trend.The existing RS-CCPs mainly focus on developing and optimizing high-performance data storage and intelligent computing for common visual representation,which ignores remote sensing data characteristics such as large image size,large-scale change,multiple data channels,and geographic knowledge embedding,thus impairing computational efficiency and accuracy.We construct a LuoJiaAI platform composed of a standard large-scale sample database(LuoJiaSET)and a dedicated deep learning framework(LuoJiaNET)to achieve state-of-the-art performance on five typical remote sensing interpretation tasks,including scene classification,object detection,land-use classification,change detection,and multi-view 3D reconstruction.The details of the LuoJiaAI application experiment can be found at the white paper for LuoJiaAI industrial application.In addition,LuoJiaAI is an open-source RS-CCP that supports the latest Open Geospatial Consortium(OGC)standards for better developing and sharing Earth Artificial Intelligence(AI)algorithms and products on benchmark datasets.LuoJiaAI narrows the gap between the sample database and deep learning frameworks through a user-friendly data-framework collaboration mechanism,showing great potential in high-precision remote sensing mapping applications.
基金funded by the National Natural Science Foundation of China(U21A2013,71874165)Opening Fund of Key Laboratory of Geological Survey and Evaluation of Ministry of Education[Grant Nos.GLAB2020ZR02,GLAB2022ZR02]+2 种基金State Key Laboratory of Biogeology and Environmental Geology[grant number GBL12107]the Fundamental Research Funds for the Central Universities,China University of Geosciences(Wuhan)[CUG2642022006]Hunan Provincial Natural Science Foundation of China[2021JC0009].
文摘Near real-time spatial prediction of earthquake-induced landslides(EQILs)can rapidly forecast the occurrence position of widespread landslides just after a violent earthquake;thus,EQIL prediction is very crucial to the 72-hour‘golden window’for survivors.This work focuses on a series of earthquake events from 2008 to 2022 occurring in the Tibetan Plateau,a famous seismically-active zone,and proposes a novel interpretable self-supervised learning(ISeL)method for the near real-time spatial prediction of EQILs.This new method innovatively introduces swap noise at the unsupervised mechanism,which can improve the generalization performance and transferability of the model,and can effectively reduce false alarm and improve accuracy through supervisedfine-tuning.An interpretable module is built based on a self-attention mechanism to reveal the importance and contribution of various influencing factors to EQIL spatial distribution.Experimental results demonstrate that the ISeL model is superior to the excellent state-of-the-art machine learning and deep learning methods.Furthermore,according to the interpretable module in the ISeL method,the critical controlling and triggering factors are revealed.The ISeL method can also be applied in other earthquake-frequent regions worldwide because of its good generalization and transferability.
基金supported by the ONR MURI pro ject(No.N00014-16-1-2007)the DARPA XAI Award(No.N66001-17-2-4029)NSF IIS(No.1423305)
文摘This paper reviews recent studies in understanding neural-network representations and learning neural networks with interpretable/disentangled middle-layer representations.Although deep neural networks have exhibited superior performance in various tasks,interpretability is always Achilles' heel of deep neural networks.At present,deep neural networks obtain high discrimination power at the cost of a low interpretability of their black-box representations.We believe that high model interpretability may help people break several bottlenecks of deep learning,e.g.,learning from a few annotations,learning via human–computer communications at the semantic level,and semantically debugging network representations.We focus on convolutional neural networks(CNNs),and revisit the visualization of CNN representations,methods of diagnosing representations of pre-trained CNNs,approaches for disentangling pre-trained CNN representations,learning of CNNs with disentangled representations,and middle-to-end learning based on model interpretability.Finally,we discuss prospective trends in explainable artificial intelligence.