Recent studies have shown that deep learning(DL)models can skillfully forecast El Niño–Southern Oscillation(ENSO)events more than 1.5 years in advance.However,concerns regarding the reliability of predictions ma...Recent studies have shown that deep learning(DL)models can skillfully forecast El Niño–Southern Oscillation(ENSO)events more than 1.5 years in advance.However,concerns regarding the reliability of predictions made by DL methods persist,including potential overfitting issues and lack of interpretability.Here,we propose ResoNet,a DL model that combines CNN(convolutional neural network)and transformer architectures.This hybrid architecture enables our model to adequately capture local sea surface temperature anomalies as well as long-range inter-basin interactions across oceans.We show that ResoNet can robustly predict ENSO at lead times of 19 months,thus outperforming existing approaches in terms of the forecast horizon.According to an explainability method applied to ResoNet predictions of El Niño and La Niña from 1-to 18-month leads,we find that it predicts the Niño-3.4 index based on multiple physically reasonable mechanisms,such as the recharge oscillator concept,seasonal footprint mechanism,and Indian Ocean capacitor effect.Moreover,we demonstrate for the first time that the asymmetry between El Niño and La Niña development can be captured by ResoNet.Our results could help to alleviate skepticism about applying DL models for ENSO prediction and encourage more attempts to discover and predict climate phenomena using AI methods.展开更多
Recently, there have been some attempts of Transformer in 3D point cloud classification. In order to reduce computations, most existing methods focus on local spatial attention,but ignore their content and fail to est...Recently, there have been some attempts of Transformer in 3D point cloud classification. In order to reduce computations, most existing methods focus on local spatial attention,but ignore their content and fail to establish relationships between distant but relevant points. To overcome the limitation of local spatial attention, we propose a point content-based Transformer architecture, called PointConT for short. It exploits the locality of points in the feature space(content-based), which clusters the sampled points with similar features into the same class and computes the self-attention within each class, thus enabling an effective trade-off between capturing long-range dependencies and computational complexity. We further introduce an inception feature aggregator for point cloud classification, which uses parallel structures to aggregate high-frequency and low-frequency information in each branch separately. Extensive experiments show that our PointConT model achieves a remarkable performance on point cloud shape classification. Especially, our method exhibits 90.3% Top-1 accuracy on the hardest setting of ScanObjectN N. Source code of this paper is available at https://github.com/yahuiliu99/PointC onT.展开更多
Hemorrhagic transformation is a major complication of large-artery atheroscle rotic stroke(a major ischemic stro ke subtype)that wo rsens outcomes and increases mortality.Disruption of the gut microbiota is an importa...Hemorrhagic transformation is a major complication of large-artery atheroscle rotic stroke(a major ischemic stro ke subtype)that wo rsens outcomes and increases mortality.Disruption of the gut microbiota is an important feature of stroke,and some specific bacteria and bacterial metabolites may contribute to hemorrhagic transformation pathogenesis.We aimed to investigate the relationship between the gut microbiota and hemorrhagic transformation in largearte ry atheroscle rotic stro ke.An observational retrospective study was conducted.From May 2020 to September 2021,blood and fecal samples were obtained upon admission from 32 patients with first-ever acute ischemic stroke and not undergoing intravenous thrombolysis or endovascular thrombectomy,as well as 16 healthy controls.Patients with stro ke who developed hemorrhagic transfo rmation(n=15)were compared to those who did not develop hemorrhagic transformation(n=17)and with healthy controls.The gut microbiota was assessed through 16S ribosomal ribonucleic acid sequencing.We also examined key components of the lipopolysaccharide pathway:lipopolysaccharide,lipopolysaccharide-binding protein,and soluble CD14.We observed that bacterial diversity was decreased in both the hemorrhagic transformation and non-hemorrhagic transfo rmation group compared with the healthy controls.The patients with ischemic stro ke who developed hemorrhagic transfo rmation exhibited altered gut micro biota composition,in particular an increase in the relative abundance and dive rsity of members belonging to the Enterobacteriaceae family.Plasma lipopolysaccharide and lipopolysaccharide-binding protein levels were higher in the hemorrhagic transformation group compared with the non-hemorrhagic transfo rmation group.lipopolysaccharide,lipopolysaccharide-binding protein,and soluble CD14 concentrations were associated with increased abundance of Enterobacte riaceae.Next,the role of the gut microbiota in hemorrhagic transformation was evaluated using an experimental stroke rat model.In this model,transplantation of the gut microbiota from hemorrhagic transformation rats into the recipient rats triggered higher plasma levels of lipopolysaccharide,lipopolysaccharide-binding protein,and soluble CD14.Ta ken togethe r,our findings demonstrate a noticeable change in the gut microbiota and lipopolysaccharide-related inflammatory response in stroke patients with hemorrhagic transformation.This suggests that maintaining a balanced gut microbiota may be an important factor in preventing hemorrhagic transfo rmation after stro ke.展开更多
基金supported by the Shanghai Artificial Intelligence Laboratory and National Natural Science Foundation of China(Grant No.42088101 and 42030605).
文摘Recent studies have shown that deep learning(DL)models can skillfully forecast El Niño–Southern Oscillation(ENSO)events more than 1.5 years in advance.However,concerns regarding the reliability of predictions made by DL methods persist,including potential overfitting issues and lack of interpretability.Here,we propose ResoNet,a DL model that combines CNN(convolutional neural network)and transformer architectures.This hybrid architecture enables our model to adequately capture local sea surface temperature anomalies as well as long-range inter-basin interactions across oceans.We show that ResoNet can robustly predict ENSO at lead times of 19 months,thus outperforming existing approaches in terms of the forecast horizon.According to an explainability method applied to ResoNet predictions of El Niño and La Niña from 1-to 18-month leads,we find that it predicts the Niño-3.4 index based on multiple physically reasonable mechanisms,such as the recharge oscillator concept,seasonal footprint mechanism,and Indian Ocean capacitor effect.Moreover,we demonstrate for the first time that the asymmetry between El Niño and La Niña development can be captured by ResoNet.Our results could help to alleviate skepticism about applying DL models for ENSO prediction and encourage more attempts to discover and predict climate phenomena using AI methods.
基金supported in part by the Nationa Natural Science Foundation of China (61876011)the National Key Research and Development Program of China (2022YFB4703700)+1 种基金the Key Research and Development Program 2020 of Guangzhou (202007050002)the Key-Area Research and Development Program of Guangdong Province (2020B090921003)。
文摘Recently, there have been some attempts of Transformer in 3D point cloud classification. In order to reduce computations, most existing methods focus on local spatial attention,but ignore their content and fail to establish relationships between distant but relevant points. To overcome the limitation of local spatial attention, we propose a point content-based Transformer architecture, called PointConT for short. It exploits the locality of points in the feature space(content-based), which clusters the sampled points with similar features into the same class and computes the self-attention within each class, thus enabling an effective trade-off between capturing long-range dependencies and computational complexity. We further introduce an inception feature aggregator for point cloud classification, which uses parallel structures to aggregate high-frequency and low-frequency information in each branch separately. Extensive experiments show that our PointConT model achieves a remarkable performance on point cloud shape classification. Especially, our method exhibits 90.3% Top-1 accuracy on the hardest setting of ScanObjectN N. Source code of this paper is available at https://github.com/yahuiliu99/PointC onT.
基金supported by the National Key Research and Development Projects,Nos.2022 YFC3602400,2022 YFC3602401(to JX)the Project Program of National Clinical Research Center for Geriatric Disorders(Xiangya Hospital),No.2020LNJJ16(to JX)the National Natural Science Foundation of China,No.82271369(to JX)。
文摘Hemorrhagic transformation is a major complication of large-artery atheroscle rotic stroke(a major ischemic stro ke subtype)that wo rsens outcomes and increases mortality.Disruption of the gut microbiota is an important feature of stroke,and some specific bacteria and bacterial metabolites may contribute to hemorrhagic transformation pathogenesis.We aimed to investigate the relationship between the gut microbiota and hemorrhagic transformation in largearte ry atheroscle rotic stro ke.An observational retrospective study was conducted.From May 2020 to September 2021,blood and fecal samples were obtained upon admission from 32 patients with first-ever acute ischemic stroke and not undergoing intravenous thrombolysis or endovascular thrombectomy,as well as 16 healthy controls.Patients with stro ke who developed hemorrhagic transfo rmation(n=15)were compared to those who did not develop hemorrhagic transformation(n=17)and with healthy controls.The gut microbiota was assessed through 16S ribosomal ribonucleic acid sequencing.We also examined key components of the lipopolysaccharide pathway:lipopolysaccharide,lipopolysaccharide-binding protein,and soluble CD14.We observed that bacterial diversity was decreased in both the hemorrhagic transformation and non-hemorrhagic transfo rmation group compared with the healthy controls.The patients with ischemic stro ke who developed hemorrhagic transfo rmation exhibited altered gut micro biota composition,in particular an increase in the relative abundance and dive rsity of members belonging to the Enterobacteriaceae family.Plasma lipopolysaccharide and lipopolysaccharide-binding protein levels were higher in the hemorrhagic transformation group compared with the non-hemorrhagic transfo rmation group.lipopolysaccharide,lipopolysaccharide-binding protein,and soluble CD14 concentrations were associated with increased abundance of Enterobacte riaceae.Next,the role of the gut microbiota in hemorrhagic transformation was evaluated using an experimental stroke rat model.In this model,transplantation of the gut microbiota from hemorrhagic transformation rats into the recipient rats triggered higher plasma levels of lipopolysaccharide,lipopolysaccharide-binding protein,and soluble CD14.Ta ken togethe r,our findings demonstrate a noticeable change in the gut microbiota and lipopolysaccharide-related inflammatory response in stroke patients with hemorrhagic transformation.This suggests that maintaining a balanced gut microbiota may be an important factor in preventing hemorrhagic transfo rmation after stro ke.
