Multimodal Sentiment Analysis Using BiGRU and Attention-Based Hybrid Fusion Strategy

Recently,multimodal sentiment analysis has increasingly attracted attention with the popularity of complementary data streams,which has great potential to surpass unimodal sentiment analysis.One challenge of multimodal sentiment analysis is how to design an efficient multimodal feature fusion strategy.Unfortunately,existing work always considers feature-level fusion or decision-level fusion,and few research works focus on hybrid fusion strategies that contain feature-level fusion and decision-level fusion.To improve the performance of multimodal sentiment analysis,we present a novel multimodal sentiment analysis model using BiGRU and attention-based hybrid fusion strategy(BAHFS).Firstly,we apply BiGRU to learn the unimodal features of text,audio and video.Then we fuse the unimodal features into bimodal features using the bimodal attention fusion module.Next,BAHFS feeds the unimodal features and bimodal features into the trimodal attention fusion module and the trimodal concatenation fusion module simultaneously to get two sets of trimodal features.Finally,BAHFS makes a classification with the two sets of trimodal features respectively and gets the final analysis results with decision-level fusion.Based on the CMU-MOSI and CMU-MOSEI datasets,extensive experiments have been carried out to verify BAHFS’s superiority.

Mafic Archean continental crust prohibited exhumation of orogenic UHP eclogite

The absence of ultrahigh pressure(UHP)orogenic eclogite in the geological record older than c.0.6 Ga is problematic for evidence of subduction having begun on Earth during the Archean(4.0-2.5 Ga).Many eclogites in Phanerozoic and Proterozoic terranes occur as mafic boudins encased within low-density felsic crust,which provides positive buoyancy during subduction;however,recent geochemical proxy analysis shows that Archean continental crust was more mafic than previously thought,having greater proportions of basalt and komatiite than modern-day continents.Here,we show via petrological modelling that secular change in the petrology and bulk composition of upper continental crust would make Archean continental terranes negatively buoyant in the mantle before reaching UHP conditions.Subducted or delaminated Archean continental crust passes a point of no return during metamorphism in the mantle prior to the stabilization of coesite,while Proterozoic and Phanerozoic terranes remain positively buoyant at these depths.UHP orogenic eclogite may thus readily have formed on the Archean Earth,but could not have been exhumed,weakening arguments for a Neoproterozoic onset of subduction and plate tectonics.Further,isostatic balance calculations for more mafic Archean continents indicate that the early Earth was covered by a global ocean over 1 km deep,corroborating independent isotopic evidence for large-scale emergence of the continents no earlier than c.3 Ga.Our findings thus weaken arguments that early life on Earth likely emerged in shallow subaerial ponds,and instead support hypotheses involving development at hydrothermal vents in the deep ocean.