The widespread fake news in social networks is posing threats to social stability,economic development,and political democracy,etc.Numerous studies have explored the effective detection approaches of online fake news,...The widespread fake news in social networks is posing threats to social stability,economic development,and political democracy,etc.Numerous studies have explored the effective detection approaches of online fake news,while few works study the intrinsic propagation and cognition mechanisms of fake news.Since the development of cognitive science paves a promising way for the prevention of fake news,we present a new research area called Cognition Security(CogSec),which studies the potential impacts of fake news on human cognition,ranging from misperception,untrusted knowledge acquisition,targeted opinion/attitude formation,to biased decision making,and investigates the effective ways for fake news debunking.CogSec is a multidisciplinary research field that leverages the knowledge from social science,psychology,cognition science,neuroscience,AI and computer science.We first propose related definitions to characterize CogSec and review the literature history.We further investigate the key research challenges and techniques of CogSec,including human-content cognition mechanism,social influence and opinion dif-fusion,fake news detection,and malicious bot detection.Finally,we summarize the open issues and future research directions,such as the cognition mechanism of fake news,influence maximization of fact-checking information,early detection of fake news,fast refutation of fake news,and so on.展开更多
Recent advances in deep learning have led to disruptive breakthroughs in artificial intelligence(AI),fueling the jump in ChatGPT-like large language models(LLMs).As with any emerging technology,it is a two-sided coin,...Recent advances in deep learning have led to disruptive breakthroughs in artificial intelligence(AI),fueling the jump in ChatGPT-like large language models(LLMs).As with any emerging technology,it is a two-sided coin,bringing not only vast social impacts but also significant security concerns,especially in the socio-cognitive domain.Against this back-ground,this work starts with an inherent mechanism analysis of cognitive domain games,from which it proceeds to explore the security concerns facing the cognitive domain as well as to analyze the formation mechanisms of a cognitive immune system.Finally,inspired by behavioral mimicry in biology,this work will elaborate on new approaches to cognitive security from three aspects:Mimicry Computing,Mimicry Defense,and Mimicry Intelligence.展开更多
基金supported by the National Key R&D Program of China(2019QY0600)the National Natural Science Foundation of China(Grant Nos.61772428,61725205,61902320,61925203,U1636210)Beijing Advanced Innovation Center for Big Data and Brain Computing。
文摘The widespread fake news in social networks is posing threats to social stability,economic development,and political democracy,etc.Numerous studies have explored the effective detection approaches of online fake news,while few works study the intrinsic propagation and cognition mechanisms of fake news.Since the development of cognitive science paves a promising way for the prevention of fake news,we present a new research area called Cognition Security(CogSec),which studies the potential impacts of fake news on human cognition,ranging from misperception,untrusted knowledge acquisition,targeted opinion/attitude formation,to biased decision making,and investigates the effective ways for fake news debunking.CogSec is a multidisciplinary research field that leverages the knowledge from social science,psychology,cognition science,neuroscience,AI and computer science.We first propose related definitions to characterize CogSec and review the literature history.We further investigate the key research challenges and techniques of CogSec,including human-content cognition mechanism,social influence and opinion dif-fusion,fake news detection,and malicious bot detection.Finally,we summarize the open issues and future research directions,such as the cognition mechanism of fake news,influence maximization of fact-checking information,early detection of fake news,fast refutation of fake news,and so on.
基金supported in part by National Key R&D Plan(2022YFB3102901)
文摘Recent advances in deep learning have led to disruptive breakthroughs in artificial intelligence(AI),fueling the jump in ChatGPT-like large language models(LLMs).As with any emerging technology,it is a two-sided coin,bringing not only vast social impacts but also significant security concerns,especially in the socio-cognitive domain.Against this back-ground,this work starts with an inherent mechanism analysis of cognitive domain games,from which it proceeds to explore the security concerns facing the cognitive domain as well as to analyze the formation mechanisms of a cognitive immune system.Finally,inspired by behavioral mimicry in biology,this work will elaborate on new approaches to cognitive security from three aspects:Mimicry Computing,Mimicry Defense,and Mimicry Intelligence.
