In the technique of video multi-target tracking,the common particle filter can not deal well with uncertain relations among multiple targets.To solve this problem,many researchers use data association method to reduce...In the technique of video multi-target tracking,the common particle filter can not deal well with uncertain relations among multiple targets.To solve this problem,many researchers use data association method to reduce the multi-target uncertainty.However,the traditional data association method is difficult to track accurately when the target is occluded.To remove the occlusion in the video,combined with the theory of data association,this paper adopts the probabilistic graphical model for multi-target modeling and analysis of the targets relationship in the particle filter framework.Ex-perimental results show that the proposed algorithm can solve the occlusion problem better compared with the traditional algorithm.展开更多
Knowledge tracing aims to track students’knowledge status over time to predict students’future performance accurately.In a real environment,teachers expect knowledge tracing models to provide the interpretable resul...Knowledge tracing aims to track students’knowledge status over time to predict students’future performance accurately.In a real environment,teachers expect knowledge tracing models to provide the interpretable result of knowledge status.Markov chain-based knowledge tracing(MCKT)models,such as Bayesian Knowledge Tracing,can track knowledge concept mastery probability over time.However,as the number of tracked knowledge concepts increases,the time complexity of MCKT predicting student performance increases exponentially(also called explaining away problem).When the number of tracked knowledge concepts is large,we cannot utilize MCKT to track knowledge concept mastery probability over time.In addition,the existing MCKT models only consider the relationship between students’knowledge status and problems when modeling students’responses but ignore the relationship between knowledge concepts in the same problem.To address these challenges,we propose an inTerpretable pRobAbilistiC gEnerative moDel(TRACED),which can track students’numerous knowledge concepts mastery probabilities over time.To solve explain away problem,we design long and short-term memory(LSTM)-based networks to approximate the posterior distribution,predict students’future performance,and propose a heuristic algorithm to train LSTMs and probabilistic graphical model jointly.To better model students’exercise responses,we proposed a logarithmic linear model with three interactive strategies,which models students’exercise responses by considering the relationship among students’knowledge status,knowledge concept,and problems.We conduct experiments with four real-world datasets in three knowledge-driven tasks.The experimental results show that TRACED outperforms existing knowledge tracing methods in predicting students’future performance and can learn the relationship among students,knowledge concepts,and problems from students’exercise sequences.We also conduct several case studies.The case studies show that TRACED exhibits excellent interpretability and thus has the potential for personalized automatic feedback in the real-world educational environment.展开更多
Probabilistic graphical models(PGMs)can effectively deal with the problems of energy consumption and occupancy prediction,fault detection and diagnosis,reliability analysis,and optimization in energy systems.Compared ...Probabilistic graphical models(PGMs)can effectively deal with the problems of energy consumption and occupancy prediction,fault detection and diagnosis,reliability analysis,and optimization in energy systems.Compared with the black-box models,PGMs show advantages in model interpretability,scalability and reliability.They have great potential to realize the true artificial intelligence in energy systems of the next generation.This paper intends to provide a comprehensive review of the PGM-based approaches published in the last decades.It reveals the advantages,limitations and potential future research directions of the PGM-based approaches for energy systems.Two types of PGMs are summarized in this review,including static models(SPGMs)and dynamic models(DPGMs).SPGMs can conduct probabilistic inference based on incomplete,uncertain or even conflicting information.SPGM-based approaches are proposed to deal with various management tasks in energy systems.They show outstanding performance in fault detection and diagnosis of energy systems.DPGMs can represent a dynamic and stochastic process by describing how its state changes with time.DPGM-based approaches have high accuracy in predicting the energy consumption,occupancy and failures of energy systems.In the future,a unified framework is suggested to fuse the knowledge-driven and data-driven PGMs for achieving better performances.Universal PGM-based approaches are needed that can be adapted to various energy systems.Hybrid algorithms would outperform the basic PGMs by integrating advanced techniques such as deep learning and first-order logic.展开更多
A neuroprosthesis is a type of precision medical device that is intended to manipulate the neuronal signals of the brain in a closed-loop fashion,while simultaneously receiving stimuli from the environment and control...A neuroprosthesis is a type of precision medical device that is intended to manipulate the neuronal signals of the brain in a closed-loop fashion,while simultaneously receiving stimuli from the environment and controlling some part of a human brain or body.Incoming visual information can be processed by the brain in millisecond intervals.The retina computes visual scenes and sends its output to the cortex in the form of neuronal spikes for further computation.Thus,the neuronal signal of interest for a retinal neuroprosthesis is the neuronal spike.Closed-loop computation in a neuroprosthesis includes two stages:encoding a stimulus as a neuronal signal,and decoding it back into a stimulus.In this paper,we review some of the recent progress that has been achieved in visual computation models that use spikes to analyze natural scenes that include static images and dynamic videos.We hypothesize that in order to obtain a better understanding of the computational principles in the retina,a hypercircuit view of the retina is necessary,in which the different functional network motifs that have been revealed in the cortex neuronal network are taken into consideration when interacting with the retina.The different building blocks of the retina,which include a diversity of cell types and synaptic connections-both chemical synapses and electrical synapses(gap junctions)-make the retina an ideal neuronal network for adapting the computational techniques that have been developed in artificial intelligence to model the encoding and decoding of visual scenes.An overall systems approach to visual computation with neuronal spikes is necessary in order to advance the next generation of retinal neuroprosthesis as an artificial visual system.展开更多
Online automatic fault diagnosis in industrial systems is essential for guaranteeing safe, reliable and efficient operations.However, difficulties associated with computational overload, ubiquitous uncertainties and i...Online automatic fault diagnosis in industrial systems is essential for guaranteeing safe, reliable and efficient operations.However, difficulties associated with computational overload, ubiquitous uncertainties and insufficient fault samples hamper the engineering application of intelligent fault diagnosis technology. Geared towards the settlement of these problems, this paper introduces the method of dynamic uncertain causality graph, which is a new attempt to model complex behaviors of real-world systems under uncertainties. The visual representation to causality pathways and self-relied "chaining" inference mechanisms are analyzed. In particular, some solutions are investigated for the diagnostic reasoning algorithm to aim at reducing its computational complexity and improving the robustness to potential losses and imprecisions in observations. To evaluate the effectiveness and performance of this method, experiments are conducted using both synthetic calculation cases and generator faults of a nuclear power plant. The results manifest the high diagnostic accuracy and efficiency, suggesting its practical significance in large-scale industrial applications.展开更多
Cognitive diagnosis is an important issue of intelligent education systems,which aims to estimate students'proficiency on specific knowledge concepts.Most existing studies rely on the assumption of static student ...Cognitive diagnosis is an important issue of intelligent education systems,which aims to estimate students'proficiency on specific knowledge concepts.Most existing studies rely on the assumption of static student states and ig-nore the dynamics of proficiency in the learning process,which makes them unsuitable for online learning scenarios.In this paper,we propose a unified temporal item response theory(UTIRT)framework,incorporating temporality and random-ness of proficiency evolving to get both accurate and interpretable diagnosis results.Specifically,we hypothesize that stu-dents'proficiency varies as a Wiener process and describe a probabilistic graphical model in UTIRT to consider temporali-ty and randomness factors.Furthermore,based on the relationship between student states and exercising answers,we hy-pothesize that the answering result at time k contributes most to inferring a student's proficiency at time k,which also re-flects the temporality aspect and enables us to get analytical maximization(M-step)in the expectation maximization(EM)algorithm when estimating model parameters.Our UTIRT is a framework containing unified training and inferenc-ing methods,and is general to cover several typical traditional models such as Item Response Theory(IRT),multidimen-sional IRT(MIRT),and temporal IRT(TIRT).Extensive experimental results on real-world datasets show the effective-ness of UTIRT and prove its superiority in leveraging temporality theoretically and practically over TIRT.展开更多
Content-based video copy detection is an active research field due to the need for copyright pro- tection and business intellectual property protection. This paper gives a probabilistic spatiotemporal fusion approach ...Content-based video copy detection is an active research field due to the need for copyright pro- tection and business intellectual property protection. This paper gives a probabilistic spatiotemporal fusion approach for video copy detection. This approach directly estimates the location of the copy segment with a probabilistic graphical model. The spatial and temporal consistency of the video copy is embedded in the local probability function. An effective local descriptor and a two-level descriptor pairing method are used to build a video copy detection system to evaluate the approach. Tests show that it outperforms the popular voting algorithm and the probabilistic fusion framework based on the Hidden Markov Model, improving F-score (F1) by 8%.展开更多
Some microblog services encourage users to annotate themselves with multiple tags, indicating their attributes and interests. User tags play an important role for personalized recommendation and information retrieval....Some microblog services encourage users to annotate themselves with multiple tags, indicating their attributes and interests. User tags play an important role for personalized recommendation and information retrieval. In order to better understand the semantics of user tags, we propose Tag Correspondence Model (TCM) to identify complex correspondences of tags from the rich context of microblog users. The correspondence of a tag is referred to as a unique element in the context which is semantically correlated with this tag. In TCM, we divide the context of a microblog user into various sources (such as short messages, user profile, and neighbors). With a collection of users with annotated tags, TCM can automatically learn the correspondences of user tags from multiple sources. With the learned correspondences, we are able to interpret implicit semantics of tags. Moreover, for the users who have not annotated any tags, TCM can suggest tags according to users' context information. Extensive experiments on a real-world dataset demonstrate that our method can efficiently identify correspondences of tags, which may eventually represent semantic meanings of tags.展开更多
基金Supported by the National High Technology Research and Development Program of China (No. 2007AA11Z227)the Natural Science Foundation of Jiangsu Province of China(No. BK2009352)the Fundamental Research Funds for the Central Universities of China (No. 2010B16414)
文摘In the technique of video multi-target tracking,the common particle filter can not deal well with uncertain relations among multiple targets.To solve this problem,many researchers use data association method to reduce the multi-target uncertainty.However,the traditional data association method is difficult to track accurately when the target is occluded.To remove the occlusion in the video,combined with the theory of data association,this paper adopts the probabilistic graphical model for multi-target modeling and analysis of the targets relationship in the particle filter framework.Ex-perimental results show that the proposed algorithm can solve the occlusion problem better compared with the traditional algorithm.
基金supported by the National Natural Science Foundation of China(Grant Nos.62272093,62137001,U1811261,and 61902055).
文摘Knowledge tracing aims to track students’knowledge status over time to predict students’future performance accurately.In a real environment,teachers expect knowledge tracing models to provide the interpretable result of knowledge status.Markov chain-based knowledge tracing(MCKT)models,such as Bayesian Knowledge Tracing,can track knowledge concept mastery probability over time.However,as the number of tracked knowledge concepts increases,the time complexity of MCKT predicting student performance increases exponentially(also called explaining away problem).When the number of tracked knowledge concepts is large,we cannot utilize MCKT to track knowledge concept mastery probability over time.In addition,the existing MCKT models only consider the relationship between students’knowledge status and problems when modeling students’responses but ignore the relationship between knowledge concepts in the same problem.To address these challenges,we propose an inTerpretable pRobAbilistiC gEnerative moDel(TRACED),which can track students’numerous knowledge concepts mastery probabilities over time.To solve explain away problem,we design long and short-term memory(LSTM)-based networks to approximate the posterior distribution,predict students’future performance,and propose a heuristic algorithm to train LSTMs and probabilistic graphical model jointly.To better model students’exercise responses,we proposed a logarithmic linear model with three interactive strategies,which models students’exercise responses by considering the relationship among students’knowledge status,knowledge concept,and problems.We conduct experiments with four real-world datasets in three knowledge-driven tasks.The experimental results show that TRACED outperforms existing knowledge tracing methods in predicting students’future performance and can learn the relationship among students,knowledge concepts,and problems from students’exercise sequences.We also conduct several case studies.The case studies show that TRACED exhibits excellent interpretability and thus has the potential for personalized automatic feedback in the real-world educational environment.
基金supported by the National Key Research and Development Program of China(No.2018YFE0116300)the National Natural Science Foundation of China(No.51978601).
文摘Probabilistic graphical models(PGMs)can effectively deal with the problems of energy consumption and occupancy prediction,fault detection and diagnosis,reliability analysis,and optimization in energy systems.Compared with the black-box models,PGMs show advantages in model interpretability,scalability and reliability.They have great potential to realize the true artificial intelligence in energy systems of the next generation.This paper intends to provide a comprehensive review of the PGM-based approaches published in the last decades.It reveals the advantages,limitations and potential future research directions of the PGM-based approaches for energy systems.Two types of PGMs are summarized in this review,including static models(SPGMs)and dynamic models(DPGMs).SPGMs can conduct probabilistic inference based on incomplete,uncertain or even conflicting information.SPGM-based approaches are proposed to deal with various management tasks in energy systems.They show outstanding performance in fault detection and diagnosis of energy systems.DPGMs can represent a dynamic and stochastic process by describing how its state changes with time.DPGM-based approaches have high accuracy in predicting the energy consumption,occupancy and failures of energy systems.In the future,a unified framework is suggested to fuse the knowledge-driven and data-driven PGMs for achieving better performances.Universal PGM-based approaches are needed that can be adapted to various energy systems.Hybrid algorithms would outperform the basic PGMs by integrating advanced techniques such as deep learning and first-order logic.
基金supported by the National Basic Research Program of China(2015CB351806)the National Natural Science Foundation of China(61806011,61825101,61425025,and U1611461)+4 种基金the National Postdoctoral Program for Innovative Talents(BX20180005)the China Postdoctoral Science Foundation(2018M630036)the International Talent Exchange Program of Beijing Municipal Commission of Science and Technology(Z181100001018026)the Zhejiang Lab(2019KC0AB03 and 2019KC0AD02)the Royal Society Newton Advanced Fellowship(NAF-R1-191082).
文摘A neuroprosthesis is a type of precision medical device that is intended to manipulate the neuronal signals of the brain in a closed-loop fashion,while simultaneously receiving stimuli from the environment and controlling some part of a human brain or body.Incoming visual information can be processed by the brain in millisecond intervals.The retina computes visual scenes and sends its output to the cortex in the form of neuronal spikes for further computation.Thus,the neuronal signal of interest for a retinal neuroprosthesis is the neuronal spike.Closed-loop computation in a neuroprosthesis includes two stages:encoding a stimulus as a neuronal signal,and decoding it back into a stimulus.In this paper,we review some of the recent progress that has been achieved in visual computation models that use spikes to analyze natural scenes that include static images and dynamic videos.We hypothesize that in order to obtain a better understanding of the computational principles in the retina,a hypercircuit view of the retina is necessary,in which the different functional network motifs that have been revealed in the cortex neuronal network are taken into consideration when interacting with the retina.The different building blocks of the retina,which include a diversity of cell types and synaptic connections-both chemical synapses and electrical synapses(gap junctions)-make the retina an ideal neuronal network for adapting the computational techniques that have been developed in artificial intelligence to model the encoding and decoding of visual scenes.An overall systems approach to visual computation with neuronal spikes is necessary in order to advance the next generation of retinal neuroprosthesis as an artificial visual system.
基金supported by the National Natural Science Foundation of China(Nos.61050005 and 61273330)Research Foundation for the Doctoral Program of China Ministry of Education(No.20120002110037)+1 种基金the 2014 Teaching Reform Project of Shandong Normal UniversityDevelopment Project of China Guangdong Nuclear Power Group(No.CNPRI-ST10P005)
文摘Online automatic fault diagnosis in industrial systems is essential for guaranteeing safe, reliable and efficient operations.However, difficulties associated with computational overload, ubiquitous uncertainties and insufficient fault samples hamper the engineering application of intelligent fault diagnosis technology. Geared towards the settlement of these problems, this paper introduces the method of dynamic uncertain causality graph, which is a new attempt to model complex behaviors of real-world systems under uncertainties. The visual representation to causality pathways and self-relied "chaining" inference mechanisms are analyzed. In particular, some solutions are investigated for the diagnostic reasoning algorithm to aim at reducing its computational complexity and improving the robustness to potential losses and imprecisions in observations. To evaluate the effectiveness and performance of this method, experiments are conducted using both synthetic calculation cases and generator faults of a nuclear power plant. The results manifest the high diagnostic accuracy and efficiency, suggesting its practical significance in large-scale industrial applications.
基金supported by the National Key Research and Development Program of China under Grant No.2021YFF0901003the National Natural Science Foundation of China under Grant Nos.U20A20229,61922073,and 62106244the Natural Science Foundation of Anhui Province of China under Grant No.2108085QF272.
文摘Cognitive diagnosis is an important issue of intelligent education systems,which aims to estimate students'proficiency on specific knowledge concepts.Most existing studies rely on the assumption of static student states and ig-nore the dynamics of proficiency in the learning process,which makes them unsuitable for online learning scenarios.In this paper,we propose a unified temporal item response theory(UTIRT)framework,incorporating temporality and random-ness of proficiency evolving to get both accurate and interpretable diagnosis results.Specifically,we hypothesize that stu-dents'proficiency varies as a Wiener process and describe a probabilistic graphical model in UTIRT to consider temporali-ty and randomness factors.Furthermore,based on the relationship between student states and exercising answers,we hy-pothesize that the answering result at time k contributes most to inferring a student's proficiency at time k,which also re-flects the temporality aspect and enables us to get analytical maximization(M-step)in the expectation maximization(EM)algorithm when estimating model parameters.Our UTIRT is a framework containing unified training and inferenc-ing methods,and is general to cover several typical traditional models such as Item Response Theory(IRT),multidimen-sional IRT(MIRT),and temporal IRT(TIRT).Extensive experimental results on real-world datasets show the effective-ness of UTIRT and prove its superiority in leveraging temporality theoretically and practically over TIRT.
基金Supported by the National Key Basic Research and Development (863) Program of China (No. 2007CB311003)
文摘Content-based video copy detection is an active research field due to the need for copyright pro- tection and business intellectual property protection. This paper gives a probabilistic spatiotemporal fusion approach for video copy detection. This approach directly estimates the location of the copy segment with a probabilistic graphical model. The spatial and temporal consistency of the video copy is embedded in the local probability function. An effective local descriptor and a two-level descriptor pairing method are used to build a video copy detection system to evaluate the approach. Tests show that it outperforms the popular voting algorithm and the probabilistic fusion framework based on the Hidden Markov Model, improving F-score (F1) by 8%.
基金the National Natural Science Foundation of China under Grant Nos. 61170196 and 61202140, and the Major Project of the National Social Science Foundation of China under Grant No. 13&ZD190.
文摘Some microblog services encourage users to annotate themselves with multiple tags, indicating their attributes and interests. User tags play an important role for personalized recommendation and information retrieval. In order to better understand the semantics of user tags, we propose Tag Correspondence Model (TCM) to identify complex correspondences of tags from the rich context of microblog users. The correspondence of a tag is referred to as a unique element in the context which is semantically correlated with this tag. In TCM, we divide the context of a microblog user into various sources (such as short messages, user profile, and neighbors). With a collection of users with annotated tags, TCM can automatically learn the correspondences of user tags from multiple sources. With the learned correspondences, we are able to interpret implicit semantics of tags. Moreover, for the users who have not annotated any tags, TCM can suggest tags according to users' context information. Extensive experiments on a real-world dataset demonstrate that our method can efficiently identify correspondences of tags, which may eventually represent semantic meanings of tags.