A Study of Using Synthetic Data for Effective Association Knowledge Learning

Association,aiming to link bounding boxes of the same identity in a video sequence,is a central component in multi-object tracking(MOT).To train association modules,e.g.,parametric networks,real video data are usually used.However,annotating person tracks in consecutive video frames is expensive,and such real data,due to its inflexibility,offer us limited opportunities to evaluate the system performance w.r.t.changing tracking scenarios.In this paper,we study whether 3D synthetic data can replace real-world videos for association training.Specifically,we introduce a large-scale synthetic data engine named MOTX,where the motion characteristics of cameras and objects are manually configured to be similar to those of real-world datasets.We show that,compared with real data,association knowledge obtained from synthetic data can achieve very similar performance on real-world test sets without domain adaption techniques.Our intriguing observation is credited to two factors.First and foremost,3D engines can well simulate motion factors such as camera movement,camera view,and object movement so that the simulated videos can provide association modules with effective motion features.Second,the experimental results show that the appearance domain gap hardly harms the learning of association knowledge.In addition,the strong customization ability of MOTX allows us to quantitatively assess the impact of motion factors on MOT,which brings new insights to the community.

Knowledge Transfer Learning via Dual Density Sampling for Resource-Limited Domain Adaptation

Most existing domain adaptation(DA) methods aim to explore favorable performance under complicated environments by sampling.However,there are three unsolved problems that limit their efficiencies:ⅰ) they adopt global sampling but neglect to exploit global and local sampling simultaneously;ⅱ)they either transfer knowledge from a global perspective or a local perspective,while overlooking transmission of confident knowledge from both perspectives;and ⅲ) they apply repeated sampling during iteration,which takes a lot of time.To address these problems,knowledge transfer learning via dual density sampling(KTL-DDS) is proposed in this study,which consists of three parts:ⅰ) Dual density sampling(DDS) that jointly leverages two sampling methods associated with different views,i.e.,global density sampling that extracts representative samples with the most common features and local density sampling that selects representative samples with critical boundary information;ⅱ)Consistent maximum mean discrepancy(CMMD) that reduces intra-and cross-domain risks and guarantees high consistency of knowledge by shortening the distances of every two subsets among the four subsets collected by DDS;and ⅲ) Knowledge dissemination(KD) that transmits confident and consistent knowledge from the representative target samples with global and local properties to the whole target domain by preserving the neighboring relationships of the target domain.Mathematical analyses show that DDS avoids repeated sampling during the iteration.With the above three actions,confident knowledge with both global and local properties is transferred,and the memory and running time are greatly reduced.In addition,a general framework named dual density sampling approximation(DDSA) is extended,which can be easily applied to other DA algorithms.Extensive experiments on five datasets in clean,label corruption(LC),feature missing(FM),and LC&FM environments demonstrate the encouraging performance of KTL-DDS.

Guidelines for Creating a Rule-Based Knowledge Learning System and Their Application to a Chinese Business Card Layout Analysis

Rule selection has long been a problem of great challenge that has to be solved when developing a rule-based knowledge learning system. Many methods have been proposed to evaluate the eligibility of a single rule based on some criteria. However, in a knowledge learning system there is usually a set of rules. These rules are not independent, but interactive. They tend to affect each other and form a rulesystem. In such case, it is no longer reasonable to isolate each rule from others for evaluation. A best rule according to certain criterion is not always the best one for the whole system. Furthermore, the data in the real world from which people want to create their learning system are often ill-defined and inconsistent. In this case, the completeness and consistency criteria for rule selection are no longer essential. In this paper, some ideas about how to solve the rule-selection problem in a systematic way are proposed. These ideas have been applied in the design of a Chinese business card layout analysis system and gained a good result on the training data set of 425 images. The implementation of the system and the result are presented in this paper.

Method of Dynamic Knowledge Representation and Learning Based on Fuzzy Petri Nets

A method of knowledge representation and learning based on fuzzy Petri nets was designed. In this way the parameters of weights, threshold value and certainty factor in knowledge model can be adjusted dynamically. The advantages of knowledge representation based on production rules and neural networks were integrated into this method. Just as production knowledge representation, this method has clear structure and specific parameters meaning. In addition, it has learning and parallel reasoning ability as neural networks knowledge representation does. The result of simulation shows that the learning algorithm can converge, and the parameters of weights, threshold value and certainty factor can reach the ideal level after training.

Knowledge Graph Representation Reasoning for Recommendation System

In view of the low interpretability of existing collaborative filtering recommendation algorithms and the difficulty of extracting information from content-based recommendation algorithms,we propose an efficient KGRS model.KGRS first obtains reasoning paths of knowledge graph and embeds the entities of paths into vectors based on knowledge representation learning TransD algorithm,then uses LSTM and soft attention mechanism to capture the semantic of each path reasoning,then uses convolution operation and pooling operation to distinguish the importance of different paths reasoning.Finally,through the full connection layer and sigmoid function to get the prediction ratings,and the items are sorted according to the prediction ratings to get the user’s recommendation list.KGRS is tested on the movielens-100k dataset.Compared with the related representative algorithm,including the state-of-the-art interpretable recommendation models RKGE and RippleNet,the experimental results show that KGRS has good recommendation interpretation and higher recommendation accuracy.

Towards Integrated Testing Approach: An Application of Cognitive Science and Deep Learning Principle

The use of multiple-choice(MC)question types has been one of the most contentious issues in language testing.Much has been said and written about the use of MC over the years.However,no attempt has ever been made to introduce any innovation in test item types.The researchers proposed a jumbled words test item(JW)based on cognitive science and deep learning principles,and addressed the feasibility of replacing the type of multiple-choice(MC)question with JW to meet the ongoing rapid development of language testing practice.Two research questions were proposed ad hoc,focusing on the co-relationship between JW and MC scores.RASCH-GZ was used to perform item analyses(Rasch,1960).The item difficulty parameters thus obtained were used to compare the two different test items.The sample data metric includes 40 Chinese participants.The findings revealed that correlation analysis revealed that the performance of the same group of subjects taking both JW and MC was not relevant(Pearson Corr=0).This is primarily due to the total elimination of guessing factors inherent in test-takers during JW test performance.Three factors were specified for the design of the JW test:compute program,test difficulty,and score acceptability.These all have three dimensions.Data collected through questionnaires were analyzed using EFA in SPSS V.24.0.KMOs(=0.867)were found to be approximately one and significance at 0.000(0.05),indicating that the construct of theuestionnaire thus designed has better validity for factor analysis.Three important conclusions were obtained,the implications of which could provide impetus for our testing counterparts to practice more precisely and correctly,potentially reshaping our overall language testing practice.Limitations and recommendations for future research were also discussed.

An improved transfer learning strategy for short-term cross-building energy prediction usingdata incremental

The available modelling data shortage issue makes it difficult to guarantee the performance of data-driven building energy prediction(BEP)models for both the newly built buildings and existing information-poor buildings.Both knowledge transfer learning(KTL)and data incremental learning(DIL)can address the data shortage issue of such buildings.For new building scenarios with continuous data accumulation,the performance of BEP models has not been fully investigated considering the data accumulation dynamics.DIL,which can learn dynamic features from accumulated data adapting to the developing trend of new building time-series data and extend BEP model's knowledge,has been rarely studied.Previous studies have shown that the performance of KTL models trained with fixed data can be further improved in scenarios with dynamically changing data.Hence,this study proposes an improved transfer learning cross-BEP strategy continuously updated using the coarse data incremental(CDI)manner.The hybrid KTL-DIL strategy(LSTM-DANN-CDI)uses domain adversarial neural network(DANN)for KLT and long short-term memory(LSTM)as the Baseline BEP model.Performance evaluation is conducted to systematically qualify the effectiveness and applicability of KTL and improved KTL-DIL.Real-world data from six-type 36 buildings of six types are adopted to evaluate the performance of KTL and KTL-DIL in data-driven BEP tasks considering factors like the model increment time interval,the available target and source building data volumes.Compared with LSTM,results indicate that KTL(LSTM-DANN)and the proposed KTL-DIL(LSTM-DANN-CDI)can significantly improve the BEP performance for new buildings with limited data.Compared with the pure KTL strategy LSTM-DANN,the improved KTL-DIL strategy LSTM-DANN-CDI has better prediction performance with an average performance improvement ratio of 60%.

Exploring the Road to 6G: ABC-Foundation for Intelligent Mobile Networks

The 5 th generation(5 G)mobile networks has been put into services across a number of markets,which aims at providing subscribers with high bit rates,low latency,high capacity,many new services and vertical applications.Therefore the research and development on 6 G have been put on the agenda.Regarding demands and characteristics of future 6 G,artificial intelligence(A),big data(B)and cloud computing(C)will play indispensable roles in achieving the highest efficiency and the largest benefits.Interestingly,the initials of these three aspects remind us the significance of vitamin ABC to human body.In this article we specifically expound on the three elements of ABC and relationships in between.We analyze the basic characteristics of wireless big data(WBD)and the corresponding technical action in A and C,which are the high dimensional feature and spatial separation,the predictive ability,and the characteristics of knowledge.Based on the abilities of WBD,a new learning approach for wireless AI called knowledge+data-driven deep learning(KD-DL)method,and a layered computing architecture of mobile network integrating cloud/edge/terminal computing,is proposed,and their achievable efficiency is discussed.These progress will be conducive to the development of future 6 G.