A highly reliable encoding and decoding communication framework based on semantic information

Increasing research has focused on semantic communication,the goal of which is to convey accurately the meaning instead of transmitting symbols from the sender to the receiver.In this paper,we design a novel encoding and decoding semantic communication framework,which adopts the semantic information and the contextual correlations between items to optimize the performance of a communication system over various channels.On the sender side,the average semantic loss caused by the wrong detection is defined,and a semantic source encoding strategy is developed to minimize the average semantic loss.To further improve communication reliability,a decoding strategy that utilizes the semantic and the context information to recover messages is proposed in the receiver.Extensive simulation results validate the superior performance of our strategies over state-of-the-art semantic coding and decoding policies on different communication channels.

A Theory of Semantic Information(Invited Paper)

The information really useful to humans must be the trinity of its three components: the form termed syntactic information, the meaning termed semantic information, and the utility termed pragmatic information. But the theory of information set up by Shannon in 1948 is a statistical theory of syntactic information. Thus, the trinity of information theories needs to be established as urgently as possible. Such a theory of semantic information will be presented in the paper and it will also be proved that it is the semantic information that is the unique representative of the trinity. This is why the title of the paper is set to "a theory of semantic information" without mentioning the pragmatic information.

An improved pulse coupled neural networks model for semantic IoT

In recent years,the Internet of Things(IoT)has gradually developed applications such as collecting sensory data and building intelligent services,which has led to an explosion in mobile data traffic.Meanwhile,with the rapid development of artificial intelligence,semantic communication has attracted great attention as a new communication paradigm.However,for IoT devices,however,processing image information efficiently in real time is an essential task for the rapid transmission of semantic information.With the increase of model parameters in deep learning methods,the model inference time in sensor devices continues to increase.In contrast,the Pulse Coupled Neural Network(PCNN)has fewer parameters,making it more suitable for processing real-time scene tasks such as image segmentation,which lays the foundation for real-time,effective,and accurate image transmission.However,the parameters of PCNN are determined by trial and error,which limits its application.To overcome this limitation,an Improved Pulse Coupled Neural Networks(IPCNN)model is proposed in this work.The IPCNN constructs the connection between the static properties of the input image and the dynamic properties of the neurons,and all its parameters are set adaptively,which avoids the inconvenience of manual setting in traditional methods and improves the adaptability of parameters to different types of images.Experimental segmentation results demonstrate the validity and efficiency of the proposed self-adaptive parameter setting method of IPCNN on the gray images and natural images from the Matlab and Berkeley Segmentation Datasets.The IPCNN method achieves a better segmentation result without training,providing a new solution for the real-time transmission of image semantic information.

Semantic information processing in industrial networks

The industrial Internet of things(industrial IoT, IIoT) aims at connecting everything, which poses severe challenges to existing wireless communication. To handle the demand for massive access in future industrial networks, semantic information processing is integrated into communication systems so as to improve the effectiveness and efficiency of data transmission. The semantic paradigm is particularly suitable for the purpose-oriented information exchanging scheme in industrial networks. To illustrate its applicability, typical industrial data are investigated, i.e., time series and images. Simulation results demonstrate the superiority of semantic information processing, which achieves a better rate-utility tradeoff than conventional signal processing.

Adopting Context Mediation in Information Integration to Resolve Semantic Heterogeneity in Distributed Environment

Ontology-based semantic information integration resolve the schema-level heterogeneity and part of data level heterogeneity between distributed data sources. But it is ubiquitous that schema semantics of information is identical while the interpretation of it varies with different context, and ontology-based semantic information integration can not resolve this context heterogeneity. By introducing context representation and context mediation to ontology based information integration, the attribute-level context heterogeneity can be detected and reconciled automatically, and hence a complete solution for semantic heterogeneity is formed. Through a concrete example, the context representation and the process in which the attribute-level context heterogeneity is reconciled during query processing are presented. This resolution can make up the deficiency of schema mapping based semantic information integration. With the architecture proposed in this paper the semantic heterogeneity solution is adaptive and extensive.

Semantic-aware graph convolution network on multi-hop paths for link prediction

Knowledge graph(KG) link prediction aims to address the problem of missing multiple valid triples in KGs. Existing approaches either struggle to efficiently model the message passing process of multi-hop paths or lack transparency of model prediction principles. In this paper,a new graph convolutional network path semantic-aware graph convolution network(PSGCN) is proposed to achieve modeling the semantic information of multi-hop paths. PSGCN first uses a random walk strategy to obtain all-hop paths in KGs,then captures the semantics of the paths by Word2Sec and long shortterm memory(LSTM) models,and finally converts them into a potential representation for the graph convolution network(GCN) messaging process. PSGCN combines path-based inference methods and graph neural networks to achieve better interpretability and scalability. In addition,to ensure the robustness of the model,the value of the path thresholdKis experimented on the FB15K-237 and WN18RR datasets,and the final results prove the effectiveness of the model.

Toward Wisdom-Evolutionary and Primitive-Concise 6G:A New Paradigm of Semantic Communication Networks

The sixth generation(6G)mobile networks will reshape the world by offering instant,efficient,and intelligent hyper-connectivity,as envisioned by the previously proposed Ubiquitous-X 6G networks.Such hyper-massive and global connectivity will introduce tremendous challenges into the operation and management of 6G networks,calling for revolutionary theories and technological innovations.To this end,we propose a new route to boost network capabilities toward a wisdom-evolutionary and primitive-concise network(WePCN)vision for the Ubiquitous-X 6G network.In particular,we aim to concretize the evolution path toward the WePCN by first conceiving a new semantic representation framework,namely semantic base,and then establishing an intelligent and efficient semantic communication(IE-SC)network architecture.In the IE-SC architecture,a semantic intelligence plane is employed to interconnect the semantic-empowered physical-bearing layer,network protocol layer,and application-intent layer via semantic information flows.The proposed architecture integrates artificial intelligence and network technologies to enable intelligent interactions among various communication objects in 6G.It features a lower bandwidth requirement,less redundancy,and more accurate intent identification.We also present a brief review of recent advances in semantic communications and highlight potential use cases,complemented by a range of open challenges for 6G.

Edge Semantic Cognitive Intelligence for 6G Networks:Novel Theoretical Models,Enabling Framework,and Typical Applications

Edge intelligence is anticipated to underlay the pathway to connected intelligence for 6G networks,but the organic confluence of edge computing and artificial intelligence still needs to be carefully treated.To this end,this article discusses the concepts of edge intelligence from the semantic cognitive perspective.Two instructive theoretical models for edge semantic cognitive intelligence(ESCI)are first established.Afterwards,the ESCI framework orchestrating deep learning with semantic communication is discussed.Two representative applications are present to shed light on the prospect of ESCI in 6G networks.Some open problems are finally listed to elicit the future research directions of ESCI.

UGC-YOLO:Underwater Environment Object Detection Based on YOLO with a Global Context Block

With the continuous development and utilization of marine resources,the underwater target detection has gradually become a popular research topic in the field of underwater robot operations and target detection.However,it is difficult to combine the environmental semantic information and the semantic information of targets at different scales by detection algorithms due to the complex underwater environment.In this paper,a cascade model based on the UGC-YOLO network structure with high detection accuracy is proposed.The YOLOv3 convolutional neural network is employed as the baseline structure.By fusing the global semantic information between two residual stages in the parallel structure of the feature extraction network,the perception of underwater targets is improved and the detection rate of hard-to-detect underwater objects is raised.Furthermore,the deformable convolution is applied to capture longrange semantic dependencies and PPM pooling is introduced in the highest layer network for aggregating semantic information.Finally,a multi-scale weighted fusion approach is presented for learning semantic information at different scales.Experiments are conducted on an underwater test dataset and the results have demonstrated that our proposed algorithm could detect aquatic targets in complex degraded underwater images.Compared with the baseline network algorithm,the Common Objects in Context(COCO)evaluation metric has been improved by 4.34%.

Visual Object Tracking Based on Modified LeNet-5 and RCCF

The field of object tracking has recently made significant progress.Particularly,the performance results in both deep learning and correlation filters,based trackers achieved effective tracking performance.Moreover,there are still some difficulties with object tracking for example illumination and deformation(DEF).The precision and accuracy of tracking algorithms suffer from the effects of such occurrences.For this situation,finding a solution is important.This research proposes a new tracking algorithm to handle this problem.The features are extracted by using Modified LeNet-5,and the precision and accuracy are improved by developing the Real-Time Cross-modality Correlation Filtering method(RCCF).In Modified LeNet-5,the visual tracking performance is improved by adjusting the number and size of the convolution kernels in the pooling and convolution layers.The high-level,middle-level,and handcraft features are extracted from the modified LeNet-5 network.The handcraft features are used to determine the specific location of the target because the handcraft features contain more spatial information regarding the visual object.The LeNet features are more suitable for a target appearance change in object tracking.Extensive experiments were conducted by the Object Tracking Benchmarking(OTB)databases like OTB50 and OTB100.The experimental results reveal that the proposed tracker outperforms other state-of-the-art trackers under different problems.The experimental simulation is carried out in python.The overall success rate and precision of the proposed algorithm are 93.8%and 92.5%.The average running frame rate reaches 42 frames per second,which can meet the real-time requirements.

Advances and challenges in semantic communications:A systematic review

Inspired by the recent success of machine learning(ML),the concept of semantic communication introduced by Weaver in 1949 has gained significant attention and has become a promising research direction.Unlike conventional communication systems,semantic communication emphasizes the precise retrieval of conveyed meaning from the source to the receiver,rather than focusing on the accurate transmission of symbols.Thus,semantic communication can achieve a significant gain in source data compression,alleviate communication bandwidth pressure,and support new intelligent services,which is envisioned as a crucial enabler of future sixth-generation(6G)networks.In this review,we critically summarize the advances made in semantic information and semantic communications,including theory,architecture,and potential applications.Moreover,we deeply explore the major challenges in developing semantic communications and present the development prospects,aiming to prompt further scientific and industrial advances in semantic communications.

Product-design knowledge retrieval based on ontology

In order to improve the utilization ratio of knowledge retrieval, a product-design knowledge retrieval approach based on ontology is proposed. A representation model of product-design knowledge is proposed according to its characteristics. Domain ontology of product-design is estab- lished and the semantic annotation technology is used to connect the design knowledge and ontolo- gy. A new semantic annotation format is developed and semantic information of the design knowl- edge is enriched by making use of ontology. On that basis a retrieval algorithm is designed for semantic retrieval. Finally, this approach is used in a knowledge management system for military-vehi- cle design and its effectiveness and feasibility are validated. Results show that the recall ratio and the precision ratio of knowledge retrieval are improved greatly and users＇ requirements in semantic retrieval are satisfied.

An Efficient Grid Service Discovery Mechanism Based on the Locality Principle

With the explosion of services in grid environment, it＇s necessary to develop a mechanism which has the ability of discovering suitable grid services efficiently. This paper attempts to establish a layered resource management model based on the locality principle which classifies services into different domains and virtual organizations （VOs） according to their shared purposes. We propose an ontologybased search method applying the ontology theory for characterizing semantic information. In addition, we extend the UD- D1 in querying, storing, and so on. Simulation experiments have shown that our mechanism achieves higher performance in precision, recall and query response time.

ECG Biometrics via Enhanced Correlation and Semantic-rich Embedding

Electrocardiogram(ECG)biometric recognition has gained considerable attention,and various methods have been proposed to facilitate its development.However,one limitation is that the diversity of ECG signals affects the recognition performance.To address this issue,in this paper,we propose a novel ECG biometrics framework based on enhanced correlation and semantic-rich embedding.Firstly,we construct an enhanced correlation between the base feature and latent representation by using only one projection.Secondly,to fully exploit the semantic information,we take both the label and pairwise similarity into consideration to reduce the influence of ECG sample diversity.Furthermore,to solve the objective function,we propose an effective and efficient algorithm for optimization.Finally,extensive experiments are conducted on two benchmark datasets,and the experimental results show the effectiveness of our framework.

Semisupervised learning-based depth estimation with semantic inference guidance

Depth estimation is a fundamental computer vision problem that infers three-dimensional(3D)structures from a given scene.As it is an ill-posed problem,to fit the projection function from the given scene to the 3D structure,traditional methods generally require mass amounts of annotated data.Such pixel-level annotation is quite labor consuming,especially when addressing reflective surfaces such as mirrors or water.The widespread application of deep learning further intensifies the demand for large amounts of annotated data.Therefore,it is urgent and necessary to propose a framework that is able to reduce the requirement on the amount of data.In this paper,we propose a novel semisupervised learning framework to infer the 3D structure from the given scene.First,semantic information is employed to make the depth inference more accurate.Second,we make both the depth estimation and semantic segmentation coarse-to-fine frameworks;thus,the depth estimation can be gradually guided by semantic segmentation.We compare our model with state-of-the-art methods.The experimental results demonstrate that our method is better than many supervised learning-based methods,which proves the effectiveness of the proposed method.

Enhancing N-Gram Based Metrics with Semantics for Better Evaluation of Abstractive Text Summarization

Text summarization is an important task in natural language processing and it has been applied in many applications.Recently,abstractive summarization has attracted many attentions.However,the traditional evaluation metrics that consider little semantic information,are unsuitable for evaluating the quality of deep learning based abstractive summarization models,since these models may generate new words that do not exist in the original text.Moreover,the out-of-vocabulary(OOV)problem that affects the evaluation results,has not been well solved yet.To address these issues,we propose a novel model called ENMS,to enhance existing N-gram based evaluation metrics with semantics.To be specific,we present two types of methods:N-gram based Semantic Matching(NSM for short),and N-gram based Semantic Similarity(NSS for short),to improve several widely-used evaluation metrics including ROUGE(Recall-Oriented Understudy for Gisting Evaluation),BLEU(Bilingual Evaluation Understudy),etc.NSM and NSS work in different ways.The former calculates the matching degree directly,while the latter mainly improves the similarity measurement.Moreover we propose an N-gram representation mechanism to explore the vector representation of N-grams(including skip-grams).It serves as the basis of our ENMS model,in which we exploit some simple but effective integration methods to solve the OOV problem efficiently.Experimental results over the TAC AESOP dataset show that the metrics improved by our methods are well correlated with human judgements and can be used to better evaluate abstractive summarization methods.

MIMS:Towards a Message Interface Based Memory System

The decades-old synchronous memory bus interface has restricted many innovations in the memory system, which is facing various challenges （or walls） in the era of multi-core and big data. In this paper, we argue that a message- based interface should be adopted to replace the traditional bus-based interface in the memory system. A novel message interface based memory system called MIMS is proposed. The key innovation of MIMS is that processors communicate with the memory system through a universal and flexible message packet interface. Each message packet is allowed to encapsulate multiple memory requests （or commands） and additional semantic information. The memory system is more intelligent and active by equipping with a local buffer scheduler, which is responsible for processing packets, scheduling memory requests, preparing responses, and executing specific commands with the help of semantic information. Under the MIMS framework, many previous innovations on memory architecture as well as new optimization opportunities such as address compression and continuous requests combination can be naturally incorporated. The experimental results on a 16-core cycle-detailed simulation system show that： with accurate granularity message, MIMS can improve system performance by 53.21% and reduce energy delay product （EDP） by 55.90%. Furthermore, it can improve effective bandwidth utilization by 62.42% and reduce memory access latency by 51% on average.

Abstraction of informed virtual geographic environments

We propose a novel method for the automated generation of virtual geographic environments that allows using geographic information system data to build what we call informed virtual geographic environment(IVGE).The description of an IVGE integrates semantic information expressed using conceptual graphs,a standard knowledge representation technique.In addition,we propose an abstraction process that uses geometric,topologic,and semantic characteristics of geographic features to build a hierarchical graph-based structure describing this IVGE.Our IVGE model enables the support of large-scale and complex geographic environment modeling for multiagent geo-simulations in which the agents are situated and with which they interact.

Spatial simulation using abstraction of virtual geographic environments

In this paper,we address two challenging issues underlying spatial simulation using software agents immersed in virtual geographic environments(VGE).First,the way to describe virtual VGE models using accurate spatial decomposition approaches structured using graph theory techniques.Second,the use of graph abstraction techniques to support realistic and advanced navigation and path planning capabilities for software agents considering the VGE’s characteristics.In order to illustrate our contributions to the growing field of spatial simulations,we present and discuss a case study involving an urban VGE model populated with agents who autonomously and differently interact with multiple abstractions of the same physical environment.