Enhanced Autonomous Exploration and Mapping of an Unknown Environment with the Fusion of Dual RGB-D Sensors

The autonomous exploration and mapping of an unknown environment is useful in a wide range of applications and thus holds great significance. Existing methods mostly use range sensors to generate twodimensional (2D) grid maps. Red/green/blue-depth (RGB-D) sensors provide both color and depth information on the environment, thereby enabling the generation of a three-dimensional (3D) point cloud map that is intuitive for human perception. In this paper, we present a systematic approach with dual RGB-D sensors to achieve the autonomous exploration and mapping of an unknown indoor environment. With the synchronized and processed RGB-D data, location points were generated and a 3D point cloud map and 2D grid map were incrementally built. Next, the exploration was modeled as a partially observable Markov decision process. Partial map simulation and global frontier search methods were combined for autonomous exploration, and dynamic action constraints were utilized in motion control. In this way, the local optimum can be avoided and the exploration efficacy can be ensured. Experiments with single connected and multi-branched regions demonstrated the high robustness, efficiency, and superiority of the developed system and methods.

基于特征调节器和双路径引导的RGB-D室内语义分割

针对室内场景图像语义分割结果不精确、显著图粗糙的问题,提出一种基于多模态特征优化提取和双路径引导解码的网络架构(feature regulator and dual-path guidance,FG-Net)。具体来说,设计的特征调节器对每个阶段的多模态特征依次进行噪声过滤、重加权表示、差异性互补和交互融合,通过强化RGB和深度特征聚合,优化特征提取过程中的多模态特征表示。然后,在解码阶段引入特征交互融合后丰富的跨模态线索,进一步发挥多模态特征的优势。结合双路径协同引导结构,在解码阶段融合多尺度、多层次的特征信息,从而输出更细致的显著图。实验在公开数据集NYUD-v2和SUN RGB-D上进行,在主要评价指标mIoU上达到48.5%,优于其他先进算法。结果表明,该算法实现了更精细的室内场景图像语义分割,表现出了较好的泛化性和鲁棒性。

激光雷达与RGB-D相机融合的SLAM建图

对二维激光雷达与RGB-D相机联合标定,采用改进的ORB-SLAM2算法实现稠密的点云地图、八叉树地图、栅格地图的构建。提出了一种将Cartographer算法与改进的ORB-SLAM2算法融合建图的改进算法。实验结果表明,相比传统的ORB-SLAM2算法,改进的融合算法在建图过程中障碍物的识别率达到了96.8%,绝对位姿误差减小了53.2%,提高了建图的精确性和鲁棒性。

Collaborative positioning for swarms:A brief survey of vision,LiDAR and wireless sensors based methods

As positioning sensors,edge computation power,and communication technologies continue to develop,a moving agent can now sense its surroundings and communicate with other agents.By receiving spatial information from both its environment and other agents,an agent can use various methods and sensor types to localize itself.With its high flexibility and robustness,collaborative positioning has become a widely used method in both military and civilian applications.This paper introduces the basic fundamental concepts and applications of collaborative positioning,and reviews recent progress in the field based on camera,LiDAR(Light Detection and Ranging),wireless sensor,and their integration.The paper compares the current methods with respect to their sensor type,summarizes their main paradigms,and analyzes their evaluation experiments.Finally,the paper discusses the main challenges and open issues that require further research.

Progress of Proximity Sensors for Potential Applications in Electronic Skins

Recently,electronic skins and fl exible wearable devices have been developed for widespread applications in medical monitoring,artifi cial intelligence,human–machine interaction,and artifi cial prosthetics.Flexible proximity sensors can accurately perceive external objects without contact,introducing a new way to achieve an ultrasensitive perception of objects.This article reviews the progress of fl exible capacitive proximity sensors,fl exible triboelectric proximity sensors,and fl exible gate-enhanced proximity sensors,focusing on their applications in the electronic skin fi eld.Herein,their working mechanism,materials,preparation methods,and research progress are discussed in detail.Finally,we summarize the future challenges in developing fl exible proximity sensors.

轻量化改进XYZNet的RGB-D特征提取网络

针对用于位姿估计的RGB-D特征提取网络规模过于庞大的问题,提出一种轻量化改进XYZNet的RGB-D特征提取网络。首先设计一种轻量级子网络BaseNet以替换XYZNet中的ResNet18,使得网络规模显著下降的同时获得更强大的性能;然后基于深度可分离卷积设计一种多尺度卷积注意力子模块Rep-MSCA(re-parameterized multi-scale convolutional attention),加强BaseNet提取不同尺度上下文信息的能力,并约束模型的参数量;最后,为了以较小的参数代价提升XYZNet中PointNet的几何特征提取能力,设计一种残差多层感知器模块Rep-ResP(re-parameterized residual multi-layer perceptron)。改进后的网络浮点计算量与参数量分别降低了60.8%和64.8%,推理速度加快了21.2%,在主流数据集LineMOD与YCB-Video上分别取得了0.5%与0.6%的精度提升。改进后的网络更适宜在硬件资源紧张的场景下部署。

Advances of Electrochemical and Electrochemiluminescent Sensors Based on Covalent Organic Frameworks

Covalent organic frameworks(COFs),a rapidly developing category of crystalline conjugated organic polymers,possess highly ordered structures,large specific surface areas,stable chemical properties,and tunable pore microenvironments.Since the first report of boroxine/boronate ester-linked COFs in 2005,COFs have rapidly gained popularity,showing important application prospects in various fields,such as sensing,catalysis,separation,and energy storage.Among them,COFs-based electrochemical(EC)sensors with upgraded analytical performance are arousing extensive interest.In this review,therefore,we summarize the basic properties and the general synthesis methods of COFs used in the field of electroanalytical chemistry,with special emphasis on their usages in the fabrication of chemical sensors,ions sensors,immunosensors,and aptasensors.Notably,the emerged COFs in the electrochemiluminescence(ECL)realm are thoroughly covered along with their preliminary applications.Additionally,final conclusions on state-of-the-art COFs are provided in terms of EC and ECL sensors,as well as challenges and prospects for extending and improving the research and applications of COFs in electroanalytical chemistry.

基于多模态特征交互的RGB-D显著性目标检测

现有的大多数RGB-D显著性目标检测方法利用深度图来提高检测效果,而忽视了其质量的影响。低质量的深度图会对最终显著目标预测结果造成污染,影响显著性检测的性能。为了消除低质量深度图带来的干扰,并准确突出RGB图像中的显著目标,提出了一个用于多模态特征交互的RGB-D显著性目标检测模型。在编码阶段,设计了一个特征交互模块,其包含三个子模块:用于增强特征表述能力的全局特征采集子模块、用于过滤低质量深度信息的深度特征精炼子模块和用于实现特征融合的多模态特征交互子模块。在解码阶段,逐层融合经过特征交互后的多模态特征,实现多层次特征融合。通过在五个基准数据集上与十二种先进方法进行的综合实验表明,该模型在NLPR、SIP和NJU2K数据集上的指标上均优于其他对比方法,其中在NJU2K数据集上,该模型的性能比第二名在平均F值上提升了0.008,加权F值上提升了0.014,E-measure上提升了0.007,表现出了较好的检测效果。

跨模态交互融合与全局感知的RGB-D显著性目标检测

近年来,RGB-D显著性检测方法凭借深度图中丰富的几何结构和空间位置信息,取得了比RGB显著性检测模型更好的性能,受到学术界的高度关注.然而,现有的RGB-D检测模型仍面临着持续提升检测性能的需求.最近兴起的Transformer擅长建模全局信息,而卷积神经网络(CNN)擅长提取局部细节.因此,如何有效结合CNN和Transformer两者的优势,挖掘全局和局部信息,将有助于提升显著性目标检测的精度.为此,提出一种基于跨模态交互融合与全局感知的RGB-D显著性目标检测方法,通过将Transformer网络嵌入U-Net中,从而将全局注意力机制与局部卷积结合在一起,能够更好地对特征进行提取.首先借助U-Net编码-解码结构,高效地提取多层次互补特征并逐级解码生成显著特征图.然后,使用Transformer模块学习高级特征间的全局依赖关系增强特征表示,并针对输入采用渐进上采样融合策略以减少噪声信息的引入.其次,为了减轻低质量深度图带来的负面影响,设计一个跨模态交互融合模块以实现跨模态特征融合.最后,5个基准数据集上的实验结果表明,所提算法与其他最新的算法相比具有显著优势.

A Fuzzy Trust Management Mechanism with Dynamic Behavior Monitoring for Wireless Sensor Networks

Traditional wireless sensor networks(WSNs)are typically deployed in remote and hostile environments for information collection.The wireless communication methods adopted by sensor nodes may make the network highly vulnerable to various attacks.Traditional encryption and authentication mechanisms cannot prevent attacks launched by internal malicious nodes.The trust-based security mechanism is usually adopted to solve this problem in WSNs.However,the behavioral evidence used for trust estimation presents some uncertainties due to the open wireless medium and the inexpensive sensor nodes.Moreover,how to efficiently collect behavioral evidences are rarely discussed.To address these issues,in this paper,we present a trust management mechanism based on fuzzy logic and a cloud model.First,a type-II fuzzy logic system is used to preprocess the behavioral evidences and alleviate uncertainty.Then,the cloud model is introduced to estimate the trust values for sensor nodes.Finally,a dynamic behavior monitoring protocol is proposed to provide a balance between energy conservation and safety assurance.Simulation results demonstrate that our trust management mechanism can effectively protect the network from internal malicious attacks while enhancing the energy efficiency of behavior monitoring.

Rao Algorithms-Based Structure Optimization for Heterogeneous Wireless Sensor Networks

The structural optimization of wireless sensor networks is a critical issue because it impacts energy consumption and hence the network’s lifetime.Many studies have been conducted for homogeneous networks,but few have been performed for heterogeneouswireless sensor networks.This paper utilizes Rao algorithms to optimize the structure of heterogeneous wireless sensor networks according to node locations and their initial energies.The proposed algorithms lack algorithm-specific parameters and metaphorical connotations.The proposed algorithms examine the search space based on the relations of the population with the best,worst,and randomly assigned solutions.The proposed algorithms can be evaluated using any routing protocol,however,we have chosen the well-known routing protocols in the literature:Low Energy Adaptive Clustering Hierarchy(LEACH),Power-Efficient Gathering in Sensor Information Systems(PEAGSIS),Partitioned-based Energy-efficient LEACH(PE-LEACH),and the Power-Efficient Gathering in Sensor Information Systems Neural Network(PEAGSIS-NN)recent routing protocol.We compare our optimized method with the Jaya,the Particle Swarm Optimization-based Energy Efficient Clustering(PSO-EEC)protocol,and the hybrid Harmony Search Algorithm and PSO(HSA-PSO)algorithms.The efficiencies of our proposed algorithms are evaluated by conducting experiments in terms of the network lifetime(first dead node,half dead nodes,and last dead node),energy consumption,packets to cluster head,and packets to the base station.The experimental results were compared with those obtained using the Jaya optimization algorithm.The proposed algorithms exhibited the best performance.The proposed approach successfully prolongs the network lifetime by 71% for the PEAGSIS protocol,51% for the LEACH protocol,10% for the PE-LEACH protocol,and 73% for the PEGSIS-NN protocol;Moreover,it enhances other criteria such as energy conservation,fitness convergence,packets to cluster head,and packets to the base station.

The Fabrication and Detection Performance of High Sensitivity Au-Ag Alloy Nanostar/Paper Flexible Surface Enhanced Raman Spectroscopy Sensors

Au-Ag alloy nanostars based flexible paper surface enhanced Raman spectroscopy sensors were fabricated through simple nanostar coating on regular office paper,and the surface enhanced Raman spectroscopy detection performances were investigated using crystal violet dye analyte.Au-Ag nanostars with sharp tips were synthesized via metal ions reduction method.Transmission electron microscope images,X-Ray diffraction pattern and energy dispersive spectroscopy elemental mapping confirmed the nanostar geometry and Au/Ag components of the nanostructure.UV-Vis-NIR absorption spectrum shows wide local surface plasmon resonance induced optical extinction.In addition,finite-difference time-domain simulation shows much stronger electromagnetic field from nanostars than from sphere nanoparticle.The effect of coating layer on Raman signal intensities was discussed,and optimized 5-layer coating with best Raman signal was obtained.The Au-Ag nanostatrs homogeneously distribute on paper fiber surface.The detection limit is 10-10 M,and the relationship between analyte concentrations and Raman signal intensities shows well linear,for potential quantitative analysis.The calculated enhancement factor is 4.795×10^(6).The flexible paper surface enhanced Raman spectroscopy sensors could be applied for trace chemical and biology molecule detection.

Observer-based dynamic event-triggered control for distributed parameter systems over mobile sensor-plus-actuator networks

We develop a policy of observer-based dynamic event-triggered state feedback control for distributed parameter systems over a mobile sensor-plus-actuator network.It is assumed that the mobile sensing devices that provide spatially averaged state measurements can be used to improve state estimation in the network.For the purpose of decreasing the update frequency of controller and unnecessary sampled data transmission, an efficient dynamic event-triggered control policy is constructed.In an event-triggered system, when an error signal exceeds a specified time-varying threshold, it indicates the occurrence of a typical event.The global asymptotic stability of the event-triggered closed-loop system and the boundedness of the minimum inter-event time can be guaranteed.Based on the linear quadratic optimal regulator, the actuator selects the optimal displacement only when an event occurs.A simulation example is finally used to verify that the effectiveness of such a control strategy can enhance the system performance.

Flexible capacitive pressure sensor based on interdigital electrodes with porous microneedle arrays for physiological signal monitoring

Flexible pressure sensors have many potential applications in the monitoring of physiological signals because of their good biocompatibil-ity and wearability.However,their relatively low sensitivity,linearity,and stability have hindered their large-scale commercial application.Herein,aflexible capacitive pressure sensor based on an interdigital electrode structure with two porous microneedle arrays(MNAs)is pro-posed.The porous substrate that constitutes the MNA is a mixed product of polydimethylsiloxane and NaHCO3.Due to its porous and interdigital structure,the maximum sensitivity(0.07 kPa-1)of a porous MNA-based pressure sensor was found to be seven times higher than that of an imporous MNA pressure sensor,and it was much greater than that of aflat pressure sensor without a porous MNA structure.Finite-element analysis showed that the interdigital MNA structure can greatly increase the strain and improve the sensitivity of the sen-sor.In addition,the porous MNA-based pressure sensor was found to have good stability over 1500 loading cycles as a result of its bilayer parylene-enhanced conductive electrode structure.Most importantly,it was found that the sensor could accurately monitor the motion of afinger,wrist joint,arm,face,abdomen,eye,and Adam’s apple.Furthermore,preliminary semantic recognition was achieved by monitoring the movement of the Adam’s apple.Finally,multiple pressure sensors were integrated into a 33 array to detect a spatial pressure distribu-×tion.Compared to the sensors reported in previous works,the interdigital electrode structure presented in this work improves sensitivity and stability by modifying the electrode layer rather than the dielectric layer.

MXene-Based Elastomer Mimetic StretchableSensors: Design, Properties, and Applications

Flexible sensors based on MXene-polymer composites are highly prospective for next-generation wearable electronics used in human-machine interfaces.One of the motivating factors behind the progress of flexible sensors is the steady arrival of new conductive materials.MXenes,a new family of 2D nanomaterials,have been draw-ing attention since the last decade due to their high electronic conduc-tivity,processability,mechanical robustness and chemical tunability.In this review,we encompass the fabrication of MXene-based polymeric nanocomposites,their structure-property relationship,and applications in the flexible sensor domain.Moreover,our discussion is not only lim-ited to sensor design,their mechanism,and various modes of sensing platform,but also their future perspective and market throughout the world.With our article,we intend to fortify the bond between flexible matrices and MXenes thus promoting the swift advancement of flexible MXene-sensors for wearable technologies.

Mechanism analysis of regulating Turing instability and Hopf bifurcation of malware propagation in mobile wireless sensor networks

A dynamical model is constructed to depict the spatial-temporal evolution of malware in mobile wireless sensor networks(MWSNs). Based on such a model, we design a hybrid control scheme combining parameter perturbation and state feedback to effectively manipulate the spatiotemporal dynamics of malware propagation. The hybrid control can not only suppress the Turing instability caused by diffusion factor but can also adjust the occurrence of Hopf bifurcation induced by time delay. Numerical simulation results show that the hybrid control strategy can efficiently manipulate the transmission dynamics to achieve our expected desired properties, thus reducing the harm of malware propagation to MWSNs.

Implantable Electrochemical Microsensors for In Vivo Monitoring of Animal Physiological Information

In vivo monitoring of animal physiological information plays a crucial role in promptly alerting humans to potential diseases in animals and aiding in the exploration of mechanisms underlying human diseases.Currently,implantable electrochemical microsensors have emerged as a prominent area of research.These microsensors not only fulfill the technical requirements for monitoring animal physiological information but also offer an ideal platform for integration.They have been extensively studied for their ability to monitor animal physiological information in a minimally invasive manner,characterized by their bloodless,painless features,and exceptional performance.The development of implantable electrochemical microsensors for in vivo monitoring of animal physiological information has witnessed significant scientific and technological advancements through dedicated efforts.This review commenced with a comprehensive discussion of the construction of microsensors,including the materials utilized and the methods employed for fabrication.Following this,we proceeded to explore the various implantation technologies employed for electrochemical microsensors.In addition,a comprehensive overview was provided of the various applications of implantable electrochemical microsensors,specifically in the monitoring of diseases and the investigation of disease mechanisms.Lastly,a concise conclusion was conducted on the recent advancements and significant obstacles pertaining to the practical implementation of implantable electrochemical microsensors.

Isomeric fluorescence sensors for wide range detection of ionizing radiations

In order to achieve a wider range of ionizing radiations detection,novel fluorescence sensing materials have been developed that utilize the fluorescence enhancement phenomenon caused by the intramolecular photoinduced electron transfer(PET)effect.Two perylene diimide isomers PDI-P and PDI-B were designed and synthesized,and their molecular structures were characterized by high-resolution Fourier transform mass spectrometry(HRMS),nuclear magnetic resonance hydrogen and carbon spectroscopy(~1H and~(13)C NMR).The interaction between ionizing radiation and fluorescent molecules was simulated by HCl titration.The results show that combining PDIs and HCl can improve fluorescence through the retro-PET process.Despite the similarities in chemical structures,the fluorescent enhancement multiple of PDI-B with aromatic amine as electron donor is much higher than that of PDI-P with alkyl amine.In the direct irradiation experiments of ionizing radiation,the emission enhancement multiples of PDI-P and PDI-B are 2.01 and 45.4,respectively.Furthermore,density functional theory(DFT)and time-dependent density functional theory(TDDFT)calculations indicate that the HOMO and HOMO-1 energy ranges of PDI-P and PDI-B are 0.54 e V and 1.13 e V,respectively.A wider energy range has a stronger driving force on electrons,which is conducive to fluorescence quenching.Both femtosecond transient absorption spectroscopy(fs-TAS)and transient fluorescence spectroscopy(TFS)tests show that PDI-B has shorter charge separation lifetime and higher electron transfer rate constant.Although both isomers can significantly reduce LOD during PET process,PDI-B with aromatic amine has a wider detection range of 0.118—240 Gy due to its larger emission enhancement,which is a leap of three orders of magnitude.It breaks through the detection range of gamma radiation reported in existing studies,and provides theoretical support for the further study of sensitive and effective new materials for ionizing radiation detection.

An Insight Survey on Sensor Errors and Fault Detection Techniques in Smart Spaces

The widespread adoption of the Internet of Things (IoT) has transformed various sectors globally, making themmore intelligent and connected. However, this advancement comes with challenges related to the effectiveness ofIoT devices. These devices, present in offices, homes, industries, and more, need constant monitoring to ensuretheir proper functionality. The success of smart systems relies on their seamless operation and ability to handlefaults. Sensors, crucial components of these systems, gather data and contribute to their functionality. Therefore,sensor faults can compromise the system’s reliability and undermine the trustworthiness of smart environments.To address these concerns, various techniques and algorithms can be employed to enhance the performance ofIoT devices through effective fault detection. This paper conducted a thorough review of the existing literature andconducted a detailed analysis.This analysis effectively links sensor errors with a prominent fault detection techniquecapable of addressing them. This study is innovative because it paves theway for future researchers to explore errorsthat have not yet been tackled by existing fault detection methods. Significant, the paper, also highlights essentialfactors for selecting and adopting fault detection techniques, as well as the characteristics of datasets and theircorresponding recommended techniques. Additionally, the paper presents amethodical overview of fault detectiontechniques employed in smart devices, including themetrics used for evaluation. Furthermore, the paper examinesthe body of academic work related to sensor faults and fault detection techniques within the domain. This reflectsthe growing inclination and scholarly attention of researchers and academicians toward strategies for fault detectionwithin the realm of the Internet of Things.

面向RGB-D语义分割的多模态任意旋转自监督学习

基于RGB-D数据的自监督学习受到广泛关注,然而大多数方法侧重全局级别的表示学习,会丢失对识别对象至关重要的局部细节信息.由于RGB-D数据中图像和深度具有几何一致性,因此这可以作为线索来指导RGB-D数据的自监督特征表示学习.在本文中,我们提出了ArbRot,它可以无限制地旋转角度并为代理任务生成多个伪标签用于自监督学习,而且还建立了全局和局部之间的上下文联系.本文所提出的ArbRot可以与其他对比学习方法联合训练,构建多模态多代理任务自监督学习框架,以增强图像和深度视图的特征表示一致性,从而为RGB-D语义分割任务提供有效的初始化.在SUN RGB-D和NYU Depth Dataset V2数据集上的实验结果表明,多模态任意旋转自监督学习得到的特征表示质量均高于基线模型.开源代码:https://github.com/Physu/ArbRot.