Deep Reinforcement Learning Based Mobile Robot Navigation:A Review

Navigation is a fundamental problem of mobile robots,for which Deep Reinforcement Learning(DRL)has received significant attention because of its strong representation and experience learning abilities.There is a growing trend of applying DRL to mobile robot navigation.In this paper,we review DRL methods and DRL-based navigation frameworks.Then we systematically compare and analyze the relationship and differences between four typical application scenarios:local obstacle avoidance,indoor navigation,multi-robot navigation,and social navigation.Next,we describe the development of DRL-based navigation.Last,we discuss the challenges and some possible solutions regarding DRL-based navigation.

Effects of reconfiguration on the performance of mobile navigation robot

An irmovative mobile robot that has reconfigurable loeomotion chassis and reconfigurable bionic wheels has been developed to meet the needs of different payload and different terrain. Several prototypes have been achieved by the recortfiguration. By modeling relative comparison coefficients, these prototypes are analyzed in terms of geometrical parameter of trafficability, static stability and maneuverability. The effects of reconfiguration on these indices of robot performance can be compared, i.e. the variable height of chassis h has the biggest effect, the variable length of chassis 1 is the second, then is the camber angle β and the caster angle α. Some principles for reconfiguration are proposed.

Mobile Robot Indoor Autonomous Navigation with Position Estimation Using RF Signal Triangulation

In the mobile robotic systems a precise estimate of the robot pose (Cartesian [x y] position plus orientation angle theta) with the intention of the path planning optimization is essential for the correct performance, on the part of the robots, for tasks that are destined to it, especially when intention is for mobile robot autonomous navigation. This work uses a ToF (Time-of-Flight) of the RF digital signal interacting with beacons for computational triangulation in the way to provide a pose estimative at bi-dimensional indoor environment, where GPS system is out of range. It’s a new technology utilization making good use of old ultrasonic ToF methodology that takes advantage of high performance multicore DSP processors to calculate ToF of the order about ns. Sensors data like odometry, compass and the result of triangulation Cartesian estimative, are fused in a Kalman filter in the way to perform optimal estimation and correct robot pose. A mobile robot platform with differential drive and nonholonomic constraints is used as base for state space, plants and measurements models that are used in the simulations and for validation the experiments.

ARCHITECTURE AND ITS IMPLEMENTATION FOR ROBOTS TO NAVIGATE IN UNKNOWN INDOOR ENVIRONMENTS

It is discussed with the design and implementation of an architecture for a mobile robot to navigate in dynamic and anknown indoor environments. The architecture is based on the framework of Open Robot Control Software at KTH （OROCOS@KTH）, which is also discussed and evaluated to navigate indoor efficiently, a new algorithm named door-like-exit detection is proposed which employs 2D feature oft. door and extracts key points of pathway from the raw data of a laser scanner. As a hybrid architecture, it is decomposed into several basic components which can be classified as either deliberative or reactive. Each component can concurrently execute and communicate with another. It is expansible and transferable and its components are reusable.

Navigation of Non-holonomic Mobile Robot Using Neuro-fuzzy Logic with Integrated Safe Boundary Algorithm

In the present work, autonomous mobile robot（AMR） system is intended with basic behaviour, one is obstacle avoidance and the other is target seeking in various environments. The AMR is navigated using fuzzy logic, neural network and adaptive neurofuzzy inference system（ANFIS） controller with safe boundary algorithm. In this method of target seeking behaviour, the obstacle avoidance at every instant improves the performance of robot in navigation approach. The inputs to the controller are the signals from various sensors fixed at front face, left and right face of the AMR. The output signal from controller regulates the angular velocity of both front power wheels of the AMR. The shortest path is identified using fuzzy, neural network and ANFIS techniques with integrated safe boundary algorithm and the predicted results are validated with experimentation. The experimental result has proven that ANFIS with safe boundary algorithm yields better performance in navigation, in particular with curved/irregular obstacles.

Solution to reinforcement learning problems with artificial potential field

A novel method was designed to solve reinforcement learning problems with artificial potential field.Firstly a reinforcement learning problem was transferred to a path planning problem by using artificial potential field(APF),which was a very appropriate method to model a reinforcement learning problem.Secondly,a new APF algorithm was proposed to overcome the local minimum problem in the potential field methods with a virtual water-flow concept.The performance of this new method was tested by a gridworld problem named as key and door maze.The experimental results show that within 45 trials,good and deterministic policies are found in almost all simulations.In comparison with WIERING's HQ-learning system which needs 20 000 trials for stable solution,the proposed new method can obtain optimal and stable policy far more quickly than HQ-learning.Therefore,the new method is simple and effective to give an optimal solution to the reinforcement learning problem.