JOURNAL ARTICLE

Mapless Navigation with Deep Reinforcement Learning in Indoor Environment

Abstract

One of the crucial tasks for autonomous robots is learning to safely navigate through obstacles in real-world environments. An intelligent robot must not only perform the assigned task but also adapt to changes in its environment as quickly as possible. In this work, we propose an improved version of the Deep Reinforcement Learning (DRL) Proximal Policy Optimization (PPO) algorithm by modifying a deep neural network of the Actor and Critic. Then we compare the results of our work by comparing them with those of classical PPO. Algorithm testing is conducted in a Flatland simulation environment, which allows for integration with the ROS2 operating environment.

Keywords:
Computer science Reinforcement learning Artificial intelligence Human–computer interaction

Metrics

0
Cited By
0.00
FWCI (Field Weighted Citation Impact)
13
Refs
0.26
Citation Normalized Percentile
Is in top 1%
Is in top 10%

Topics

Robotic Path Planning Algorithms
Physical Sciences →  Computer Science →  Computer Vision and Pattern Recognition
Robotics and Sensor-Based Localization
Physical Sciences →  Engineering →  Aerospace Engineering
Indoor and Outdoor Localization Technologies
Physical Sciences →  Engineering →  Electrical and Electronic Engineering

Related Documents

JOURNAL ARTICLE

Dimension-Variable Mapless Navigation With Deep Reinforcement Learning

Wěi ZhāngYunfeng ZhangNing LiuKai RenGaoliang Peng

Journal:   IEEE/ASME Transactions on Mechatronics Year: 2025 Vol: 30 (6)Pages: 5834-5844
JOURNAL ARTICLE

Environment Exploration for Mapless Navigation based on Deep Reinforcement Learning

Duc‐Toan NguyenGon-Woo Kim

Journal:   2021 21st International Conference on Control, Automation and Systems (ICCAS) Year: 2021 Pages: 17-20
BOOK-CHAPTER

Application Barrier-Free Deep Reinforcement Learning-Based Navigation in Mapless Environment

Yu JinZhengjie WangYanxuan Wu

Lecture notes in electrical engineering Year: 2021 Pages: 643-653
JOURNAL ARTICLE

Mapless Navigation with Distributional Reinforcement Learning

Van Manh TranGon-Woo Kim

Journal:   The Journal of Korea Robotics Society Year: 2024 Vol: 19 (1)Pages: 92-97
© 2026 ScienceGate Book Chapters — All rights reserved.