Real-Time Semantic Mapping and Object-Oriented Autonomous Navigation with Low-Cost LiDAR and RGB Sensor
Sarimella Rami Reddy, VVS Viswa Kiran, Siddapu Chinnikrishna Yadav, and R Prasanth Kumar

2026 IEEE Applied Sensing Conference (APSCON), Delhi, India, 2026

doi:10.1109/apscon68325.2026.11497028

Abstract

This paper presents a framework for semantic mapping and autonomous navigation using low-cost LiDAR and RGB cameras. Our approach integrates real-time object detection from camera images with LiDAR-based mapping to generate a semantically enriched map, where detected objects are represented as landmarks with labels and images. The semantic map is then leveraged by the ROS2 Navigation2 (Nav2) stack to enable goal-directed autonomous navigation, allowing the robot to plan paths not only around obstacles but also toward specific objects of interest. The proposed method provides a low-cost, scalable, and practical solution for intelligent robot navigation in environments with visually identifiable objects.