Automatic Detection and 3D Modeling of City Furniture Objects using LiDAR and Imagery Mobile Mapping Data
City furniture objects hold valuable information about urban traffic and city dynamics, making their integration into 3D city models essential for enhancing these models. This study implements two methodologies for detecting, classifying, and positioning City Furniture objects, as well as one approa...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Copernicus Publications
2024-12-01
|
| Series: | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| Online Access: | https://isprs-archives.copernicus.org/articles/XLVIII-2-W8-2024/125/2024/isprs-archives-XLVIII-2-W8-2024-125-2024.pdf |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1846122256976052224 |
|---|---|
| author | H. Doi A. Yarroudh I. Jeddoub R. Hajji R. Billen |
| author_facet | H. Doi A. Yarroudh I. Jeddoub R. Hajji R. Billen |
| author_sort | H. Doi |
| collection | DOAJ |
| description | City furniture objects hold valuable information about urban traffic and city dynamics, making their integration into 3D city models essential for enhancing these models. This study implements two methodologies for detecting, classifying, and positioning City Furniture objects, as well as one approach for their automatic 3D modeling. The first approach uses Mobile Mapping System (MMS) imagery with YOLO for object detection and classification, coupled with the Line of Bearing (LoB) method for extracting XYZ coordinates and height. A spatial operation was conducted to determine object orientation. The second approach employs camera- LiDAR fusion, integrating KPConv for semantic segmentation and connected components for instance segmentation. Classification is performed using two complementary approaches: using Fast Global Registration (FGR) on point clouds, for lamppost types, and image-based, projecting point cloud instances to classify traffic lights and signs. This fusion approach leverages image-based classification models and point cloud accuracy, achieving an RMSE of 0.32 against ground truth data. The point cloud approach shows promise but requires refinement to improve noise sensitivity in FGR. This study presents a comprehensive workflow from detection to Level of Detail 4 (LOD4) modeling, combining KPConv and multi-source data to enhance feature detection and classification for city furniture. |
| format | Article |
| id | doaj-art-7f2e96aa33c747e2a9dd60129159ed57 |
| institution | Kabale University |
| issn | 1682-1750 2194-9034 |
| language | English |
| publishDate | 2024-12-01 |
| publisher | Copernicus Publications |
| record_format | Article |
| series | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| spelling | doaj-art-7f2e96aa33c747e2a9dd60129159ed572024-12-14T22:09:14ZengCopernicus PublicationsThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences1682-17502194-90342024-12-01XLVIII-2-W8-202412513210.5194/isprs-archives-XLVIII-2-W8-2024-125-2024Automatic Detection and 3D Modeling of City Furniture Objects using LiDAR and Imagery Mobile Mapping DataH. Doi0A. Yarroudh1I. Jeddoub2R. Hajji3R. Billen4College of Geomatic Sciences and Surveying Engineering, Agronomy and Veterinary Institute Hassan II, Rabat 10101, MoroccoGeoScITY, Spheres Research Unit, University of Liège, 4000 Liège, BelgiumGeoScITY, Spheres Research Unit, University of Liège, 4000 Liège, BelgiumCollege of Geomatic Sciences and Surveying Engineering, Agronomy and Veterinary Institute Hassan II, Rabat 10101, MoroccoGeoScITY, Spheres Research Unit, University of Liège, 4000 Liège, BelgiumCity furniture objects hold valuable information about urban traffic and city dynamics, making their integration into 3D city models essential for enhancing these models. This study implements two methodologies for detecting, classifying, and positioning City Furniture objects, as well as one approach for their automatic 3D modeling. The first approach uses Mobile Mapping System (MMS) imagery with YOLO for object detection and classification, coupled with the Line of Bearing (LoB) method for extracting XYZ coordinates and height. A spatial operation was conducted to determine object orientation. The second approach employs camera- LiDAR fusion, integrating KPConv for semantic segmentation and connected components for instance segmentation. Classification is performed using two complementary approaches: using Fast Global Registration (FGR) on point clouds, for lamppost types, and image-based, projecting point cloud instances to classify traffic lights and signs. This fusion approach leverages image-based classification models and point cloud accuracy, achieving an RMSE of 0.32 against ground truth data. The point cloud approach shows promise but requires refinement to improve noise sensitivity in FGR. This study presents a comprehensive workflow from detection to Level of Detail 4 (LOD4) modeling, combining KPConv and multi-source data to enhance feature detection and classification for city furniture.https://isprs-archives.copernicus.org/articles/XLVIII-2-W8-2024/125/2024/isprs-archives-XLVIII-2-W8-2024-125-2024.pdf |
| spellingShingle | H. Doi A. Yarroudh I. Jeddoub R. Hajji R. Billen Automatic Detection and 3D Modeling of City Furniture Objects using LiDAR and Imagery Mobile Mapping Data The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| title | Automatic Detection and 3D Modeling of City Furniture Objects using LiDAR and Imagery Mobile Mapping Data |
| title_full | Automatic Detection and 3D Modeling of City Furniture Objects using LiDAR and Imagery Mobile Mapping Data |
| title_fullStr | Automatic Detection and 3D Modeling of City Furniture Objects using LiDAR and Imagery Mobile Mapping Data |
| title_full_unstemmed | Automatic Detection and 3D Modeling of City Furniture Objects using LiDAR and Imagery Mobile Mapping Data |
| title_short | Automatic Detection and 3D Modeling of City Furniture Objects using LiDAR and Imagery Mobile Mapping Data |
| title_sort | automatic detection and 3d modeling of city furniture objects using lidar and imagery mobile mapping data |
| url | https://isprs-archives.copernicus.org/articles/XLVIII-2-W8-2024/125/2024/isprs-archives-XLVIII-2-W8-2024-125-2024.pdf |
| work_keys_str_mv | AT hdoi automaticdetectionand3dmodelingofcityfurnitureobjectsusinglidarandimagerymobilemappingdata AT ayarroudh automaticdetectionand3dmodelingofcityfurnitureobjectsusinglidarandimagerymobilemappingdata AT ijeddoub automaticdetectionand3dmodelingofcityfurnitureobjectsusinglidarandimagerymobilemappingdata AT rhajji automaticdetectionand3dmodelingofcityfurnitureobjectsusinglidarandimagerymobilemappingdata AT rbillen automaticdetectionand3dmodelingofcityfurnitureobjectsusinglidarandimagerymobilemappingdata |