Effective Marine Monitoring with Multimodal Sensing and Improved Underwater Robotic Perception towards Environmental Protection and Smart Energy Transition
Effective underwater sensing is crucial for environmental protection and sustainable energy transitions, particularly as we face growing challenges in marine ecosystem monitoring, resource management, and the need for efficient energy infrastructure. To support these efforts, we propose a multimodal...
Saved in:
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Surveying and Mapping Press
2024-12-01
|
| Series: | Journal of Geodesy and Geoinformation Science |
| Subjects: | |
| Online Access: | http://jggs.chinasmp.com/fileup/2096-5990/PDF/1737100124809-648964442.pdf |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841525705650733056 |
|---|---|
| author | Hamidreza FARHADI TOLIE, REN Jinchang, Md Junayed HASAN, MA Ping, Somasundar KANNAN, LI Yinhe |
| author_facet | Hamidreza FARHADI TOLIE, REN Jinchang, Md Junayed HASAN, MA Ping, Somasundar KANNAN, LI Yinhe |
| author_sort | Hamidreza FARHADI TOLIE, REN Jinchang, Md Junayed HASAN, MA Ping, Somasundar KANNAN, LI Yinhe |
| collection | DOAJ |
| description | Effective underwater sensing is crucial for environmental protection and sustainable energy transitions, particularly as we face growing challenges in marine ecosystem monitoring, resource management, and the need for efficient energy infrastructure. To support these efforts, we propose a multimodal sensing approach that enhances underwater detection and distance estimation by combining affordable sonar technology with stereo vision-based depth cameras. Our method integrates the Ping 360 single-beam sonar for target detection and distance measurement with depth refinement from the Intel RealSense D455 camera. A promptable segmentation model automates sonar target detection, overcoming challenges such as acoustic noise and shadowing without requiring large labeled datasets. Depth images from the stereo camera are enhanced using a Depth-Anything model, addressing underwater-specific issues like noise, missing regions, and light attenuation, achieving accurate depth maps for distances up to 1.2 meters underwater. By leveraging multimodal sensing, this approach not only improves underwater robotics for navigation, manipulation, and exploration but also plays a key role in monitoring and maintaining energy infrastructure, such as offshore wind farms and underwater pipelines. Accurate, real-time sensing of these installations ensures more efficient operations, minimizes the environmental impact, and aids in the sustainable management of ocean resources. This enables better energy production and resource utilization, which are essential for a smarter and more sustainable energy transition. |
| format | Article |
| id | doaj-art-69438b530ca64c6db037f78eec024b64 |
| institution | Kabale University |
| issn | 2096-5990 |
| language | English |
| publishDate | 2024-12-01 |
| publisher | Surveying and Mapping Press |
| record_format | Article |
| series | Journal of Geodesy and Geoinformation Science |
| spelling | doaj-art-69438b530ca64c6db037f78eec024b642025-01-17T07:56:09ZengSurveying and Mapping PressJournal of Geodesy and Geoinformation Science2096-59902024-12-0174193510.11947/j.JGGS.2024.0403Effective Marine Monitoring with Multimodal Sensing and Improved Underwater Robotic Perception towards Environmental Protection and Smart Energy TransitionHamidreza FARHADI TOLIE, REN Jinchang, Md Junayed HASAN, MA Ping, Somasundar KANNAN, LI Yinhe01 School of Computing, Engineering, and Technology, Robert Gordon University, Aberdeen AB10 7AQ, U. K.;2 National Subsea Centre, Aberdeen AB21 0BH, U. K.Effective underwater sensing is crucial for environmental protection and sustainable energy transitions, particularly as we face growing challenges in marine ecosystem monitoring, resource management, and the need for efficient energy infrastructure. To support these efforts, we propose a multimodal sensing approach that enhances underwater detection and distance estimation by combining affordable sonar technology with stereo vision-based depth cameras. Our method integrates the Ping 360 single-beam sonar for target detection and distance measurement with depth refinement from the Intel RealSense D455 camera. A promptable segmentation model automates sonar target detection, overcoming challenges such as acoustic noise and shadowing without requiring large labeled datasets. Depth images from the stereo camera are enhanced using a Depth-Anything model, addressing underwater-specific issues like noise, missing regions, and light attenuation, achieving accurate depth maps for distances up to 1.2 meters underwater. By leveraging multimodal sensing, this approach not only improves underwater robotics for navigation, manipulation, and exploration but also plays a key role in monitoring and maintaining energy infrastructure, such as offshore wind farms and underwater pipelines. Accurate, real-time sensing of these installations ensures more efficient operations, minimizes the environmental impact, and aids in the sustainable management of ocean resources. This enables better energy production and resource utilization, which are essential for a smarter and more sustainable energy transition.http://jggs.chinasmp.com/fileup/2096-5990/PDF/1737100124809-648964442.pdf|underwater multi-modal sensing|image fusion|depth refinement|sonar image analysis |
| spellingShingle | Hamidreza FARHADI TOLIE, REN Jinchang, Md Junayed HASAN, MA Ping, Somasundar KANNAN, LI Yinhe Effective Marine Monitoring with Multimodal Sensing and Improved Underwater Robotic Perception towards Environmental Protection and Smart Energy Transition Journal of Geodesy and Geoinformation Science |underwater multi-modal sensing|image fusion|depth refinement|sonar image analysis |
| title | Effective Marine Monitoring with Multimodal Sensing and Improved Underwater Robotic Perception towards Environmental Protection and Smart Energy Transition |
| title_full | Effective Marine Monitoring with Multimodal Sensing and Improved Underwater Robotic Perception towards Environmental Protection and Smart Energy Transition |
| title_fullStr | Effective Marine Monitoring with Multimodal Sensing and Improved Underwater Robotic Perception towards Environmental Protection and Smart Energy Transition |
| title_full_unstemmed | Effective Marine Monitoring with Multimodal Sensing and Improved Underwater Robotic Perception towards Environmental Protection and Smart Energy Transition |
| title_short | Effective Marine Monitoring with Multimodal Sensing and Improved Underwater Robotic Perception towards Environmental Protection and Smart Energy Transition |
| title_sort | effective marine monitoring with multimodal sensing and improved underwater robotic perception towards environmental protection and smart energy transition |
| topic | |underwater multi-modal sensing|image fusion|depth refinement|sonar image analysis |
| url | http://jggs.chinasmp.com/fileup/2096-5990/PDF/1737100124809-648964442.pdf |
| work_keys_str_mv | AT hamidrezafarhaditolierenjinchangmdjunayedhasanmapingsomasundarkannanliyinhe effectivemarinemonitoringwithmultimodalsensingandimprovedunderwaterroboticperceptiontowardsenvironmentalprotectionandsmartenergytransition |