URI | http://purl.tuc.gr/dl/dias/C917C95B-4206-45E2-9FA1-1D793EEEDEC8 | - |
Identifier | https://doi.org/10.3390/robotics12050137 | - |
Identifier | https://www.mdpi.com/2218-6581/12/5/137 | - |
Language | en | - |
Extent | 28 pages | en |
Title | Keypoint detection and description through deep learning in unstructured environments | en |
Creator | Petrakis Georgios | en |
Creator | Πετρακης Γεωργιος | el |
Creator | Partsinevelos Panagiotis | en |
Creator | Παρτσινεβελος Παναγιωτης | el |
Publisher | MDPI | en |
Description | The implementation of the doctoral thesis was co-financed by Greece and the European Union (European Social Fund-ESF) through the Operational Programme «Human Resources Development, Education and Lifelong Learning» in the context of the Act “Enhancing Human Resources Research Potential by undertaking a Doctoral Research” Sub-action 2: IKY Scholarship Programme for PhD candidates in the Greek Universities. | en |
Content Summary | Feature extraction plays a crucial role in computer vision and autonomous navigation, offering valuable information for real-time localization and scene understanding. However, although multiple studies investigate keypoint detection and description algorithms in urban and indoor environments, far fewer studies concentrate in unstructured environments. In this study, a multi-task deep learning architecture is developed for keypoint detection and description, focused on poor-featured unstructured and planetary scenes with low or changing illumination. The proposed architecture was trained and evaluated using a training and benchmark dataset with earthy and planetary scenes. Moreover, the trained model was integrated in a visual SLAM (Simultaneous Localization and Maping) system as a feature extraction module, and tested in two feature-poor unstructured areas. Regarding the results, the proposed architecture provides a mAP (mean Average Precision) in a level of 0.95 in terms of keypoint description, outperforming well-known handcrafted algorithms while the proposed SLAM achieved two times lower RMSE error in a poor-featured area with low illumination, compared with ORB-SLAM2. To the best of the authors’ knowledge, this is the first study that investigates the potential of keypoint detection and description through deep learning in unstructured and planetary environments. | en |
Type of Item | Peer-Reviewed Journal Publication | en |
Type of Item | Δημοσίευση σε Περιοδικό με Κριτές | el |
License | http://creativecommons.org/licenses/by/4.0/ | en |
Date of Item | 2025-02-20 | - |
Date of Publication | 2023 | - |
Subject | Feature extraction | en |
Subject | Unstructured environments | en |
Subject | Visual SLAM | en |
Subject | Deep learning | en |
Subject | Autonomous navigation | en |
Bibliographic Citation | G. Petrakis and P. Partsinevelos, “Keypoint detection and description through deep learning in unstructured environments,” Robotics, vol. 12, no. 5, Sep. 2023, doi: 10.3390/robotics12050137. | en |