Institutional Repository
Technical University of Crete
EN  |  EL

Search

Browse

My Space

Keypoint detection and description through deep learning in unstructured environments

Petrakis Georgios, Partsinevelos Panagiotis

Simple record


URIhttp://purl.tuc.gr/dl/dias/C917C95B-4206-45E2-9FA1-1D793EEEDEC8-
Identifierhttps://doi.org/10.3390/robotics12050137-
Identifierhttps://www.mdpi.com/2218-6581/12/5/137-
Languageen-
Extent28 pagesen
TitleKeypoint detection and description through deep learning in unstructured environmentsen
CreatorPetrakis Georgiosen
CreatorΠετρακης Γεωργιοςel
CreatorPartsinevelos Panagiotisen
CreatorΠαρτσινεβελος Παναγιωτηςel
PublisherMDPIen
DescriptionThe implementation of the doctoral thesis was co-financed by Greece and the European Union (European Social Fund-ESF) through the Operational Programme «Human Resources Development, Education and Lifelong Learning» in the context of the Act “Enhancing Human Resources Research Potential by undertaking a Doctoral Research” Sub-action 2: IKY Scholarship Programme for PhD candidates in the Greek Universities.en
Content SummaryFeature extraction plays a crucial role in computer vision and autonomous navigation, offering valuable information for real-time localization and scene understanding. However, although multiple studies investigate keypoint detection and description algorithms in urban and indoor environments, far fewer studies concentrate in unstructured environments. In this study, a multi-task deep learning architecture is developed for keypoint detection and description, focused on poor-featured unstructured and planetary scenes with low or changing illumination. The proposed architecture was trained and evaluated using a training and benchmark dataset with earthy and planetary scenes. Moreover, the trained model was integrated in a visual SLAM (Simultaneous Localization and Maping) system as a feature extraction module, and tested in two feature-poor unstructured areas. Regarding the results, the proposed architecture provides a mAP (mean Average Precision) in a level of 0.95 in terms of keypoint description, outperforming well-known handcrafted algorithms while the proposed SLAM achieved two times lower RMSE error in a poor-featured area with low illumination, compared with ORB-SLAM2. To the best of the authors’ knowledge, this is the first study that investigates the potential of keypoint detection and description through deep learning in unstructured and planetary environments.en
Type of ItemPeer-Reviewed Journal Publicationen
Type of ItemΔημοσίευση σε Περιοδικό με Κριτέςel
Licensehttp://creativecommons.org/licenses/by/4.0/en
Date of Item2025-02-20-
Date of Publication2023-
SubjectFeature extractionen
SubjectUnstructured environmentsen
SubjectVisual SLAMen
SubjectDeep learningen
SubjectAutonomous navigationen
Bibliographic CitationG. Petrakis and P. Partsinevelos, “Keypoint detection and description through deep learning in unstructured environments,” Robotics, vol. 12, no. 5, Sep. 2023, doi: 10.3390/robotics12050137.en

Available Files

Services

Statistics