Ιδρυματικό Αποθετήριο
Πολυτεχνείο Κρήτης
Πολυτεχνείο Κρήτης
EN
|
EL
| URI | http://purl.tuc.gr/dl/dias/FF1A586C-6148-4624-9E05-D1072C249829 | - |
| Αναγνωριστικό | https://doi.org/10.1016/j.datak.2009.04.002 | - |
| Γλώσσα | en | - |
| Τίτλος | Improving the performance of focused web crawlers | en |
| Δημιουργός | Petrakis Evripidis | en |
| Δημιουργός | Πετρακης Ευριπιδης | el |
| Δημιουργός | Sotiris Batsakis | en |
| Δημιουργός | Evangelos Milios | en |
| Εκδότης | Elsevier | en |
| Περίληψη | This work addresses issues related to the design and implementation of focused crawlers. Several variants of state-of-the-art crawlers relying on web page content and link information for estimating the relevance of web pages to a given topic are proposed. Particular emphasis is given to crawlers capable of learning not only the content of relevant pages (as classic crawlers do) but also paths leading to relevant pages. A novel learning crawler inspired by a previously proposed Hidden Markov Model (HMM) crawler is described as well. The crawlers have been implemented using the same baseline implementation (only the priority assignment function differs in each crawler) providing an unbiased evaluation framework for a comparative analysis of their performance. All crawlers achieve their maximum performance when a combination of web page content and (link) anchor text is used for assigning download priorities to web pages. Furthermore, the new HMM crawler improved the performance of the original HMM crawler and also outperforms classic focused crawlers in searching for specialized topics. | en |
| Τύπος | Peer-Reviewed Journal Publication | en |
| Τύπος | Δημοσίευση σε Περιοδικό με Κριτές | el |
| Άδεια Χρήσης | http://creativecommons.org/licenses/by/4.0/ | en |
| Ημερομηνία | 2015-10-24 | - |
| Ημερομηνία Δημοσίευσης | 2009 | - |
| Βιβλιογραφική Αναφορά | Sotirios Batsakis, Euripides G.M. Pertakis, Evangelos Milios, "Improving the Performance of Focused Web Crawlers" , Data Knowledge Engineering (DKE) Journal, Vol. 68, No. 10, pp. 1001-1013, Oct. 2009. doi:10.1016/j.datak.2009.04.002 | en |
Copyright © DIAS 2013
