Ιδρυματικό Αποθετήριο
Πολυτεχνείο Κρήτης
EN  |  EL

Αναζήτηση

Πλοήγηση

Ο Χώρος μου

Directed policy search for decision making using relevance vector machines

Rexakis Ioannis, Lagoudakis Michael

Απλή Εγγραφή


URIhttp://purl.tuc.gr/dl/dias/B72A2B56-6E1A-47B6-8C6F-9B89CA2AF27E-
Αναγνωριστικόhttps://doi.org/10.1142/S0218213014600161-
Γλώσσαen-
Μέγεθος21en
ΤίτλοςDirected policy search for decision making using relevance vector machines en
ΔημιουργόςRexakis Ioannisen
ΔημιουργόςΡεξακης Ιωαννηςel
ΔημιουργόςLagoudakis Michaelen
ΔημιουργόςΛαγουδακης Μιχαηλel
ΕκδότηςWorld Scientific Publishingen
ΠεριγραφήΔημοσίευση σε επιστημονικό περιοδικό el
ΠερίληψηSeveral recent learning approaches in decision making under uncertainty suggest the use of classifiers for representing policies compactly. The space of possible policies, even under such structured representations, is huge and must be searched carefully to avoid computationally expensive policy simulations (rollouts). In our recent work, we proposed a method for directed exploration of policy space using support vector classifiers, whereby rollouts are directed to states around the boundaries between different action choices indicated by the separating hyperplanes in the represented policies. While effective, this method suffers from the growing number of support vectors in the underlying classifiers as the number of training examples increases. In this paper, we propose an alternative method for directed policy search based on relevance vector machines. Relevance vector machines are used both for classification (to represent a policy) and regression (to approximate the corresponding relative action advantage function). Classification is enhanced by anomaly detection for accurate policy representation. Exploiting the internal structure of the regressor, we guide the probing of the state space only to critical areas corresponding to changes of action dominance in the underlying policy. This directed focus on critical parts of the state space iteratively leads to refinement and improvement of the underlying policy and delivers excellent control policies in only a few iterations, while the small number of relevance vectors yields significant computational time savings. We demonstrate the proposed approach and compare it with our previous method on standard reinforcement learning domains (inverted pendulum and mountain car). en
ΤύποςPeer-Reviewed Journal Publicationen
ΤύποςΔημοσίευση σε Περιοδικό με Κριτέςel
Άδεια Χρήσηςhttp://creativecommons.org/licenses/by/4.0/en
Ημερομηνία2015-10-27-
Ημερομηνία Δημοσίευσης2014-
Θεματική ΚατηγορίαReinforcement learningen
Θεματική Κατηγορίαdecision making under uncertaintyen
Θεματική Κατηγορίαclassificationen
Βιβλιογραφική Αναφορά I. Rexakis, M. Lagoudakis , "Directed policy search for decision making using relevance vector machines," International Journal on Artificial Intelligence Tools,vol. 23, no.4, Aug. 2014. doi: 10.1142/S0218213014600161 en

Υπηρεσίες

Στατιστικά