Institutional Repository
Technical University of Crete
Technical University of Crete
EN
|
EL
| URI | http://purl.tuc.gr/dl/dias/E2365192-8D33-48EE-8069-2097118F293B | - |
| Identifier | https://doi.org/10.1007/3-540-46014-4_23 | - |
| Identifier | https://users.cs.duke.edu/~parr/setn02.pdf | - |
| Language | en | - |
| Extent | 12 pages | en |
| Title | Least-squares methods in reinforcement learning for control | en |
| Creator | Lagoudakis Michael | en |
| Creator | Λαγουδακης Μιχαηλ | el |
| Creator | Parr Ronald | en |
| Creator | Littman Michael L. | en |
| Content Summary | Least-squares methods have been successfully used for prediction problems in the context of reinforcement learning, but little has been done in extending these methods to control problems. This paper presents an overview of our research efforts in using least-squares techniques for control. In our early attempts, we considered a direct extension of the Least-Squares Temporal Difference (LSTD) algorithm in the spirit of Q-learning. Later, an effort to remedy some limitations of this algorithm (approximation bias, poor sample utilization) led to the Least- Squares Policy Iteration (LSPI) algorithm, which is a form of model-free approximate policy iteration and makes efficient use of training samples collected in any arbitrary manner. The algorithms are demonstrated on a variety of learning domains, including algorithm selection, inverted pendulum balancing, bicycle balancing and riding, multiagent learning in factored domains, and, recently, on two-player zero-sum Markov games and the game of Tetris. | en |
| Type of Item | Πλήρης Δημοσίευση σε Συνέδριο | el |
| Type of Item | Conference Full Paper | en |
| License | http://creativecommons.org/licenses/by-nc-nd/4.0/ | en |
| Date of Item | 2015-11-17 | - |
| Date of Publication | 2002 | - |
| Bibliographic Citation | M. Lagoudakis , R. Parr , M. Littman ," Least-Squares Methods in Reinforcement Learning for Control," in 2002 Proceedings of the 2nd Hellenic Conference on Artificial Intelligence (SETN), pp. 249-260, doi: 10.1007/3-540-46014-4_23 | en |
Copyright © DIAS 2013
