Ιδρυματικό Αποθετήριο
Πολυτεχνείο Κρήτης
Πολυτεχνείο Κρήτης
EN
|
EL
| URI | http://purl.tuc.gr/dl/dias/E1E8608D-4126-4834-AC8D-7EF0DDCE59C4 | - |
| Αναγνωριστικό | https://link.springer.com/chapter/10.1007%2F978-3-319-33509-4_8 | - |
| Αναγνωριστικό | https://doi.org/10.1007/978-3-319-33509-4_8 | - |
| Γλώσσα | en | - |
| Μέγεθος | 17 pages | en |
| Τίτλος | Factored MDPs for optimal prosumer decision-making in continuous state spaces | en |
| Δημιουργός | Angelidakis Angelos | en |
| Δημιουργός | Αγγελιδακης Αγγελος | el |
| Δημιουργός | Chalkiadakis Georgios | en |
| Δημιουργός | Χαλκιαδακης Γεωργιος | el |
| Εκδότης | Springer Verlag | en |
| Περίληψη | The economic profitability of Smart Grid prosumers (i.e., producers that are simultaneously consumers) depends on their tackling of the decision-making problem they face when selling and buying energy. In previous work, we had modelled this problem compactly as a factored Markov Decision Process, capturing the main aspects of the business decisions of a prosumer corresponding to a community microgrid of any size. Though that work had employed an exact value iteration algorithm to obtain a near-optimal solution over discrete state spaces, it could not tackle problems defined over continuous state spaces. By contrast, in this paper we show how to use approximate MDP solution methods for taking decisions in this domain without the need of discretizing the state space. Specifically, we employ fitted value iteration, a sampling-based approximation method that is known to be well behaved. By so doing, we generalize our factored MDP solution method to continuous state spaces. We evaluate our approach using a variety of basis functions over different state sample sizes, and compare its performance to that of our original “exact” value iteration algorithm. Our generic approximation method is shown to exhibit stable performance in terms of accumulated reward, which for certain basis functions reaches 98% of that gathered by the exact algorithm. | en |
| Τύπος | Πλήρης Δημοσίευση σε Συνέδριο | el |
| Τύπος | Conference Full Paper | en |
| Άδεια Χρήσης | http://creativecommons.org/licenses/by/4.0/ | en |
| Ημερομηνία | 2018-10-30 | - |
| Ημερομηνία Δημοσίευσης | 2016 | - |
| Θεματική Κατηγορία | Approximation methods | en |
| Θεματική Κατηγορία | Continuous state spaces | en |
| Θεματική Κατηγορία | Decision-making | en |
| Θεματική Κατηγορία | Energy | en |
| Θεματική Κατηγορία | Factored MDPs | en |
| Θεματική Κατηγορία | Smart Grid | en |
| Βιβλιογραφική Αναφορά | A. Angelidakis and G. Chalkiadakis, "Factored MDPs for optimal prosumer decision-making in continuous state spaces," in 13th European Conference on Multi-Agent Systems, EUMAS 2015 and 3rd International Conference on Agreement Technologies, 2016, pp. 91-107. doi: 10.1007/978-3-319-33509-4_8 | en |
Copyright © DIAS 2013
