Institutional Repository
Technical University of Crete
Technical University of Crete
EN
|
EL
| URI | http://purl.tuc.gr/dl/dias/5AE5689F-69AA-4E38-8EDD-0F5F8EC9D826 | - |
| Identifier | https://doi.org/10.26233/heallink.tuc.62539 | - |
| Language | en | - |
| Extent | 3,1 megabytes | en |
| Title | Factored MDPs for optimal prosumer decision-making in the smart grid | en |
| Title | Παραγοντοποιημένες μαρκοβιανές στοχαστικές διαδικασίες για βέλτιστη λήψη αποφάσεων ενός παραγωγού - καταναλωτή στο έξυπνο δίκτυο ηλεκτροδότησης | el |
| Creator | Angelidakis Angelos | en |
| Creator | Αγγελιδακης Αγγελος | el |
| Contributor [Thesis Supervisor] | Chalkiadakis Georgios | en |
| Contributor [Thesis Supervisor] | Χαλκιαδακης Γεωργιος | el |
| Contributor [Committee Member] | Koutroulis Eftychios | en |
| Contributor [Committee Member] | Κουτρουλης Ευτυχιος | el |
| Contributor [Committee Member] | Lagoudakis Michael | en |
| Contributor [Committee Member] | Λαγουδακης Μιχαηλ | el |
| Publisher | Πολυτεχνείο Κρήτης | el |
| Publisher | Technical University of Crete | en |
| Academic Unit | Πολυτεχνείο Κρήτης: Σχολή Ηλεκτρονικών Μηχανικών και Μηχανικών Υπολογιστών | el |
| Content Summary | Tackling the decision-making problem faced by a prosumer (i.e., a producer that is simultaneously a consumer) when selling and buying energy in the emerging smart electricity grid, is of utmost importance for the economic profitability of such a business entity. In this thesis, we model, for the first time, this problem as a factored Markov Decision process (MDP). Our model successfully captures the main aspects of the business decisions of a prosumer corresponding to a com- munity microgrid of any size. Moreover, it includes appropriate sub-models for prosumer production and consumption prediction. Employing this model, we are able to represent the problem compactly, and to provide an exact optimal solution via dynamic programming—notwithstanding its large size. In addition, we show how to use approximate MDP solution meth- ods for taking decisions in this domain, without the need of discretizing the state space. Specifically, we employ fitted value iteration, a sampling-based approxi- mation method that is known to be well behaved. By so doing, we generalize our factored MDP solution method to continuous state spaces. Our experimental simulations verify the effectiveness of our approach. They show that our exact value iteration solution matches that of a state-of-the-art method for stochastic planning in very large environments, while outperforming it in terms of computation time. Furthermore, we evaluate our approximate solution method via using a variety of basis functions over different state sample sizes, and comparing its performance to that of our exact value iteration algorithm. Our approximation method is shown to exhibit stable performance in terms of accu- mulated reward, which for certain basis functions reaches 90% of that gathered by the exact algorithm. | en |
| Type of Item | Μεταπτυχιακή Διατριβή | el |
| Type of Item | Master Thesis | en |
| License | http://creativecommons.org/licenses/by-sa/4.0/ | en |
| Date of Item | 2015-12-11 | - |
| Date of Publication | 2015 | - |
| Subject | Decision theoretic planning | en |
| Subject | Smart grid | en |
| Subject | Factored Markov Decision Process | en |
| Bibliographic Citation | Άγγελος Αγγελιδάκης, "Παραγοντοποιημένες μαρκοβιανές στοχαστικές διαδικασίες για βέλτιστη λήψη αποφάσεων ενός παραγωγού - καταναλωτή στο έξυπνο δίκτυο ηλεκτροδότησης", Μεταπτυχιακή Διατριβή, Σχολή Ηλεκτρονικών Μηχανικών και Μηχανικών Υπολογιστών, Πολυτεχνείο Κρήτης, Χανιά, Ελλάς, 2015 | el |
| Bibliographic Citation | Angelos Angelidakis, "Factored MDPs for optimal prosumer decision-making in the smart grid", Master Thesis, School of Electronic Computer Engineering, Technical University of Crete, Chania, Greece, 2015 | el |
Copyright © DIAS 2013
