Institutional Repository
Technical University of Crete
Technical University of Crete
EN
|
EL
| URI | http://purl.tuc.gr/dl/dias/B015D2A5-35D3-44F0-ABBA-C6D07796F14C | - |
| Identifier | https://doi.org/10.26233/heallink.tuc.95102 | - |
| Language | en | - |
| Extent | 1.8 megabytes | en |
| Extent | 76 pages | en |
| Title | Pro-active Automatic scaling support for Apache Flink in Kubernetes in the Cloud | en |
| Title | Έγκυρη υποστήριξη αυτόματης κλιμάκωσης του Apache Flink σε υποδομή Kubernetes στο υπολογιστικό νέφος | el |
| Creator | Zafeirakopoulos Alexandros-Nikolaos | en |
| Creator | Ζαφειρακοπουλος Αλεξανδρος-Νικολαος | el |
| Contributor [Thesis Supervisor] | Petrakis Evripidis | en |
| Contributor [Thesis Supervisor] | Πετρακης Ευριπιδης | el |
| Contributor [Committee Member] | Samoladas Vasilis | en |
| Contributor [Committee Member] | Σαμολαδας Βασιλης | el |
| Contributor [Committee Member] | Zervakis Michail | en |
| Contributor [Committee Member] | Ζερβακης Μιχαηλ | el |
| Publisher | Πολυτεχνείο Κρήτης | el |
| Publisher | Technical University of Crete | en |
| Academic Unit | Technical University of Crete::School of Electrical and Computer Engineering | en |
| Academic Unit | Πολυτεχνείο Κρήτης::Σχολή Ηλεκτρολόγων Μηχανικών και Μηχανικών Υπολογιστών | el |
| Description | Προπτυχιακή Διατριβή που υποβλήθηκε στη σχολή ΗΜΜΥ του Πολ. Κρήτης για την πλήρωση προϋποθέσεων λήψης του Προπτυχιακού Διπλώματος. | el |
| Content Summary | Apache Flink is a framework and distributed processing engine for stateful computations over unbounded and bounded data streams. It executes arbitrary dataflow programs in a data-parallel and pipelined manner in event-driven applications such as, fraud detection (i.e. detection of suspicious transactions), anomaly detection (i.e. detection of rare or suspicions events), rule-based alerting (i.e. identification of data which satisfy one or more rules) and many more. Despite its versatility, Apache Flink cannot automatically and optimally adjust the utilization of its underlying computing resources when streaming sources produce data at varying speeds. In order to address this issue, we describe an autonomous agent to support dynamic autoscaling for Apache Flink on Kubernetes. This agent monitors, models and adjusts Flink's behaviour by optimally modifying its allocated resources in order to match the incoming workload while achieving minimum cost. The decision making process is based on operator idleness and changes to the input's record lag. We prove that our model not only successfully maintains the performance of the application while minimizing infrastructure costs, but can provide a better performance-to-cost ratio compared to already existing work on Flink autoscaling. The effectiveness of our model is supported by an exhaustive set of synthetic and real life workloads aimed to simulate a plethora of possible scenarios. | en |
| Type of Item | Διπλωματική Εργασία | el |
| Type of Item | Diploma Work | en |
| License | http://creativecommons.org/licenses/by/4.0/ | en |
| Date of Item | 2023-03-01 | - |
| Date of Publication | 2022 | - |
| Subject | Autoscaling Microservice Architectures in the Cloud | en |
| Bibliographic Citation | Alexandros-Nikolaos Zafeirakopoulos, "Pro-active Automatic scaling support for Apache Flink in Kubernetes in the Cloud", Diploma Work, School of Electrical and Computer Engineering, Technical University of Crete, Chania, Greece, 2022 | en |
| Bibliographic Citation | Αλέξανδρος-Νικόλαος Ζαφειρακόπουλος, "Έγκυρη υποστήριξη αυτόματης κλιμάκωσης του Apache Flink σε υποδομή Kubernetes στο υπολογιστικό νέφος", Διπλωματική Εργασία, Σχολή Ηλεκτρολόγων Μηχανικών και Μηχανικών Υπολογιστών, Πολυτεχνείο Κρήτης, Χανιά, Ελλάς, 2022 | el |
Copyright © DIAS 2013
