Self-Organising, Self-Managing Heterogeneous Cloud

Projektinformationen

CloudLightning

ID Finanzhilfevereinbarung: 643946

DOI

10.3030/643946

Projekt abgeschlossen

EK-Unterschriftsdatum 15 Dezember 2014

Startdatum 1 Februar 2015

Enddatum 31 Januar 2018

Finanziert unter

• INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT)

Gesamtkosten

€ 3 957 050,00

EU-Beitrag

€ 3 934 425,00

Koordiniert durch

UNIVERSITY COLLEGE CORK - NATIONAL UNIVERSITY OF IRELAND, CORK
Ireland

CORDIS bietet Links zu öffentlichen Ergebnissen und Veröffentlichungen von HORIZONT-Projekten.

Links zu Ergebnissen und Veröffentlichungen von RP7-Projekten sowie Links zu einigen Typen spezifischer Ergebnisse wie Datensätzen und Software werden dynamisch von OpenAIRE abgerufen.

Leistungen

Documents, reports (23)

Simulation execution and evaluation

D7.2.1 Simulation execution and evaluation. (Due date - month33)

Evaluation

D3.3.1 Evaluation Report. (Due date - month 36)

D2.3.1 Report on use case testing

This report will describe the testbed environment that is being used for evaluation and the results of execution of the use case applications on the testbed.

Local Decision Strategies

D4.2.1 Local Decision Strategies. (Due date - months 12,18)

Service Description Format

D5.1.1 Service description format specification. (Due date - month15)

D8.3.2 Report on CloudLightning Concertation

A follow-up deliverable to D8.3.1, this report will provide updates on targets, detailed figures and progress towards implementing the concertation plan.

D8.1.3 Exploitation Plan and Strategic Guidelines for Exploitation

A separate report relating to the outputs from the Delphi Method research Task 8.1.1 Industry Exploitation.

Gateway Service

D5.2.1 Gateway service. Due date (month 24)

Gateway service user interface

D5.3.1 Gateway service user interface. (Due date - month30)

Coalition Formation

D4.3.1 Coalition Formation. (Due date - month20)

Prototype Specification and API

D4.1.1 Protocol specification and API. (Due date - month12)

Simulation Report

The simulation report that will constitute all results obtained from the exhaustive experimentation on large scale simulations. The report will constitute qualitative metrics along with the results of several parameterised executions, mainly resulting from the testbed of WP2. Theoretical models will accompany the results for validation purposes in order to predict the behaviour of the proposed models of even larger scale executions. The results of simulation execution will validate the proposed methodology against the initial project objectives.

D8.1.1 Exploitation Plan and Strategic Guidelines for Exploitation

The first deliverable will provide details about the exploitation plan and Strategic Guidelines for exploitation as laid out in Task 8.1.

D8.2.3 CloudLightning Dissemination

The final report under Task 8.2 will provide updates on targets, detailed figures and progress towards the implementation of the dissemination strategy, including a review of all dissemination activities undertaken during the project.

D8.3.3 Report on CloudLightning Concertation

The final report will include a review of all concertation activities undertaken during the project under Task 8.3.

D8.1.4 Exploitation Plan and Strategic Guidelines for Exploitation

This final report will include a review of all exploitation activities undertaken during the project including updates on targets, detailed figures and progress towards implementing the exploitation strategy.

Large scale modelling and simulation framework

D7.1.1 - Large scale modelling and simulation framework. (Due date - month29)

Integration

D3.2.1 Final Integration Plan (Due date - month 30)

Service Deployment and Management

D4.4.1 Service Deployment and Management.(Due date - month21)

D8.2.1 CloudLightning Dissemination

The first deliverable will provide details about the Dissemination Plan, implementation of the project website, Basecamp and social networking accounts and a progress report on agreed activities to raise public awareness and participation, and impact against planned metrics in the first 12 months.

D8.1.2 Exploitation Plan and Strategic Guidelines for Exploitation

A follow-up report to D8.1.1 that will provide updates on targets, detailed figures and progress towards implementing the exploitation strategy.

D8.3.1 Report on CloudLightning Concertation

The first deliverable will provide details about the Concertation Plan and a progress report on concertation activities and impact against planned metrics in the first 12 months.

D8.2.2 CloudLightning Dissemination

Follow-up report to D8.2.1 will provide updates on targets, detailed figures and progress towards implementing the dissemination strategy.

Demonstrators, pilots, prototypes (3)

Integrated use cases

D2.2.1 Integrated use cases This report will describe the integrated use case applications and document their capabilities and structure. (Due date - month 24)

Architecture

D3.1.1 Report on State of the Art and Draft Architecture (Draft, internal). (Due date - month 6) D3.1.2 Report on State of the Art and Architecture (updated, public, for review). (Due date - month 12)

Use Case Requirements Report

D2.1.1 Use case requirements report This report will detail the requirements of, opportunities for and means to evaluate the identified use case applications. (Due date - month 8)

Veröffentlichungen

Other (1)

Benchmarking the Numascale Shared Memory Cluster System with MPI

Autoren: Malik M. Khan, Anne C. Elster
Veröffentlicht in: Workshop on Exascale MPI at Supercomputing Conference, 2015
Herausgeber: Epigram Project Website
DOI: 10.13140/RG.2.1.3660.9364

Conference proceedings (31)

On Autonomic HPC Clouds

Autoren: Petcu, Dana
Veröffentlicht in: Proceedings of the Second International Workshop on Sustainable Ultrascale Computing Systems (NESUS 2015), Ausgabe NESUS 2015, 2015, Seite(n) 29-40, ISBN 978-84-608-2581-4
Herausgeber: University Carlos III

On the Next Generations of Infrastructure-as-a-Services

Autoren: Dana Petcu, Maria Fazio, Radu Prodan, Zhiming Zhao, Massimiliano Rak
Veröffentlicht in: Proceedings of the 6th International Conference on Cloud Computing and Services Science, Ausgabe CLOSER 2016, 2016, Seite(n) 320-326, ISBN 978-989-758-182-3
Herausgeber: SCITEPRESS - Science and and Technology Publications
DOI: 10.5220/0005912503200326

CLOUDLIGHTNING: A Framework for a Self-organising and Self-managing Heterogeneous Cloud

Autoren: Theo Lynn, Huanhuan Xiong, Dapeng Dong, Bilal Momani, George Gravvanis, Christos Filelis-Papadopoulos, Anne Elster, Malik Muhammad Zaki Murtaza Khan, Dimitrios Tzovaras, Konstantinos Giannoutakis, Dana Petcu, Marian Neagul, Ioan Dragon, Perumal Kuppudayar, Suryanarayanan Natarajan, Michael McGrath, Georgi Gaydadjiev, Tobias Becker, Anna Gourinovitch, David Kenny, John Morrison
Veröffentlicht in: Proceedings of the 6th International Conference on Cloud Computing and Services Science, Ausgabe CLOSER 2016, 2016, Seite(n) 333-338, ISBN 978-989-758-182-3
Herausgeber: SCITEPRESS - Science and and Technology Publications
DOI: 10.5220/0005921503330338

Benchmarking the WRF Model on Bluegene/P, Cluster, and Cloud Platforms and Accelerating Model Setup Through Parallel Genetic Algorithms

Autoren: Liviu Oana, Marc Frincu
Veröffentlicht in: 2017 16th International Symposium on Parallel and Distributed Computing (ISPDC), 2017, Seite(n) 78-84, ISBN 978-1-5386-0862-3
Herausgeber: IEEE
DOI: 10.1109/ISPDC.2017.24

A Generic Framework Supporting Self-Organisation and Self-Management in Hierarchical Systems

Autoren: Christos Filelis-Papadopoulos, Huanhuan Xiong, Adrian Spataru, Gabriel G. Castane, Dapeng Dong, George A. Gravvanis, John P. Morrison
Veröffentlicht in: 2017 16th International Symposium on Parallel and Distributed Computing (ISPDC), 2017, Seite(n) 149-156, ISBN 978-1-5386-0862-3
Herausgeber: IEEE
DOI: 10.1109/ISPDC.2017.18

CloudLightning: a Self-Organized Self-Managed Heterogeneous Cloud

Autoren: Huanhuan Xiong, Dapeng Dong, Christos Filelis-Papadopoulos, Gabriel G. Castañé, Theo Lynn, Dan C. Marinescu, John Morrison
Veröffentlicht in: Proceedings of the 2017 Federated Conference on Computer Science and Information Systems, 2017, Seite(n) 749-758, ISBN 978-83-946253-7-5
Herausgeber: IEEE
DOI: 10.15439/2017F274

Towards a Scalable and Adaptable Resource Allocation Framework in Cloud Environments

Autoren: Huanhuan Xiong, Christos Filelis-Papadopoulos, Dapeng Dong, Gabriel G. Castane, John P. Morrison
Veröffentlicht in: 2017 46th International Conference on Parallel Processing Workshops (ICPPW), 2017, Seite(n) 137-144, ISBN 978-1-5386-1044-2
Herausgeber: IEEE
DOI: 10.1109/ICPPW.2017.31

Reusing Resource Coalitions for Efficient Scheduling on the Intercloud

Autoren: Teodora Selea, Adrian Spataru, Marc Frincu
Veröffentlicht in: 2016 16th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), 2016, Seite(n) 621-626, ISBN 978-1-5090-2453-7
Herausgeber: IEEE
DOI: 10.1109/CCGrid.2016.45

The CloudLightning approach to cloud-user interaction

Autoren: Teodora Selea, Ioan Drăgan, Teodor-Florin Fortiş
Veröffentlicht in: Proceedings of the 1st International Workshop on Next generation of Cloud Architectures - CloudNG:17, 2017, Seite(n) 1-5, ISBN 9781-450349369
Herausgeber: ACM Press
DOI: 10.1145/3068126.3068130

Utility-Driven Deployment Decision Making

Autoren: Radhika Loomba, Thijs Metsch, Leonard Feehan, Joe Butler
Veröffentlicht in: Proceedings of the10th International Conference on Utility and Cloud Computing - UCC '17, 2017, Seite(n) 207-208, ISBN 9781-450351492
Herausgeber: ACM Press
DOI: 10.1145/3147213.3149375

Online Resource Coalition Reorganization for Effecient Scheduling on Intercloud

Autoren: Adrian Spataru, Teodora Selea, Marc Frincu
Veröffentlicht in: ICA3PP 2016, 2016, Seite(n) 143-161, ISBN 978-1-5090-2453-7
Herausgeber: Springer International Publishing
DOI: 10.1007/978-3-319-49583-5_11

Understanding the Determinants of Cloud Computing Adoption for High Performance Computing

Autoren: Theo Lynn, Xiaoning Liang, Anna Gourinovitch, John Morrison, Grace Fox, Pierangelo Rosati
Veröffentlicht in: Proceedings of the 51st Hawaii International Conference on System Sciences, 2018, Seite(n) 3894-3903, ISBN 978-0-9981331-1-9
Herausgeber: Hawaii International Conference on System Sciences

A comparative study of CPU power consumption models for cloud simulation frameworks

Autoren: Antonios T. Makaratzis, Christos K. Filelis-Papadopoulos, Konstantinos M. Giannoutakis, George A. Gravvanis, Dimitrios Tzovaras
Veröffentlicht in: Proceedings of the 21st Pan-Hellenic Conference on Informatics - PCI 2017, 2017, Seite(n) 1-6, ISBN 9781-450353557
Herausgeber: ACM Press
DOI: 10.1145/3139367.3139409

GPU Power Modeling of HPC Applications for the Simulation of Heterogeneous Clouds

Autoren: A. Makaratzis (CERTH), M. Khan (NTNU), K. Giannoutakis (CERTH), A. Elster (NTNU) and D. Tzovaras (CERTH)
Veröffentlicht in: Proceedings of the 12th International Conference on Parallel Processing and Applied Mathematics (PPAM 2017), 2018
Herausgeber: Springer

Characterizing Numascale Clusters with GPUs: MPI-Based and GPU Interconnect Benchmarks

Autoren: Malik M. Khan, Anne C. Elster
Veröffentlicht in: The 2016 International Conference on High Performance Computing and Simulation (HPCS), 2016, ISBN 978-1-5090-2086-7
Herausgeber: IEEE Xplorer

Supporting Heterogeneous Pools in a Single Ceph Storage Cluster

Autoren: Stefan Meyer, John P. Morrison
Veröffentlicht in: 2015 17th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC), 2015, Seite(n) 352-359, ISBN 978-1-5090-0461-4
Herausgeber: IEEE
DOI: 10.1109/SYNASC.2015.61

On Issues Concerning Cloud Environments in Scope of Scalable Multi-Projection Methods

Autoren: Byron E. Moutafis, Christos K. Filelis-Papadopoulos, George A. Gravvanis, John P. Morrison
Veröffentlicht in: 2016 18th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC), 2016, Seite(n) 343-350, ISBN 978-1-5090-5707-8
Herausgeber: IEEE
DOI: 10.1109/SYNASC.2016.061

CloudLightning Simulation and Evaluation Roadmap

Autoren: C. K. Filelis-Papadopoulos, G. A. Gravvanis, J. P. Morrison
Veröffentlicht in: Proceedings of the 1st International Workshop on Next generation of Cloud Architectures - CloudNG:17, 2017, Seite(n) 1-6, ISBN 9781-450349369
Herausgeber: ACM Press
DOI: 10.1145/3068126.3068128

On the power consumption modeling for the simulation of Heterogeneous HPC clouds

Autoren: Konstantinos M. Giannoutakis, Antonios T. Makaratzis, Dimitrios Tzovaras, Christos K. Filelis-Papadopoulos, George A. Gravvanis
Veröffentlicht in: Proceedings of the 1st International Workshop on Next generation of Cloud Architectures - CloudNG:17, 2017, Seite(n) 1-6, ISBN 9781-450349369
Herausgeber: ACM Press
DOI: 10.1145/3068126.3068127

Self-Healing in a Decentralised Cloud Management System

Autoren: Paul Stack, Huanhuan Xiong, Dali Mersel, Maxime Makhloufi, Guillaume Terpend, Dapeng Dong
Veröffentlicht in: Proceedings of the 1st International Workshop on Next generation of Cloud Architectures - CloudNG:17, 2017, Seite(n) 1-6, ISBN 9781-450349369
Herausgeber: ACM Press
DOI: 10.1145/3068126.3068129

Elastic Cloud Services Compliance with Gustafson’s and Amdahl’s Laws

Autoren: Ristov, Sasko; Prodan, Radu; Gusev, Marjan; Petcu, Dana; Barbosa, Jorge
Veröffentlicht in: Proceedings of the Third International Workshop on Sustainable Ultrascale Computing Systems (NESUS 2016), 2016, Seite(n) 1-9, ISBN 978-84-617-7450-0
Herausgeber: Universidad Carlos III de Madrid

Characterization of hardware in self-managing self-organizing Cloud environment

Autoren: C. K. Filelis-Papadopoulos, E. N. G. Grylonakis, P. E. Kyziropoulos, G. A. Gravvanis, J. P. Morrison
Veröffentlicht in: Proceedings of the 20th Pan-Hellenic Conference on Informatics - PCI '16, 2016, Seite(n) 1-6, ISBN 9781-450347891
Herausgeber: ACM Press
DOI: 10.1145/3003733.3003749

Cloud Deployment and Management of Dataflow Engines

Autoren: Nemanja Trifunovic, Hristina Palikareva, Tobias Becker, Georgi Gaydadjiev
Veröffentlicht in: Proceedings of the 1st International Workshop on Next generation of Cloud Architectures - CloudNG:17, 2017, Seite(n) 1-6, ISBN 9781-450349369
Herausgeber: ACM Press
DOI: 10.1145/3068126.3068795

A Preliminary Systematic Review of Computer Science Literature on Cloud Computing Research using Open Source Simulation Platforms

Autoren: Theo Lynn, Anna Gourinovitch, James Byrne, P. J. Byrne, Sergej Svorobej, Konstaninos Giannoutakis, David Kenny, John Morrison
Veröffentlicht in: Proceedings of the 7th International Conference on Cloud Computing and Services Science, 2017, Seite(n) 565-573, ISBN 978-989-758-243-1
Herausgeber: SCITEPRESS - Science and Technology Publications
DOI: 10.5220/0006351805650573

Separation of Concerns in Heterogeneous Cloud Environments

Autoren: Dapeng Dong, Huanhuan Xiong, John Morrison
Veröffentlicht in: Proceedings of the 7th International Conference on Cloud Computing and Services Science, 2017, Seite(n) 775-780, ISBN 978-989-758-243-1
Herausgeber: SCITEPRESS - Science and Technology Publications
DOI: 10.5220/0006385507750780

Architecting a hybrid cross layer dew-fog-cloud stack for future data-driven cyber-physical systems

Autoren: Marc Frincu
Veröffentlicht in: 2017 40th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), 2017, Seite(n) 399-403, ISBN 978-953-233-090-8
Herausgeber: IEEE
DOI: 10.23919/MIPRO.2017.7973456

A Review of Cloud Computing Simulation Platforms and Related Environments

Autoren: James Byrne, Sergej Svorobej, Konstantinos M. Giannoutakis, Dimitrios Tzovaras, P. J. Byrne, Per-Olov Östberg, Anna Gourinovitch, Theo Lynn
Veröffentlicht in: Proceedings of the 7th International Conference on Cloud Computing and Services Science, 2017, Seite(n) 679-691, ISBN 978-989-758-243-1
Herausgeber: SCITEPRESS - Science and Technology Publications
DOI: 10.5220/0006373006790691

Towards the Integration of a HPC Build System in the Cloud Ecosystem

Autoren: Ioan Drăgan, Teodora Selea, Teodor-Florin Fortiş
Veröffentlicht in: CISIS 2016: Conference on Complex, Intelligent, and Software Intensive Systems, 2018, Seite(n) 916-925, ISBN 978-3-319-61566-0
Herausgeber: Springer International Publishing
DOI: 10.1007/978-3-319-61566-0_87

Managing and Unifying Heterogeneous Resources in Cloud Environments

Autoren: Dapeng Dong, Paul Stack, Huanhuan Xiong, John P. Morrison
Veröffentlicht in: Proceedings of the 7th International Conference on Cloud Computing and Services Science, 2017, Seite(n) 143-150, ISBN 978-989-758-243-1
Herausgeber: SCITEPRESS - Science and Technology Publications
DOI: 10.5220/0006300901430150

Communicating Complex Services Using Electronic Word-of-Mouth on Twitter: An Exploratory Study

Autoren: Anna Gourinovitch, Xiaoning Liang, Pierangelo Rosati, Theo Lynn
Veröffentlicht in: 2017 Summer AMA Proceedings, 2017, Seite(n) F14 - F15, ISBN 0-87757-366-2
Herausgeber: American Marketing Association

Scheduling Data Stream Jobs on Distributed Systems with Background Load

Autoren: Anca Vulpe, Marc Frincu
Veröffentlicht in: 2017 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID), 2017, Seite(n) 838-847, ISBN 978-1-5090-6611-7
Herausgeber: IEEE
DOI: 10.1109/CCGRID.2017.139

Peer reviewed articles (9)

Large-scale simulation of a self-organizing self-management cloud computing framework

Autoren: Christos K. Filelis-Papadopoulos, Konstantinos M. Giannoutakis, George A. Gravvanis, Dimitrios Tzovaras
Veröffentlicht in: The Journal of Supercomputing, 2017, ISSN 0920-8542
Herausgeber: Kluwer Academic Publishers
DOI: 10.1007/s11227-017-2143-2

Energy modeling in cloud simulation frameworks

Autoren: Antonios T. Makaratzis, Konstantinos M. Giannoutakis, Dimitrios Tzovaras
Veröffentlicht in: Future Generation Computer Systems, Ausgabe 79, 2018, Seite(n) 715-725, ISSN 0167-739X
Herausgeber: Elsevier BV
DOI: 10.1016/j.future.2017.06.016

A framework for simulating large scale cloud infrastructures

Autoren: Christos K. Filelis-Papadopoulos, George A. Gravvanis, Panagiotis E. Kyziropoulos
Veröffentlicht in: Future Generation Computer Systems, Ausgabe 79, 2018, Seite(n) 703-714, ISSN 0167-739X
Herausgeber: Elsevier BV
DOI: 10.1016/j.future.2017.06.017

ImageCL: Language and source-to-source compiler for performance portability, load balancing, and scalability prediction on heterogeneous systems

Autoren: Thomas L. Falch, Anne C. Elster
Veröffentlicht in: Concurrency and Computation: Practice and Experience, 2017, Seite(n) e4384, ISSN 1532-0626
Herausgeber: John Wiley & Sons Inc.
DOI: 10.1002/cpe.4384

A Cloud Reservation System for Big Data Applications

Autoren: Dan Marinescu, Ashkan Paya, John Morrison
Veröffentlicht in: IEEE Transactions on Parallel and Distributed Systems, Ausgabe 99, 2016, Seite(n) 1-1, ISSN 1045-9219
Herausgeber: Institute of Electrical and Electronics Engineers
DOI: 10.1109/TPDS.2016.2594783

An approach for scaling cloud resource management

Autoren: Dan C. Marinescu, Ashkan Paya, John P. Morrison, Stephen Olariu
Veröffentlicht in: Cluster Computing, Ausgabe 20/1, 2017, Seite(n) 909-924, ISSN 1386-7857
Herausgeber: Baltzer Science Publishers B.V.
DOI: 10.1007/s10586-016-0700-8

Topics in cloud incident management

Autoren: Teodor-Florin Fortiş, Victor Ion Munteanu
Veröffentlicht in: Future Generation Computer Systems, Ausgabe 72, 2017, Seite(n) 163-164, ISSN 0167-739X
Herausgeber: Elsevier BV
DOI: 10.1016/j.future.2016.11.003

Exposing HPC services in the Cloud: the CloudLightning Approach

Autoren: Ioan Dragan, Teodor Florin Fortis, Marian Neagul
Veröffentlicht in: Scalable Computing: Practice and Experience, Ausgabe 17/4, 2016, ISSN 1895-1767
Herausgeber: universitatea de vest
DOI: 10.12694/scpe.v17i4.1204

Machine learning-based auto-tuning for enhanced performance portability of OpenCL applications

Autoren: Thomas L. Falch, Anne C. Elster
Veröffentlicht in: Concurrency and Computation: Practice and Experience, Ausgabe 29/8, 2017, Seite(n) e4029, ISSN 1532-0626
Herausgeber: John Wiley & Sons Inc.
DOI: 10.1002/cpe.4029

Book chapters (2)

Evaluating Distributed Systems and Applications Through Accurate Models and Simulations

Autoren: Marc Frincu, Bogdan Irimie, Teodora Selea, Adrian Spataru, Anca Vulpe
Veröffentlicht in: Modeling and Simulation in HPC and Cloud Systems, 2018, Seite(n) 1-18
Herausgeber: Springer International Publishing
DOI: 10.1007/978-3-319-73767-6_1

Applying Self-* Principles in Heterogeneous Cloud Environments

Autoren: Ioan Drăgan, Teodor-Florin Fortiş, Gabriel Iuhasz, Marian Neagul, Dana Petcu
Veröffentlicht in: Cloud Computing: Computer Communications and Networks, 2017, Seite(n) 255-274
Herausgeber: Springer International Publishing
DOI: 10.1007/978-3-319-54645-2_10

Monographic books (1)

Heterogeneity, High Performance Computing, Self-Organization and the Cloud

Autoren: D. Dong, I. Drăgan, C. Filelis-Papadopoulos, T-F Fortiș, K. M. Giannoutakis, G. Gonzalez-Castañe, G. A. Gravvanis, C. S. Kouzinopoulos, T. Lynn, A. T. Makaratzis, J. P. Morrison, M. Neagul, D. Petcu, T. Selea, A. Spataru, D. Tzovaras, H. Xiong.
Veröffentlicht in: 2018
Herausgeber: Palgrave Macmillan