Self-Organising, Self-Managing Heterogeneous Cloud

Información del proyecto

CloudLightning

Identificador del acuerdo de subvención: 643946

DOI

10.3030/643946

Proyecto cerrado

Fecha de la firma de la CE 15 Diciembre 2014

Fecha de inicio 1 Febrero 2015

Fecha de finalización 31 Enero 2018

Financiado con arreglo a

• INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT)

Coste total

€ 3 957 050,00

Aportación de la UE

€ 3 934 425,00

Coordinado por

UNIVERSITY COLLEGE CORK - NATIONAL UNIVERSITY OF IRELAND, CORK
Ireland

CORDIS proporciona enlaces a los documentos públicos y las publicaciones de los proyectos de los programas marco HORIZONTE.

Los enlaces a los documentos y las publicaciones de los proyectos del Séptimo Programa Marco, así como los enlaces a algunos tipos de resultados específicos, como conjuntos de datos y «software», se obtienen dinámicamente de OpenAIRE .

Resultado final

Documents, reports (23)

Simulation execution and evaluation

D7.2.1 Simulation execution and evaluation. (Due date - month33)

Evaluation

D3.3.1 Evaluation Report. (Due date - month 36)

D2.3.1 Report on use case testing

This report will describe the testbed environment that is being used for evaluation and the results of execution of the use case applications on the testbed.

Local Decision Strategies

D4.2.1 Local Decision Strategies. (Due date - months 12,18)

Service Description Format

D5.1.1 Service description format specification. (Due date - month15)

D8.3.2 Report on CloudLightning Concertation

A follow-up deliverable to D8.3.1, this report will provide updates on targets, detailed figures and progress towards implementing the concertation plan.

D8.1.3 Exploitation Plan and Strategic Guidelines for Exploitation

A separate report relating to the outputs from the Delphi Method research Task 8.1.1 Industry Exploitation.

Gateway Service

D5.2.1 Gateway service. Due date (month 24)

Gateway service user interface

D5.3.1 Gateway service user interface. (Due date - month30)

Coalition Formation

D4.3.1 Coalition Formation. (Due date - month20)

Prototype Specification and API

D4.1.1 Protocol specification and API. (Due date - month12)

Simulation Report

The simulation report that will constitute all results obtained from the exhaustive experimentation on large scale simulations. The report will constitute qualitative metrics along with the results of several parameterised executions, mainly resulting from the testbed of WP2. Theoretical models will accompany the results for validation purposes in order to predict the behaviour of the proposed models of even larger scale executions. The results of simulation execution will validate the proposed methodology against the initial project objectives.

D8.1.1 Exploitation Plan and Strategic Guidelines for Exploitation

The first deliverable will provide details about the exploitation plan and Strategic Guidelines for exploitation as laid out in Task 8.1.

D8.2.3 CloudLightning Dissemination

The final report under Task 8.2 will provide updates on targets, detailed figures and progress towards the implementation of the dissemination strategy, including a review of all dissemination activities undertaken during the project.

D8.3.3 Report on CloudLightning Concertation

The final report will include a review of all concertation activities undertaken during the project under Task 8.3.

D8.1.4 Exploitation Plan and Strategic Guidelines for Exploitation

This final report will include a review of all exploitation activities undertaken during the project including updates on targets, detailed figures and progress towards implementing the exploitation strategy.

Large scale modelling and simulation framework

D7.1.1 - Large scale modelling and simulation framework. (Due date - month29)

Integration

D3.2.1 Final Integration Plan (Due date - month 30)

Service Deployment and Management

D4.4.1 Service Deployment and Management.(Due date - month21)

D8.2.1 CloudLightning Dissemination

The first deliverable will provide details about the Dissemination Plan, implementation of the project website, Basecamp and social networking accounts and a progress report on agreed activities to raise public awareness and participation, and impact against planned metrics in the first 12 months.

D8.1.2 Exploitation Plan and Strategic Guidelines for Exploitation

A follow-up report to D8.1.1 that will provide updates on targets, detailed figures and progress towards implementing the exploitation strategy.

D8.3.1 Report on CloudLightning Concertation

The first deliverable will provide details about the Concertation Plan and a progress report on concertation activities and impact against planned metrics in the first 12 months.

D8.2.2 CloudLightning Dissemination

Follow-up report to D8.2.1 will provide updates on targets, detailed figures and progress towards implementing the dissemination strategy.

Demonstrators, pilots, prototypes (3)

Integrated use cases

D2.2.1 Integrated use cases This report will describe the integrated use case applications and document their capabilities and structure. (Due date - month 24)

Architecture

D3.1.1 Report on State of the Art and Draft Architecture (Draft, internal). (Due date - month 6) D3.1.2 Report on State of the Art and Architecture (updated, public, for review). (Due date - month 12)

Use Case Requirements Report

D2.1.1 Use case requirements report This report will detail the requirements of, opportunities for and means to evaluate the identified use case applications. (Due date - month 8)

Publicaciones

Other (1)

Benchmarking the Numascale Shared Memory Cluster System with MPI

Autores: Malik M. Khan, Anne C. Elster
Publicado en: Workshop on Exascale MPI at Supercomputing Conference, 2015
Editor: Epigram Project Website
DOI: 10.13140/RG.2.1.3660.9364

Conference proceedings (31)

On Autonomic HPC Clouds

Autores: Petcu, Dana
Publicado en: Proceedings of the Second International Workshop on Sustainable Ultrascale Computing Systems (NESUS 2015), Edición NESUS 2015, 2015, Página(s) 29-40, ISBN 978-84-608-2581-4
Editor: University Carlos III

On the Next Generations of Infrastructure-as-a-Services

Autores: Dana Petcu, Maria Fazio, Radu Prodan, Zhiming Zhao, Massimiliano Rak
Publicado en: Proceedings of the 6th International Conference on Cloud Computing and Services Science, Edición CLOSER 2016, 2016, Página(s) 320-326, ISBN 978-989-758-182-3
Editor: SCITEPRESS - Science and and Technology Publications
DOI: 10.5220/0005912503200326

CLOUDLIGHTNING: A Framework for a Self-organising and Self-managing Heterogeneous Cloud

Autores: Theo Lynn, Huanhuan Xiong, Dapeng Dong, Bilal Momani, George Gravvanis, Christos Filelis-Papadopoulos, Anne Elster, Malik Muhammad Zaki Murtaza Khan, Dimitrios Tzovaras, Konstantinos Giannoutakis, Dana Petcu, Marian Neagul, Ioan Dragon, Perumal Kuppudayar, Suryanarayanan Natarajan, Michael McGrath, Georgi Gaydadjiev, Tobias Becker, Anna Gourinovitch, David Kenny, John Morrison
Publicado en: Proceedings of the 6th International Conference on Cloud Computing and Services Science, Edición CLOSER 2016, 2016, Página(s) 333-338, ISBN 978-989-758-182-3
Editor: SCITEPRESS - Science and and Technology Publications
DOI: 10.5220/0005921503330338

Benchmarking the WRF Model on Bluegene/P, Cluster, and Cloud Platforms and Accelerating Model Setup Through Parallel Genetic Algorithms

Autores: Liviu Oana, Marc Frincu
Publicado en: 2017 16th International Symposium on Parallel and Distributed Computing (ISPDC), 2017, Página(s) 78-84, ISBN 978-1-5386-0862-3
Editor: IEEE
DOI: 10.1109/ISPDC.2017.24

A Generic Framework Supporting Self-Organisation and Self-Management in Hierarchical Systems

Autores: Christos Filelis-Papadopoulos, Huanhuan Xiong, Adrian Spataru, Gabriel G. Castane, Dapeng Dong, George A. Gravvanis, John P. Morrison
Publicado en: 2017 16th International Symposium on Parallel and Distributed Computing (ISPDC), 2017, Página(s) 149-156, ISBN 978-1-5386-0862-3
Editor: IEEE
DOI: 10.1109/ISPDC.2017.18

CloudLightning: a Self-Organized Self-Managed Heterogeneous Cloud

Autores: Huanhuan Xiong, Dapeng Dong, Christos Filelis-Papadopoulos, Gabriel G. Castañé, Theo Lynn, Dan C. Marinescu, John Morrison
Publicado en: Proceedings of the 2017 Federated Conference on Computer Science and Information Systems, 2017, Página(s) 749-758, ISBN 978-83-946253-7-5
Editor: IEEE
DOI: 10.15439/2017F274

Towards a Scalable and Adaptable Resource Allocation Framework in Cloud Environments

Autores: Huanhuan Xiong, Christos Filelis-Papadopoulos, Dapeng Dong, Gabriel G. Castane, John P. Morrison
Publicado en: 2017 46th International Conference on Parallel Processing Workshops (ICPPW), 2017, Página(s) 137-144, ISBN 978-1-5386-1044-2
Editor: IEEE
DOI: 10.1109/ICPPW.2017.31

Reusing Resource Coalitions for Efficient Scheduling on the Intercloud

Autores: Teodora Selea, Adrian Spataru, Marc Frincu
Publicado en: 2016 16th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid), 2016, Página(s) 621-626, ISBN 978-1-5090-2453-7
Editor: IEEE
DOI: 10.1109/CCGrid.2016.45

The CloudLightning approach to cloud-user interaction

Autores: Teodora Selea, Ioan Drăgan, Teodor-Florin Fortiş
Publicado en: Proceedings of the 1st International Workshop on Next generation of Cloud Architectures - CloudNG:17, 2017, Página(s) 1-5, ISBN 9781-450349369
Editor: ACM Press
DOI: 10.1145/3068126.3068130

Utility-Driven Deployment Decision Making

Autores: Radhika Loomba, Thijs Metsch, Leonard Feehan, Joe Butler
Publicado en: Proceedings of the10th International Conference on Utility and Cloud Computing - UCC '17, 2017, Página(s) 207-208, ISBN 9781-450351492
Editor: ACM Press
DOI: 10.1145/3147213.3149375

Online Resource Coalition Reorganization for Effecient Scheduling on Intercloud

Autores: Adrian Spataru, Teodora Selea, Marc Frincu
Publicado en: ICA3PP 2016, 2016, Página(s) 143-161, ISBN 978-1-5090-2453-7
Editor: Springer International Publishing
DOI: 10.1007/978-3-319-49583-5_11

Understanding the Determinants of Cloud Computing Adoption for High Performance Computing

Autores: Theo Lynn, Xiaoning Liang, Anna Gourinovitch, John Morrison, Grace Fox, Pierangelo Rosati
Publicado en: Proceedings of the 51st Hawaii International Conference on System Sciences, 2018, Página(s) 3894-3903, ISBN 978-0-9981331-1-9
Editor: Hawaii International Conference on System Sciences

A comparative study of CPU power consumption models for cloud simulation frameworks

Autores: Antonios T. Makaratzis, Christos K. Filelis-Papadopoulos, Konstantinos M. Giannoutakis, George A. Gravvanis, Dimitrios Tzovaras
Publicado en: Proceedings of the 21st Pan-Hellenic Conference on Informatics - PCI 2017, 2017, Página(s) 1-6, ISBN 9781-450353557
Editor: ACM Press
DOI: 10.1145/3139367.3139409

GPU Power Modeling of HPC Applications for the Simulation of Heterogeneous Clouds

Autores: A. Makaratzis (CERTH), M. Khan (NTNU), K. Giannoutakis (CERTH), A. Elster (NTNU) and D. Tzovaras (CERTH)
Publicado en: Proceedings of the 12th International Conference on Parallel Processing and Applied Mathematics (PPAM 2017), 2018
Editor: Springer

Characterizing Numascale Clusters with GPUs: MPI-Based and GPU Interconnect Benchmarks

Autores: Malik M. Khan, Anne C. Elster
Publicado en: The 2016 International Conference on High Performance Computing and Simulation (HPCS), 2016, ISBN 978-1-5090-2086-7
Editor: IEEE Xplorer

Supporting Heterogeneous Pools in a Single Ceph Storage Cluster

Autores: Stefan Meyer, John P. Morrison
Publicado en: 2015 17th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC), 2015, Página(s) 352-359, ISBN 978-1-5090-0461-4
Editor: IEEE
DOI: 10.1109/SYNASC.2015.61

On Issues Concerning Cloud Environments in Scope of Scalable Multi-Projection Methods

Autores: Byron E. Moutafis, Christos K. Filelis-Papadopoulos, George A. Gravvanis, John P. Morrison
Publicado en: 2016 18th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC), 2016, Página(s) 343-350, ISBN 978-1-5090-5707-8
Editor: IEEE
DOI: 10.1109/SYNASC.2016.061

CloudLightning Simulation and Evaluation Roadmap

Autores: C. K. Filelis-Papadopoulos, G. A. Gravvanis, J. P. Morrison
Publicado en: Proceedings of the 1st International Workshop on Next generation of Cloud Architectures - CloudNG:17, 2017, Página(s) 1-6, ISBN 9781-450349369
Editor: ACM Press
DOI: 10.1145/3068126.3068128

On the power consumption modeling for the simulation of Heterogeneous HPC clouds

Autores: Konstantinos M. Giannoutakis, Antonios T. Makaratzis, Dimitrios Tzovaras, Christos K. Filelis-Papadopoulos, George A. Gravvanis
Publicado en: Proceedings of the 1st International Workshop on Next generation of Cloud Architectures - CloudNG:17, 2017, Página(s) 1-6, ISBN 9781-450349369
Editor: ACM Press
DOI: 10.1145/3068126.3068127

Self-Healing in a Decentralised Cloud Management System

Autores: Paul Stack, Huanhuan Xiong, Dali Mersel, Maxime Makhloufi, Guillaume Terpend, Dapeng Dong
Publicado en: Proceedings of the 1st International Workshop on Next generation of Cloud Architectures - CloudNG:17, 2017, Página(s) 1-6, ISBN 9781-450349369
Editor: ACM Press
DOI: 10.1145/3068126.3068129

Elastic Cloud Services Compliance with Gustafson’s and Amdahl’s Laws

Autores: Ristov, Sasko; Prodan, Radu; Gusev, Marjan; Petcu, Dana; Barbosa, Jorge
Publicado en: Proceedings of the Third International Workshop on Sustainable Ultrascale Computing Systems (NESUS 2016), 2016, Página(s) 1-9, ISBN 978-84-617-7450-0
Editor: Universidad Carlos III de Madrid

Characterization of hardware in self-managing self-organizing Cloud environment

Autores: C. K. Filelis-Papadopoulos, E. N. G. Grylonakis, P. E. Kyziropoulos, G. A. Gravvanis, J. P. Morrison
Publicado en: Proceedings of the 20th Pan-Hellenic Conference on Informatics - PCI '16, 2016, Página(s) 1-6, ISBN 9781-450347891
Editor: ACM Press
DOI: 10.1145/3003733.3003749

Cloud Deployment and Management of Dataflow Engines

Autores: Nemanja Trifunovic, Hristina Palikareva, Tobias Becker, Georgi Gaydadjiev
Publicado en: Proceedings of the 1st International Workshop on Next generation of Cloud Architectures - CloudNG:17, 2017, Página(s) 1-6, ISBN 9781-450349369
Editor: ACM Press
DOI: 10.1145/3068126.3068795

A Preliminary Systematic Review of Computer Science Literature on Cloud Computing Research using Open Source Simulation Platforms

Autores: Theo Lynn, Anna Gourinovitch, James Byrne, P. J. Byrne, Sergej Svorobej, Konstaninos Giannoutakis, David Kenny, John Morrison
Publicado en: Proceedings of the 7th International Conference on Cloud Computing and Services Science, 2017, Página(s) 565-573, ISBN 978-989-758-243-1
Editor: SCITEPRESS - Science and Technology Publications
DOI: 10.5220/0006351805650573

Separation of Concerns in Heterogeneous Cloud Environments

Autores: Dapeng Dong, Huanhuan Xiong, John Morrison
Publicado en: Proceedings of the 7th International Conference on Cloud Computing and Services Science, 2017, Página(s) 775-780, ISBN 978-989-758-243-1
Editor: SCITEPRESS - Science and Technology Publications
DOI: 10.5220/0006385507750780

Architecting a hybrid cross layer dew-fog-cloud stack for future data-driven cyber-physical systems

Autores: Marc Frincu
Publicado en: 2017 40th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), 2017, Página(s) 399-403, ISBN 978-953-233-090-8
Editor: IEEE
DOI: 10.23919/MIPRO.2017.7973456

A Review of Cloud Computing Simulation Platforms and Related Environments

Autores: James Byrne, Sergej Svorobej, Konstantinos M. Giannoutakis, Dimitrios Tzovaras, P. J. Byrne, Per-Olov Östberg, Anna Gourinovitch, Theo Lynn
Publicado en: Proceedings of the 7th International Conference on Cloud Computing and Services Science, 2017, Página(s) 679-691, ISBN 978-989-758-243-1
Editor: SCITEPRESS - Science and Technology Publications
DOI: 10.5220/0006373006790691

Towards the Integration of a HPC Build System in the Cloud Ecosystem

Autores: Ioan Drăgan, Teodora Selea, Teodor-Florin Fortiş
Publicado en: CISIS 2016: Conference on Complex, Intelligent, and Software Intensive Systems, 2018, Página(s) 916-925, ISBN 978-3-319-61566-0
Editor: Springer International Publishing
DOI: 10.1007/978-3-319-61566-0_87

Managing and Unifying Heterogeneous Resources in Cloud Environments

Autores: Dapeng Dong, Paul Stack, Huanhuan Xiong, John P. Morrison
Publicado en: Proceedings of the 7th International Conference on Cloud Computing and Services Science, 2017, Página(s) 143-150, ISBN 978-989-758-243-1
Editor: SCITEPRESS - Science and Technology Publications
DOI: 10.5220/0006300901430150

Communicating Complex Services Using Electronic Word-of-Mouth on Twitter: An Exploratory Study

Autores: Anna Gourinovitch, Xiaoning Liang, Pierangelo Rosati, Theo Lynn
Publicado en: 2017 Summer AMA Proceedings, 2017, Página(s) F14 - F15, ISBN 0-87757-366-2
Editor: American Marketing Association

Scheduling Data Stream Jobs on Distributed Systems with Background Load

Autores: Anca Vulpe, Marc Frincu
Publicado en: 2017 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID), 2017, Página(s) 838-847, ISBN 978-1-5090-6611-7
Editor: IEEE
DOI: 10.1109/CCGRID.2017.139

Peer reviewed articles (9)

Large-scale simulation of a self-organizing self-management cloud computing framework

Autores: Christos K. Filelis-Papadopoulos, Konstantinos M. Giannoutakis, George A. Gravvanis, Dimitrios Tzovaras
Publicado en: The Journal of Supercomputing, 2017, ISSN 0920-8542
Editor: Kluwer Academic Publishers
DOI: 10.1007/s11227-017-2143-2

Energy modeling in cloud simulation frameworks

Autores: Antonios T. Makaratzis, Konstantinos M. Giannoutakis, Dimitrios Tzovaras
Publicado en: Future Generation Computer Systems, Edición 79, 2018, Página(s) 715-725, ISSN 0167-739X
Editor: Elsevier BV
DOI: 10.1016/j.future.2017.06.016

A framework for simulating large scale cloud infrastructures

Autores: Christos K. Filelis-Papadopoulos, George A. Gravvanis, Panagiotis E. Kyziropoulos
Publicado en: Future Generation Computer Systems, Edición 79, 2018, Página(s) 703-714, ISSN 0167-739X
Editor: Elsevier BV
DOI: 10.1016/j.future.2017.06.017

ImageCL: Language and source-to-source compiler for performance portability, load balancing, and scalability prediction on heterogeneous systems

Autores: Thomas L. Falch, Anne C. Elster
Publicado en: Concurrency and Computation: Practice and Experience, 2017, Página(s) e4384, ISSN 1532-0626
Editor: John Wiley & Sons Inc.
DOI: 10.1002/cpe.4384

A Cloud Reservation System for Big Data Applications

Autores: Dan Marinescu, Ashkan Paya, John Morrison
Publicado en: IEEE Transactions on Parallel and Distributed Systems, Edición 99, 2016, Página(s) 1-1, ISSN 1045-9219
Editor: Institute of Electrical and Electronics Engineers
DOI: 10.1109/TPDS.2016.2594783

An approach for scaling cloud resource management

Autores: Dan C. Marinescu, Ashkan Paya, John P. Morrison, Stephen Olariu
Publicado en: Cluster Computing, Edición 20/1, 2017, Página(s) 909-924, ISSN 1386-7857
Editor: Baltzer Science Publishers B.V.
DOI: 10.1007/s10586-016-0700-8

Topics in cloud incident management

Autores: Teodor-Florin Fortiş, Victor Ion Munteanu
Publicado en: Future Generation Computer Systems, Edición 72, 2017, Página(s) 163-164, ISSN 0167-739X
Editor: Elsevier BV
DOI: 10.1016/j.future.2016.11.003

Exposing HPC services in the Cloud: the CloudLightning Approach

Autores: Ioan Dragan, Teodor Florin Fortis, Marian Neagul
Publicado en: Scalable Computing: Practice and Experience, Edición 17/4, 2016, ISSN 1895-1767
Editor: universitatea de vest
DOI: 10.12694/scpe.v17i4.1204

Machine learning-based auto-tuning for enhanced performance portability of OpenCL applications

Autores: Thomas L. Falch, Anne C. Elster
Publicado en: Concurrency and Computation: Practice and Experience, Edición 29/8, 2017, Página(s) e4029, ISSN 1532-0626
Editor: John Wiley & Sons Inc.
DOI: 10.1002/cpe.4029

Book chapters (2)

Evaluating Distributed Systems and Applications Through Accurate Models and Simulations

Autores: Marc Frincu, Bogdan Irimie, Teodora Selea, Adrian Spataru, Anca Vulpe
Publicado en: Modeling and Simulation in HPC and Cloud Systems, 2018, Página(s) 1-18
Editor: Springer International Publishing
DOI: 10.1007/978-3-319-73767-6_1

Applying Self-* Principles in Heterogeneous Cloud Environments

Autores: Ioan Drăgan, Teodor-Florin Fortiş, Gabriel Iuhasz, Marian Neagul, Dana Petcu
Publicado en: Cloud Computing: Computer Communications and Networks, 2017, Página(s) 255-274
Editor: Springer International Publishing
DOI: 10.1007/978-3-319-54645-2_10

Monographic books (1)

Heterogeneity, High Performance Computing, Self-Organization and the Cloud

Autores: D. Dong, I. Drăgan, C. Filelis-Papadopoulos, T-F Fortiș, K. M. Giannoutakis, G. Gonzalez-Castañe, G. A. Gravvanis, C. S. Kouzinopoulos, T. Lynn, A. T. Makaratzis, J. P. Morrison, M. Neagul, D. Petcu, T. Selea, A. Spataru, D. Tzovaras, H. Xiong.
Publicado en: 2018
Editor: Palgrave Macmillan