Designing and Enabling E-infrastructures for intensive Processing in a Hybrid DataCloud

Projektinformationen

DEEP-HybridDataCloud

ID Finanzhilfevereinbarung: 777435

DOI

10.3030/777435

Projekt abgeschlossen

EK-Unterschriftsdatum 31 Oktober 2017

Startdatum 1 November 2017

Enddatum 30 April 2020

Finanziert unter

• EXCELLENT SCIENCE - Research Infrastructures

Gesamtkosten

€ 2 988 750,00

EU-Beitrag

€ 2 988 750,00

Koordiniert durch

AGENCIA ESTATAL CONSEJO SUPERIOR DE INVESTIGACIONES CIENTIFICAS
Spain

CORDIS bietet Links zu öffentlichen Ergebnissen und Veröffentlichungen von HORIZONT-Projekten.

Links zu Ergebnissen und Veröffentlichungen von RP7-Projekten sowie Links zu einigen Typen spezifischer Ergebnisse wie Datensätzen und Software werden dynamisch von OpenAIRE abgerufen.

Leistungen

Documents, reports (23)

Intermediate Status Report about Use Cases

Intermediate Status Report about use case integration and Devops methods

Available Technologies for accelerators and HPC

Assessment of available technologies for supporting accelerators and HPC, initial design and implementation plan (all tasks)

Final Report about Use Case integration

Final Report about use case integration

Consolidated reports from global DEEP meetings.
First prototype of the DEEP as a Service

First prototype implementation of the DEEP as a Service solution

Pilot testbed

Pilot testbed and integration architecture with EOSC large scale infrastructures

Final implementation of software platform for accessing accelerators and HPC
First Software Platform

First implementation of software platform for accessing accelerators and HPC

Implementation of Dissemination and Exploitation Report.
Design for the DEEP as a Service solution

Design document and work plan for the DEEP as a Service solution

Definition of the Architecture of the Hybrid Cloud

Definition of the architecture of the High Level Hybrid Cloud

Updated Dissemination and Exploitation Plan.
Initial plan for Use Cases

Initial Plan on the selection of use cases and the strategy for the devops pipelines.

High Level Hybrid Cloud solutions prototype

High Level Hybrid Cloud solutions prototype completed

Updated reports from global DEEP meetings.
Final Report on Dissemination and Exploitation.
Final report on EOSC integration and software management activities
Communication Measures: Plan and Implementation Status.
State-of-the-art on Machine Learning frameworks

State-of-the-art Deep Learning (DL), Neural Network (NN) and Machine Learning (ML) frameworks and libraries.

Final release of High Level Hybrid Cloud

Final release of High Level Hybrid Cloud solutions completed and deployed

Dissemination and Exploitation Plan.
Status of Software releases
Final implementation of the DEEP as a Service solution

Report on the final implementation of the DEEP as a Service solution.

Open Research Data Pilot (1)

Data Management considerations and initial plan

This deliverable will analyze the implications of existing Data Management Plans for the different datasets in the Case Studies, and how the derived data should be considered in the corresponding data life cycle.

Veröffentlichungen

Monographic books (1)

A set of common software quality assurance baseline criteria for research projects

Autoren: Orviz, Pablo; López García, Álvaro; Duma, Doina Cristina; Donvito, Giacinto; David, Mario; Gomes, Jorge
Veröffentlicht in: Ausgabe 1, 2018
Herausgeber: N/A

Peer reviewed articles (11)

An Information-centric Approach for Slice Monitoring from Edge Devices to Clouds

Autoren: Binh Minh Nguyen, Huan Phan, Duong Quang Ha, Giang Nguyen
Veröffentlicht in: Procedia Computer Science, Ausgabe 130, 2018, Seite(n) 326-335, ISSN 1877-0509
Herausgeber: Elsevier
DOI: 10.1016/j.procs.2018.04.046

A heuristics approach to mine behavioural data logs in mobile malware detection system

Autoren: Giang Nguyen, Binh Minh Nguyen, Dang Tran, Ladislav Hluchy
Veröffentlicht in: Data & Knowledge Engineering, Ausgabe 115, 2018, Seite(n) 129-151, ISSN 0169-023X
Herausgeber: Elsevier BV
DOI: 10.1016/j.datak.2018.03.002

A Multivariate Fuzzy Time Series Resource Forecast Model for Clouds using LSTM and Data Correlation Analysis

Autoren: Nhuan Tran, Thang Nguyen, Binh Minh Nguyen, Giang Nguyen
Veröffentlicht in: Procedia Computer Science, Ausgabe 126, 2018, Seite(n) 636-645, ISSN 1877-0509
Herausgeber: Elsevier
DOI: 10.1016/j.procs.2018.07.298

Machine Learning and Deep Learning frameworks and libraries for large-scale data mining: a survey

Autoren: Giang Nguyen, Stefan Dlugolinsky, Martin Bobák, Viet Tran, Álvaro López García, Ignacio Heredia, Peter Malík, Ladislav Hluchý
Veröffentlicht in: Artificial Intelligence Review, 2019, ISSN 0269-2821
Herausgeber: Kluwer Academic Publishers
DOI: 10.1007/s10462-018-09679-z

Deep learning for weed identification based on seed images

Autoren: Francisco Pando, Ignacio Heredia, Carlos Aedo Pérez, Mauricio Velayos Rodríguez, Lara Lloret Iglesias, Joel Calvo
Veröffentlicht in: Biodiversity Information Science and Standards, Ausgabe 2, 2018, Seite(n) e25749, ISSN 2535-0897
Herausgeber: Pensoft
DOI: 10.3897/biss.2.25749

Convolutional Neural Networks for Phytoplankton identification and classification

Autoren: Lara Lloret, Ignacio Heredia, Fernando Aguilar, Elisabeth Debusschere, Klaas Deneudt, Francisco Hernandez
Veröffentlicht in: Biodiversity Information Science and Standards, Ausgabe 2, 2018, Seite(n) e25762, ISSN 2535-0897
Herausgeber: Pensoft
DOI: 10.3897/biss.2.25762

New Method for Constructing a Visibility Graph-Network in 3D Space and a New Hybrid System of Modeling

Autoren: Matej Babič, Ladislav Hluchy, Peter Krammer, Branko Matovič, Ravi Kumar, Pavel Kovač
Veröffentlicht in: Computing and Informatics, Ausgabe 36/5, 2017, Seite(n) 1107-1126, ISSN 1335-9150
Herausgeber: Slovak Academic Press Ltd.
DOI: 10.4149/cai_2017_5_1107

Estimation of high frequency nutrient concentrations from water quality surrogates using machine learning methods

Autoren: María Castrillo, Álvaro López García
Veröffentlicht in: Water Research, Ausgabe 172, 2020, Seite(n) 115490, ISSN 0043-1354
Herausgeber: Elsevier BV
DOI: 10.1016/j.watres.2020.115490

A workbench for species identification based on images and deep learning techniques

Autoren: Ignacio Heredia, Lara Lloret, Jesús Marco, Francisco Pando
Veröffentlicht in: Proceedings of TDWG, Ausgabe 1, 2017, Seite(n) e20569, ISSN 2535-0897
Herausgeber: Pensoft
DOI: 10.3897/tdwgproceedings.1.20569

A Cloud-Based Framework for Machine Learning Workloads and Applications

Autoren: Alvaro Lopez Garcia, Viet Tran, Andy S. Alic, Miguel Caballer, Isabel Campos Plasencia, Alessandro Costantini, Stefan Dlugolinsky, Doina Cristina Duma, Giacinto Donvito, Jorge Gomes, Ignacio Heredia Cacha, Jesus Marco De Lucas, Keiichi Ito, Valentin Y. Kozlov, Giang Nguyen, Pablo Orviz Fernandez, Zdenek Sustr, Pawel Wolniewicz, Marica Antonacci, Wolfgang Zu Castell, Mario David, Marcus Hardt, Lara
Veröffentlicht in: IEEE Access, Ausgabe 8, 2020, Seite(n) 18681-18692, ISSN 2169-3536
Herausgeber: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/ACCESS.2020.2964386

DEEPaaS API: a REST API for Machine Learning and Deep Learning models

Autoren: Álvaro López García
Veröffentlicht in: Journal of Open Source Software, Ausgabe 4/42, 2019, Seite(n) 1517, ISSN 2475-9066
Herausgeber: NumFocus
DOI: 10.21105/joss.01517

Conference proceedings (4)

DEEP-HybridDataCloud

Autoren: Donvito, Giacinto; Gomes, Jorge; Ferrer, A. Juan; Kozlov, Valentin; López García, Álvaro; Matyska, Ludek; Meyer, Norbert; Moltó, Germán; Tran, Viet; Castell, Wolfgang zu
Veröffentlicht in: ISC High Performance Computing, 2018
Herausgeber: ISC High Performance Computing

DEEP: Hybrid Approach for Deep Learning

Autoren: Alic, Andy S.; Antonacci, Marica; Caballer, Miguel; Campos, Isabel; Costantini, Alessandro; David, Mario; Dlugolinsky, Stefan; Donvito, Giacinto; Duma, Cristina; Gomes, Jorge; Hardt, Marcus; Heredia, Ignacio; Hluchy, Ladislav; Ito, Keiichi; Kozlov, Valentin; Lloret, Lara; López García, Alvaro; Marco, Jesus; Matyska, Ludek; Moltó, Germán; Nguyen, Giang; Orviz, Pablo; Plociennik, Marcin; Šustr,
Veröffentlicht in: 2019
Herausgeber: ISC

Remote Sensing Data Analytics with the Udocker Container Tool using Multi-GPU Deep Learning Systems

Autoren: Cavallaro, Gabriele; Kozlov, Valentin; Götz, Markus; Riedel, Morris
Veröffentlicht in: Proc. of the 2019 conference on Big Data from Space (BiDS’2019), EUR 29660 EN, ISBN 978-92-76-00034-1, doi:10.2760/848593<br/>Conference on Big Data from Space (BiDS'19), Munich, Germany, 2019-02-19 - 2019-02-21, Ausgabe 19, 2019, ISBN 978-92-76-00034-1
Herausgeber: Publications Office of the European Union
DOI: 10.2760/848593

Rootless Containers with Udocker

Autoren: Gomes, Jorge; David, Mário; Martins, João Paulo; Pina, João; Campos, Isabel; López Garcia, Alvaro; Orviz, Pablo; Kozlov, Valentin
Veröffentlicht in: ISC High Performance (2019), Ausgabe 7, 2019
Herausgeber: ISC

Book chapters (1)

Benchmarking Deep Learning Infrastructures by Means of TensorFlow and Containers

Autoren: Adrian Grupp, Valentin Kozlov, Isabel Campos, Mario David, Jorge Gomes, Álvaro López García
Veröffentlicht in: High Performance Computing - ISC High Performance 2019 International Workshops, Frankfurt, Germany, June 16-20, 2019, Revised Selected Papers, Ausgabe 11887, 2019, Seite(n) 478-489, ISBN 978-3-030-34355-2
Herausgeber: Springer International Publishing
DOI: 10.1007/978-3-030-34356-9_36