Immersive Experiences around TV, an integrated toolset for the production and distribution of immersive and interactive content across devices.

Informazioni relative al progetto

ImmersiaTV

ID dell’accordo di sovvenzione: 688619

DOI

10.3030/688619

Progetto chiuso

Data della firma CE 13 Novembre 2015

Data di avvio 1 Gennaio 2016

Data di completamento 30 Giugno 2018

Finanziato da

• INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT)

Costo totale

€ 3 821 105,94

Contributo UE

€ 2 861 600,00

Coordinato da

FUNDACIO PRIVADA I2CAT, INTERNET I INNOVACIO DIGITAL A CATALUNYA
Spain

CORDIS fornisce collegamenti ai risultati finali pubblici e alle pubblicazioni dei progetti ORIZZONTE.

I link ai risultati e alle pubblicazioni dei progetti del 7° PQ, così come i link ad alcuni tipi di risultati specifici come dataset e software, sono recuperati dinamicamente da .OpenAIRE .

Risultati finali

Other (7)

Coding and Decoding Modules

This deliverable will consist, in each iteration, of releasing the components needed to encode and decode omnidirectional video.

Transmission, reception and overall delivery strategies of omnidirectional live streams

This deliverable will consist, in each iteration, of releasing the components needed to distribute and deliver omnidirectional video over WAN OTT networks and LAN controlled networks.

Production Tools

This deliverable will consist, in each iteration, of releasing the production tools needed to produce content based on omnidirectional video.

Workflow integration & End-to-end tests

The outcome of the tests integrating the system will be explained in a report containing the result of the tests, current limitations, and suggestions for architecture and implementation improvements.

Content Creation

This deliverable is the dataset of produced content and raw audiovisual material

Capture Components

This deliverable will consist, in each iteration, of releasing the hardware components and release of software interfaces developed needed to capture omnidirectional video.

Interaction & Display

This deliverable will consist, in each iteration, of software solutions for each of the display devices in the living room (traditional TV, second screen, immersive display)

Documents, reports (11)

End-user Requirements

This document will detail the end-user requirements needed for an the content produced. Each iteration will extend the previous one with the additional insights gained, and the novel case scenario to be addressed

Documentation and technical fact sheets

This deliverable provides all the printable support documentation of ImmersiaTV.

Professional Requirements

This document will detail the professional requirements needed for both offline and live produced content, updated with the insight gained in the previous pilots

Pilot Execution Reports

This deliverable will consist in a report of the pilots executed as well as batch demonstrators that will be further used by WP5 and WP2 to define needs in terms of exploitation and technical refinement, respectively.

Technical Evaluation

This report will detail, iteratively, the technical aspects of the outcome of the pilots: what worked and what did not, what should be improved from a technical performance perspective.

Quality of Experience

This deliverable will consist of releasing the components needed to render and interact with content based on omnidirectional video.

Content Ideation, Production scenarios and requirement analysis

This document will describe the scenarios selected, ideas for the audiovisual language to be used for immersive content and across devices, both for offline and live content, and include the technical specification scenarios to be implemented

User Evaluation

This report will detail, iteratively, the perception of the experience by the end-users, as well as the perception of professional content producers using the production tools from performance and service management perspectives. Usability aspects will also be included in this report.

Execution & Evaluation Plan

This report will explain how we plan to execute and evaulate the pilots to be performed

Design Architecture

This deliverable, in each of its iteration will address the design and refinement of the overall architecture, taking into account the outcomes of task 2.3. It feeds the rest of the tasks in the work package

Market analysis report

This deliverable describes the market for audiovisual immersive products and provides a set of recommendations as input for the use cases and the exploitation and innovation transfer activities in T.5.2.

Pubblicazioni

Conference proceedings (24)

JPEG XS call for proposals subjective evaluations

Autori: Touradj Ebrahimi, David McNally, Tim Bruylants, Alexandre Willème, Peter Schelkens, Benoît M. Macq
Pubblicato in: Applications of Digital Image Processing XL, 2017, Pagina/e 24, ISBN 9781-510612501
Editore: SPIE
DOI: 10.1117/12.2275137

Subjective and objective evaluation of HDR video coding technologies

Autori: Philippe Hanhart, Martin Rerabek, Touradj Ebrahimi
Pubblicato in: 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX), 2016, Pagina/e 1-6, ISBN 978-1-5090-0354-9
Editore: IEEE
DOI: 10.1109/QoMEX.2016.7498943

Towards subjective quality assessment of point cloud imaging in augmented reality

Autori: Evangelos Alexiou, Evgeniy Upenik, Touradj Ebrahimi
Pubblicato in: 2017 IEEE 19th International Workshop on Multimedia Signal Processing (MMSP), 2017, Pagina/e 1-6, ISBN 978-1-5090-3649-3
Editore: IEEE
DOI: 10.1109/MMSP.2017.8122237

Impact of interactivity on the assessment of quality of experience for light field content

Autori: Irene Viola, Martin Rerabek, Touradj Ebrahimi
Pubblicato in: 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX), 2017, Pagina/e 1-6, ISBN 978-1-5386-4024-1
Editore: IEEE
DOI: 10.1109/QoMEX.2017.7965636

On the performance of objective metrics for omnidirectional visual content

Autori: Evgeniy Upenik, Martin Rerabek, Touradj Ebrahimi
Pubblicato in: 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX), 2017, Pagina/e 1-6, ISBN 978-1-5386-4024-1
Editore: IEEE
DOI: 10.1109/QoMEX.2017.7965660

A Just Noticeable Difference Subjective Test for High Dynamic Range Images

Autori: Ahar, Ayyoub; Mahmoudpour, Saeed; Van Wallendael, Glenn; Paridaens, Tom; Lambert, Peter; Schelkens, Peter
Pubblicato in: 10th International Conference on Quality of Multimedia Experience (QoMEX 2018), 2018
Editore: VUB
DOI: 10.5281/zenodo.1311671

Personalized and Immersive Presentation of Video, Audio and Subtitles in 360º Environments: An Opera Use Case

Autori: Isaac Fraile, David Gómez, Juan A. Núñez, Mario Montagud, Sergi Fernández
Pubblicato in: ACM TVX 2018, Seoul (South Korea), June 2018, 2018
Editore: ACM Press
DOI: 10.6084/m9.figshare.6527531.v1

ImmersiaTV: an end-to-end toolset to enable customizable and immersive multi-screen TV experiences

Autori: Juan A. Núñez, Mario Montagud, Isaac Fraile, David Gómez, Sergi Fernández
Pubblicato in: ACM TVX 2018, Seoul (South Korea), June 2018, 2018
Editore: ACM Press
DOI: 10.6084/m9.figshare.6526379.v1

Reduced-reference image quality assessment based on internal generative mechanism utilizing shearlets and Rényi entropy analysis

Autori: Saeed Mahmoudpour, Peter Schelkens
Pubblicato in: 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX), 2017, Pagina/e 1-5, ISBN 978-1-5386-4024-1
Editore: IEEE
DOI: 10.1109/QoMEX.2017.7965628

An end-to-end toolset for the creation and delivery of video-based multi-device content

Autori: Fraile, I., Nuñez, J.A, Malewski, Artigas, X., Fernandez, S., Llobera
Pubblicato in: 6th Iberoamerican Conference on Applications and Usability for Interactive TV (jAuti 2017), 2017, ISBN 978-972-789-521-2
Editore: UA Editora Universidade de Aveiro Serviços de Biblioteca, Informação Documental e Museologia 1ª edição – outubro 2017
DOI: 10.5281/zenodo.1402979

Developing a Multi-Device Immersive TV-Experience - User Expectations and Practices

Autori: Wendy Van den Broeck, Pau Pamplona, Sergi Fernandez Langa
Pubblicato in: Proceedings of the 2nd International Workshop on Multimedia Alternate Realities - AltMM '17, 2017, Pagina/e 25-30, ISBN 9781-450355070
Editore: ACM Press, AltMM '17 Proceedings of the 2nd International Workshop on Multimedia Alternate Realities
DOI: 10.1145/3132361.3132362

A Rendering Solution to Display Light Field in Virtual Reality

Autori: Evgeniy Upenik, Irene Viola and Touradj Ebrahimi
Pubblicato in: 26th European Signal Processing Conference (EUSIPCO), 2018
Editore: Accepted- Not published yet

Point cloud subjective evaluation methodology based on 2D rendering

Autori: Evangelos Alexiou, Marco Bernardo, Luis A. da Silva Cruz, Lovorka Gotal Dmitrovic,Carlos Duarte, Emil Dumic, Touradj Ebrahimi, Dragan Matkovic, Manuela Pereira, Antonio Pinheiro, Athanasios Skodras
Pubblicato in: 10th International Conference on Quality of Multimedia Experience (QoMEX 2018), 2018
Editore: Accepted- Not published yet

Point cloud quality assessment metric based on angular distance

Autori: Evangelos Alexiou, Touradj Ebrahimi
Pubblicato in: International Conference on Multimedia & Expo (ICME 2018), 2018
Editore: Accepted- Not published yet

Benchmarking of objective quality metrics for point cloud quality assessment

Autori: Evangelos Alexiou, Touradj Ebrahimi
Pubblicato in: 33rd Picture Coding Symposium (PCS 2018), 2018
Editore: Accepted- Not published yet

Impact of visualization strategy for subjective quality assessment of point clouds

Autori: Evangelos Alexiou, Touradj Ebrahimi
Pubblicato in: Hot3D - Multimedia & Expo Workshops (ICMEW) - 2018, 2018
Editore: Accepted- Not published yet

Towards an animated JPEG

Autori: Joël Theytaz, Lin Yuan, David McNally, Touradj Ebrahimi
Pubblicato in: Applications of Digital Image Processing XXXIX, 2016, Pagina/e 99711X
Editore: SPIE
DOI: 10.1117/12.2240283

A Testbed for Subjective Evaluation of Omnidirectional Visual Content

Autori: Upenik, Evgeniy; Rerabek, Martin; Ebrahimi, Touradj
Pubblicato in: 32nd Picture Coding Symposium (PCS 2016), Numero 2, 2016
Editore: IEEE
DOI: 10.5281/zenodo.209531

A new approach to subjectively assess quality of plenoptic content

Autori: Viola, Irene; Rerabek, Martin; Ebrahimi, Touradj
Pubblicato in: SPIE Optics + Photonics, San Diego, California, USA - 2016, Numero 2, 2016
Editore: SPIE
DOI: 10.1117/12.2240279

New Light Field Image Dataset

Autori: Rerabek, Martin; Ebrahimi, Touradj
Pubblicato in: 8th International Conference on Quality of Multimedia Experience (QoMEX 2016), Numero 3, 2016
Editore: IEEE
DOI: 10.5281/zenodo.209499

JPEG backward compatible coding of omnidirectional images

Autori: Martin Řeřábek, Evgeniy Upenik, Touradj Ebrahimi
Pubblicato in: Applications of Digital Image Processing XXXIX, 2016, Pagina/e 99711O
Editore: SPIE
DOI: 10.1117/12.2240281

A new content format for immersive experiences

Autori: Llobera,Joan
Pubblicato in: Hot3D 2016, Numero 1, 2016
Editore: IEEE International Workshop
DOI: 10.5281/zenodo.202410

Objective and subjective evaluation of light field image compression algorithms

Autori: Viola, Irene; Rerabek, Martin; Bruylants, Tim; Schelkens, Peter; Pereira, Fernando; Ebrahimi, Touradj
Pubblicato in: 32nd Picture Coding Symposium (PCS 2016), Numero 1, 2016
Editore: IEEE
DOI: 10.5281/zenodo.209467

A Simple Method to Obtain Visual Attention Data in Head Mounted Virtual Reality

Autori: Upenik, Evgeniy; Ebrahimi, Touradj
Pubblicato in: 2017 IEEE International Conference on Multimedia & Expo (ICME), Numero 1, 2017
Editore: ICME
DOI: 10.5281/zenodo.556328

Peer reviewed articles (2)

Comparison and Evaluation of Light Field Image Coding Approaches

Autori: Irene Viola, Martin Rerabek, Touradj Ebrahimi
Pubblicato in: IEEE Journal of Selected Topics in Signal Processing, Numero 11/7, 2017, Pagina/e 1092-1106, ISSN 1932-4553
Editore: Institute of Electrical and Electronics Engineers
DOI: 10.1109/JSTSP.2017.2740167

ICtCp Versus Y'CbCr: Evaluation of ICtCp Color Space and an Adaptive Reshaper for HDR and WCG

Autori: Anne-Flore Perrin, Martin Rerabek, Walt Husak, Touradj Ebrahimi
Pubblicato in: IEEE Consumer Electronics Magazine, Numero 7/3, 2018, Pagina/e 38-47, ISSN 2162-2256
Editore: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/MCE.2017.2714696

Other (5)

“ImmersiaTV: Enabling Customizable and Immersive Multi-Screen TV Experiences”

Autori: D. Gómez, J.A. Núñez, M. Montagud, S. Fernández
Pubblicato in: 2018
Editore: Zenodo
DOI: 10.5281/zenodo.1480550

TiCMP: A lightweight and efficient Tiled Cubemap projection strategy for Immersive Videos in Web-based player

Autori: D. Gómez, J. A. Núñez, I. Fraile, M. Montagud, S. Fernández
Pubblicato in: 2018
Editore: Zenodo preprint
DOI: 10.5281/zenodo.1481596

Production and delivery of video for multi-device synchronized playout

Autori: Nuñez, J.A,, Malewski, S. Fernández, S., Llobera, J.
Pubblicato in: 2018
Editore: Zenodo preprint
DOI: 10.5281/zenodo.1481607

Multi-device content based on video. A practical toolset for creation and delivery

Autori: Joan Llobera, Isaac Fraile, Juan A. Núñez, Szymon Malewski, Xavier Artigas, Sergi Fernandez
Pubblicato in: 2018, Pagina/e 93-104
Editore: Springer International Publishing
DOI: 10.1007/978-3-319-90170-1_7

Creating and broadcasting video-based multi-platform experiences

Autori: Llobera, Joan; Nuñez, Juan; Fernández, Sergi
Pubblicato in: MMTC Communications - Frontiers 12 6, Numero 1, 2017
Editore: IEEE MMTC
DOI: 10.5281/zenodo.556959