Immersive Experiences around TV, an integrated toolset for the production and distribution of immersive and interactive content across devices.

Informations projet

ImmersiaTV

N° de convention de subvention: 688619

DOI

10.3030/688619

Projet clôturé

Date de signature de la CE 13 Novembre 2015

Date de début 1 Janvier 2016

Date de fin 30 Juin 2018

Financé au titre de

• INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT)

Coût total

€ 3 821 105,94

Contribution de l’UE

€ 2 861 600,00

Coordonné par

FUNDACIO PRIVADA I2CAT, INTERNET I INNOVACIO DIGITAL A CATALUNYA
Spain

CORDIS fournit des liens vers les livrables publics et les publications des projets HORIZON.

Les liens vers les livrables et les publications des projets du 7e PC, ainsi que les liens vers certains types de résultats spécifiques tels que les jeux de données et les logiciels, sont récupérés dynamiquement sur OpenAIRE .

Livrables

Other (7)

Coding and Decoding Modules

This deliverable will consist, in each iteration, of releasing the components needed to encode and decode omnidirectional video.

Transmission, reception and overall delivery strategies of omnidirectional live streams

This deliverable will consist, in each iteration, of releasing the components needed to distribute and deliver omnidirectional video over WAN OTT networks and LAN controlled networks.

Production Tools

This deliverable will consist, in each iteration, of releasing the production tools needed to produce content based on omnidirectional video.

Workflow integration & End-to-end tests

The outcome of the tests integrating the system will be explained in a report containing the result of the tests, current limitations, and suggestions for architecture and implementation improvements.

Content Creation

This deliverable is the dataset of produced content and raw audiovisual material

Capture Components

This deliverable will consist, in each iteration, of releasing the hardware components and release of software interfaces developed needed to capture omnidirectional video.

Interaction & Display

This deliverable will consist, in each iteration, of software solutions for each of the display devices in the living room (traditional TV, second screen, immersive display)

Documents, reports (11)

End-user Requirements

This document will detail the end-user requirements needed for an the content produced. Each iteration will extend the previous one with the additional insights gained, and the novel case scenario to be addressed

Documentation and technical fact sheets

This deliverable provides all the printable support documentation of ImmersiaTV.

Professional Requirements

This document will detail the professional requirements needed for both offline and live produced content, updated with the insight gained in the previous pilots

Pilot Execution Reports

This deliverable will consist in a report of the pilots executed as well as batch demonstrators that will be further used by WP5 and WP2 to define needs in terms of exploitation and technical refinement, respectively.

Technical Evaluation

This report will detail, iteratively, the technical aspects of the outcome of the pilots: what worked and what did not, what should be improved from a technical performance perspective.

Quality of Experience

This deliverable will consist of releasing the components needed to render and interact with content based on omnidirectional video.

Content Ideation, Production scenarios and requirement analysis

This document will describe the scenarios selected, ideas for the audiovisual language to be used for immersive content and across devices, both for offline and live content, and include the technical specification scenarios to be implemented

User Evaluation

This report will detail, iteratively, the perception of the experience by the end-users, as well as the perception of professional content producers using the production tools from performance and service management perspectives. Usability aspects will also be included in this report.

Execution & Evaluation Plan

This report will explain how we plan to execute and evaulate the pilots to be performed

Design Architecture

This deliverable, in each of its iteration will address the design and refinement of the overall architecture, taking into account the outcomes of task 2.3. It feeds the rest of the tasks in the work package

Market analysis report

This deliverable describes the market for audiovisual immersive products and provides a set of recommendations as input for the use cases and the exploitation and innovation transfer activities in T.5.2.

Publications

Conference proceedings (24)

JPEG XS call for proposals subjective evaluations

Auteurs: Touradj Ebrahimi, David McNally, Tim Bruylants, Alexandre Willème, Peter Schelkens, Benoît M. Macq
Publié dans: Applications of Digital Image Processing XL, 2017, Page(s) 24, ISBN 9781-510612501
Éditeur: SPIE
DOI: 10.1117/12.2275137

Subjective and objective evaluation of HDR video coding technologies

Auteurs: Philippe Hanhart, Martin Rerabek, Touradj Ebrahimi
Publié dans: 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX), 2016, Page(s) 1-6, ISBN 978-1-5090-0354-9
Éditeur: IEEE
DOI: 10.1109/QoMEX.2016.7498943

Towards subjective quality assessment of point cloud imaging in augmented reality

Auteurs: Evangelos Alexiou, Evgeniy Upenik, Touradj Ebrahimi
Publié dans: 2017 IEEE 19th International Workshop on Multimedia Signal Processing (MMSP), 2017, Page(s) 1-6, ISBN 978-1-5090-3649-3
Éditeur: IEEE
DOI: 10.1109/MMSP.2017.8122237

Impact of interactivity on the assessment of quality of experience for light field content

Auteurs: Irene Viola, Martin Rerabek, Touradj Ebrahimi
Publié dans: 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX), 2017, Page(s) 1-6, ISBN 978-1-5386-4024-1
Éditeur: IEEE
DOI: 10.1109/QoMEX.2017.7965636

On the performance of objective metrics for omnidirectional visual content

Auteurs: Evgeniy Upenik, Martin Rerabek, Touradj Ebrahimi
Publié dans: 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX), 2017, Page(s) 1-6, ISBN 978-1-5386-4024-1
Éditeur: IEEE
DOI: 10.1109/QoMEX.2017.7965660

A Just Noticeable Difference Subjective Test for High Dynamic Range Images

Auteurs: Ahar, Ayyoub; Mahmoudpour, Saeed; Van Wallendael, Glenn; Paridaens, Tom; Lambert, Peter; Schelkens, Peter
Publié dans: 10th International Conference on Quality of Multimedia Experience (QoMEX 2018), 2018
Éditeur: VUB
DOI: 10.5281/zenodo.1311671

Personalized and Immersive Presentation of Video, Audio and Subtitles in 360º Environments: An Opera Use Case

Auteurs: Isaac Fraile, David Gómez, Juan A. Núñez, Mario Montagud, Sergi Fernández
Publié dans: ACM TVX 2018, Seoul (South Korea), June 2018, 2018
Éditeur: ACM Press
DOI: 10.6084/m9.figshare.6527531.v1

ImmersiaTV: an end-to-end toolset to enable customizable and immersive multi-screen TV experiences

Auteurs: Juan A. Núñez, Mario Montagud, Isaac Fraile, David Gómez, Sergi Fernández
Publié dans: ACM TVX 2018, Seoul (South Korea), June 2018, 2018
Éditeur: ACM Press
DOI: 10.6084/m9.figshare.6526379.v1

Reduced-reference image quality assessment based on internal generative mechanism utilizing shearlets and Rényi entropy analysis

Auteurs: Saeed Mahmoudpour, Peter Schelkens
Publié dans: 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX), 2017, Page(s) 1-5, ISBN 978-1-5386-4024-1
Éditeur: IEEE
DOI: 10.1109/QoMEX.2017.7965628

An end-to-end toolset for the creation and delivery of video-based multi-device content

Auteurs: Fraile, I., Nuñez, J.A, Malewski, Artigas, X., Fernandez, S., Llobera
Publié dans: 6th Iberoamerican Conference on Applications and Usability for Interactive TV (jAuti 2017), 2017, ISBN 978-972-789-521-2
Éditeur: UA Editora Universidade de Aveiro Serviços de Biblioteca, Informação Documental e Museologia 1ª edição – outubro 2017
DOI: 10.5281/zenodo.1402979

Developing a Multi-Device Immersive TV-Experience - User Expectations and Practices

Auteurs: Wendy Van den Broeck, Pau Pamplona, Sergi Fernandez Langa
Publié dans: Proceedings of the 2nd International Workshop on Multimedia Alternate Realities - AltMM '17, 2017, Page(s) 25-30, ISBN 9781-450355070
Éditeur: ACM Press, AltMM '17 Proceedings of the 2nd International Workshop on Multimedia Alternate Realities
DOI: 10.1145/3132361.3132362

A Rendering Solution to Display Light Field in Virtual Reality

Auteurs: Evgeniy Upenik, Irene Viola and Touradj Ebrahimi
Publié dans: 26th European Signal Processing Conference (EUSIPCO), 2018
Éditeur: Accepted- Not published yet

Point cloud subjective evaluation methodology based on 2D rendering

Auteurs: Evangelos Alexiou, Marco Bernardo, Luis A. da Silva Cruz, Lovorka Gotal Dmitrovic,Carlos Duarte, Emil Dumic, Touradj Ebrahimi, Dragan Matkovic, Manuela Pereira, Antonio Pinheiro, Athanasios Skodras
Publié dans: 10th International Conference on Quality of Multimedia Experience (QoMEX 2018), 2018
Éditeur: Accepted- Not published yet

Point cloud quality assessment metric based on angular distance

Auteurs: Evangelos Alexiou, Touradj Ebrahimi
Publié dans: International Conference on Multimedia & Expo (ICME 2018), 2018
Éditeur: Accepted- Not published yet

Benchmarking of objective quality metrics for point cloud quality assessment

Auteurs: Evangelos Alexiou, Touradj Ebrahimi
Publié dans: 33rd Picture Coding Symposium (PCS 2018), 2018
Éditeur: Accepted- Not published yet

Impact of visualization strategy for subjective quality assessment of point clouds

Auteurs: Evangelos Alexiou, Touradj Ebrahimi
Publié dans: Hot3D - Multimedia & Expo Workshops (ICMEW) - 2018, 2018
Éditeur: Accepted- Not published yet

Towards an animated JPEG

Auteurs: Joël Theytaz, Lin Yuan, David McNally, Touradj Ebrahimi
Publié dans: Applications of Digital Image Processing XXXIX, 2016, Page(s) 99711X
Éditeur: SPIE
DOI: 10.1117/12.2240283

A Testbed for Subjective Evaluation of Omnidirectional Visual Content

Auteurs: Upenik, Evgeniy; Rerabek, Martin; Ebrahimi, Touradj
Publié dans: 32nd Picture Coding Symposium (PCS 2016), Numéro 2, 2016
Éditeur: IEEE
DOI: 10.5281/zenodo.209531

A new approach to subjectively assess quality of plenoptic content

Auteurs: Viola, Irene; Rerabek, Martin; Ebrahimi, Touradj
Publié dans: SPIE Optics + Photonics, San Diego, California, USA - 2016, Numéro 2, 2016
Éditeur: SPIE
DOI: 10.1117/12.2240279

New Light Field Image Dataset

Auteurs: Rerabek, Martin; Ebrahimi, Touradj
Publié dans: 8th International Conference on Quality of Multimedia Experience (QoMEX 2016), Numéro 3, 2016
Éditeur: IEEE
DOI: 10.5281/zenodo.209499

JPEG backward compatible coding of omnidirectional images

Auteurs: Martin Řeřábek, Evgeniy Upenik, Touradj Ebrahimi
Publié dans: Applications of Digital Image Processing XXXIX, 2016, Page(s) 99711O
Éditeur: SPIE
DOI: 10.1117/12.2240281

A new content format for immersive experiences

Auteurs: Llobera,Joan
Publié dans: Hot3D 2016, Numéro 1, 2016
Éditeur: IEEE International Workshop
DOI: 10.5281/zenodo.202410

Objective and subjective evaluation of light field image compression algorithms

Auteurs: Viola, Irene; Rerabek, Martin; Bruylants, Tim; Schelkens, Peter; Pereira, Fernando; Ebrahimi, Touradj
Publié dans: 32nd Picture Coding Symposium (PCS 2016), Numéro 1, 2016
Éditeur: IEEE
DOI: 10.5281/zenodo.209467

A Simple Method to Obtain Visual Attention Data in Head Mounted Virtual Reality

Auteurs: Upenik, Evgeniy; Ebrahimi, Touradj
Publié dans: 2017 IEEE International Conference on Multimedia & Expo (ICME), Numéro 1, 2017
Éditeur: ICME
DOI: 10.5281/zenodo.556328

Peer reviewed articles (2)

Comparison and Evaluation of Light Field Image Coding Approaches

Auteurs: Irene Viola, Martin Rerabek, Touradj Ebrahimi
Publié dans: IEEE Journal of Selected Topics in Signal Processing, Numéro 11/7, 2017, Page(s) 1092-1106, ISSN 1932-4553
Éditeur: Institute of Electrical and Electronics Engineers
DOI: 10.1109/JSTSP.2017.2740167

ICtCp Versus Y'CbCr: Evaluation of ICtCp Color Space and an Adaptive Reshaper for HDR and WCG

Auteurs: Anne-Flore Perrin, Martin Rerabek, Walt Husak, Touradj Ebrahimi
Publié dans: IEEE Consumer Electronics Magazine, Numéro 7/3, 2018, Page(s) 38-47, ISSN 2162-2256
Éditeur: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/MCE.2017.2714696

Other (5)

“ImmersiaTV: Enabling Customizable and Immersive Multi-Screen TV Experiences”

Auteurs: D. Gómez, J.A. Núñez, M. Montagud, S. Fernández
Publié dans: 2018
Éditeur: Zenodo
DOI: 10.5281/zenodo.1480550

TiCMP: A lightweight and efficient Tiled Cubemap projection strategy for Immersive Videos in Web-based player

Auteurs: D. Gómez, J. A. Núñez, I. Fraile, M. Montagud, S. Fernández
Publié dans: 2018
Éditeur: Zenodo preprint
DOI: 10.5281/zenodo.1481596

Production and delivery of video for multi-device synchronized playout

Auteurs: Nuñez, J.A,, Malewski, S. Fernández, S., Llobera, J.
Publié dans: 2018
Éditeur: Zenodo preprint
DOI: 10.5281/zenodo.1481607

Multi-device content based on video. A practical toolset for creation and delivery

Auteurs: Joan Llobera, Isaac Fraile, Juan A. Núñez, Szymon Malewski, Xavier Artigas, Sergi Fernandez
Publié dans: 2018, Page(s) 93-104
Éditeur: Springer International Publishing
DOI: 10.1007/978-3-319-90170-1_7

Creating and broadcasting video-based multi-platform experiences

Auteurs: Llobera, Joan; Nuñez, Juan; Fernández, Sergi
Publié dans: MMTC Communications - Frontiers 12 6, Numéro 1, 2017
Éditeur: IEEE MMTC
DOI: 10.5281/zenodo.556959