Hyperrealistic Imaging Experience

Informations projet

RealVision

N° de convention de subvention: 765911

DOI

10.3030/765911

Projet clôturé

Date de signature de la CE 10 Août 2017

Date de début 1 Janvier 2018

Date de fin 30 Juin 2022

Financé au titre de

• EXCELLENT SCIENCE - Marie Skłodowska-Curie Actions

Coût total

€ 4 076 702,28

Contribution de l’UE

€ 4 076 702,28

Coordonné par

DANMARKS TEKNISKE UNIVERSITET
Denmark

CORDIS fournit des liens vers les livrables publics et les publications des projets HORIZON.

Les liens vers les livrables et les publications des projets du 7e PC, ainsi que les liens vers certains types de résultats spécifiques tels que les jeux de données et les logiciels, sont récupérés dynamiquement sur OpenAIRE .

Livrables

Other (2)

Supervisory Board

Supervisory Board of the Network established as specified in Annex 1.

Light field capture for test images in coding and processing

Demonstrators, pilots, prototypes (3)

Organization, plan and attendance of an Industrial Forum

Organization plan and attendance of an Industrial Forum

Perceptual coding of light field data with flexible access for applications
New view extraction demonstrator

Documents, reports (11)

Metric for comparing surface appearance of fabricated objects
A model explaining maximum tolerable latency of interactive displays
Rules for the contribution of focus cues to realistic appearance of scenes
Report on the influence of perceptual cues to realism
Models of differences in color perception with narrow-band light

Models of differences in color perception with narrowband light

Naturalness of hyper-realistic video

Naturalness of hyperrealistic video

Method for objective measurement of hyper-realistic image quality of light fields

Method for objective measurement of hyperrealistic image quality of light fields

A low-level vision metric for comparing displayed hyper-realistic images

A lowlevel vision metric for comparing displayed hyperrealistic images

Report on individual variations in the perception of hyper-realistic images

Report on individual variations in the perception of hyperrealistic images

Method for the subjective assessment of immersive audio-visual contents

Method for the subjective assessment of immersive audiovisual contents

Courses

Websites, patent fillings, videos etc. (4)

Project communication tools established, website online etc
Communicate with standardization bodies about contributing content
Public dissemination of project results, incl. JPEG and MPEG bodies

Public dissemination of project results, incl. JPEG and MPEG bodies. The activity is carried out throughout the project. First larger effort is at M9.

Generate test content suitable for HDR and U-HDTV processing

Publications

Peer reviewed articles (13)

Method for Subjective Assessment of Immersion in Audiovisual Experiences

Auteurs: Sarvesh Agrawal, Søren Bech, Klaus Bærentsen, Katrien De Moor, and Søren Forchhammer
Publié dans: Journal of the Audio Engineering Society, Numéro 69 (9), 2021, Page(s) 656-671, ISSN 1549-4950
Éditeur: Audio Engineering Society
DOI: 10.17743/jaes.2021.0013

Defining Immersion: Literature Review and Implications for Research on Audiovisual Experiences

Auteurs: Sarvesh Agrawal, Adèle Simon, Søren Bech, Klaus Bærentsen, Søren Forchhammer
Publié dans: Journal of the Audio Engineering Society, Numéro 68/6, 2020, Page(s) 404-417, ISSN 1549-4950
Éditeur: Audio Engineering Society
DOI: 10.17743/jaes.2020.0039

Perceptual model for adaptive local shading and refresh rate

Auteurs: Akshay Jindal , Krzysztof Wolski , Karol Myszkowski , Rafał K. Mantiuk
Publié dans: ACM Transactions on Graphics, Numéro Volume 40, Numéro 6, December 2021, Article No.: 281, 2021, Page(s) pp 1–18, ISSN 0730-0301
Éditeur: Association for Computing Machinary, Inc.
DOI: 10.1145/3478513.3480514

Epipolar Plane Image-Based Lossless and Near-Lossless Light Field Compression

Auteurs: M. Umair Mukati, Soren Forchhammer
Publié dans: IEEE Access, Numéro 9, 2021, Page(s) 1124-1136, ISSN 2169-3536
Éditeur: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2020.3047073

Improved Deep Distributed Light Field Coding

Auteurs: M. Umair Mukati, Milan Stepanov, Giuseppe Valenzise, Soren Forchhammer, Frederic Dufaux
Publié dans: IEEE Open Journal of Circuits and Systems, Numéro 2, 2021, Page(s) 325-337, ISSN 2644-1225
Éditeur: IEEE
DOI: 10.1109/ojcas.2021.3073252

Dataset and Metrics for Predicting Local Visible Differences

Auteurs: Krzysztof Wolski, Daniele Giunchi, Nanyang Ye, Piotr Didyk, Karol Myszkowski, Radosław Mantiuk, Hans-Peter Seidel, Anthony Steed, Rafał K. Mantiuk
Publié dans: ACM Transactions on Graphics, Numéro 37/5, 2018, Page(s) 1-14, ISSN 0730-0301
Éditeur: Association for Computing Machinary, Inc.
DOI: 10.1145/3196493

Selecting texture resolution using a task‐specific visibility metric

Auteurs: K. Wolski, D. Giunchi, S. Kinuwaki, P. Didyk, K. Myszkowski, A. Steed, R. K. Mantiuk
Publié dans: Computer Graphics Forum, Numéro 38/7, 2019, Page(s) 685-696, ISSN 0167-7055
Éditeur: Blackwell Publishing Inc.
DOI: 10.1111/cgf.13871

DiCE

Auteurs: Fangcheng Zhong, George Alex Koulieris, George Drettakis, Martin S. Banks, Mathieu Chambe, Frédo Durand, Rafał K. Mantiuk
Publié dans: ACM Transactions on Graphics (TOG), Numéro 38/6, 2019, Page(s) 1-13, ISSN 0730-0301
Éditeur: Association for Computing Machinary, Inc.
DOI: 10.1145/3355089.3356552

Demonstrating a multi-primary high dynamic range display system for vision experiments

Auteurs: Allie C. Hexley, Ali Özgür Yöntem, Manuel Spitschan, Hannah E. Smithson, Rafal Mantiuk
Publié dans: Journal of the Optical Society of America A, Numéro 37/4, 2020, Page(s) A271, ISSN 1084-7529
Éditeur: Optical Society of America
DOI: 10.1364/josaa.384022

Attention Mechanism-Based Light-Field View Synthesis

Auteurs: M. Shahzeb Khan Gul, M. Umair Mukati, Michel Baetz, Soren Forchammer, Joachim Keinert
Publié dans: IEEE Acess, 2022, ISSN 2169-3536
Éditeur: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2022.3142949

Reproducing reality with a high-dynamic-range multi-focal stereo display

Auteurs: Fangcheng Zhong , Akshay Jindal , Ali Özgür Yöntem , Param Hanji , Simon J. Watt , Rafał K. Mantiuk
Publié dans: ACM Transactions on Graphics, Numéro Volume 40, Numéro 6, December 2021, Article No.: 241, 2021, Page(s) pp 1–14, ISSN 0730-0301
Éditeur: Association for Computing Machinary, Inc.
DOI: 10.1145/3478513.3480513

Influence of Changes in Audio Spatialization on Immersion in Audiovisual Experiences

Auteurs: Sarvesh Agrawal, Søren Bech, Katrien de Moor, Søren Forchhammer
Publié dans: Journal of Audio Engineering Society, Numéro 70 (10), 2022, Page(s) 810-823, ISSN 1549-4950
Éditeur: Audio Engineering Society
DOI: 10.17743/jaes.2022.0034

A perceptual model of motion quality for rendering with adaptive refresh-rate and resolution

Auteurs: Gyorgy Denes, Akshay Jindal, Aliaksei Mikhailiuk, Rafał K. Mantiuk
Publié dans: ACM Transactions on Graphics, Numéro 39/4, 2020, Page(s) 1, ISSN 0730-0301
Éditeur: Association for Computing Machinary, Inc.
DOI: 10.1145/3386569.3392411

Conference proceedings (29)

Hybrid Learning-Based And Hevc-Based Coding Of Light Fields

Auteurs: Milan Stepanov, Giuseppe Valenzise, Frederic Dufaux
Publié dans: 2020 IEEE International Conference on Image Processing (ICIP), 2020, Page(s) 3344-3348, ISBN 978-1-7281-6395-6
Éditeur: IEEE
DOI: 10.1109/icip40778.2020.9190971

Evaluation of the Bubble view Metaphor for the Crowdsourcing Study of Visual Attention Deployment in Tone-Mapped Images

Auteurs: W. Ellahi, T. Vigier and P. Le Callet
Publié dans: 2021 9th European Workshop on Visual Information Processing (EUVIP), 2021
Éditeur: EUVIP
DOI: 10.1109/euvip50544.2021.9483985

The Effect of Temporal Sub-sampling on the Accuracy of Volumetric Video Quality Assessment

Auteurs: Ali Ak, Emin Zerman, Suiyi Ling, Patrick Le Callet, Aljosa Smolic
Publié dans: 2021
Éditeur: IEEE PCS 2021, Picture Coding Symposium
DOI: 10.1109/pcs50896.2021.9477449

Can Visual Scanpath Reveal Personal Image Memorability? Investigation of HMM Tools for Gaze Patterns Analysis

Auteurs: W. Ellahi, T. Vigier and P. Le Callet
Publié dans: 2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX), 2020
Éditeur: QoMEX
DOI: 10.1109/qomex48832.2020.9123102

On Spammer Detection in Crowdsourcing Pairwise Comparison Tasks: Case Study on Two Multimedia QoE Assessment Scenarios

Auteurs: Ali Ak, Mona Abid, Matthieu Perreira da Silva, Patrick Le Callet
Publié dans: 2021
Éditeur: IEEE ICME 2021, First International Workshop on Quality of Experience in Interactive Multimedia
DOI: 10.1109/icmew53276.2021.9455992

A machine-learning approach to illuminant estimation using statistical regularities in photoreceptor signals from real-world surfaces

Auteurs: Allie C. Hexley, Takuma Morimoto, Keiji Uchikawa, Hannah E. Smithson
Publié dans: ECVP 43rd European Conference on Visual Perception (ECVP) 2021 Online, 2022
Éditeur: Perception
DOI: 10.1177/03010066211059887

Active sampling for pairwise comparisons via approximate message passing and information gain maximization

Auteurs: Aliaksei Mikhailiuk, Clifford Wilmot, Maria Perez-Ortiz, Dingcheng Yue, Rafał K. Mantiuk
Publié dans: International Conference on Patter Recognition (ICPR), 2020
Éditeur: IEEE
DOI: 10.48550/arxiv.2004.05691

A Simulation System for Scene Synthesis in Virtual Reality

Auteurs: Jingyu Liu, Claire Mantel, Florian Schweiger, Søren Forchhammer
Publié dans: International Conference on Virtual Reality and Mixed Reality, Numéro 18, 2021, Page(s) 67-84, ISBN 978-3-030-90738-9
Éditeur: Springer
DOI: 10.1007/978-3-030-90739-6_5

A Comprehensive Analysis of Crowdsourcing for Subjective Evaluation of Tone Mapping Operators

Auteurs: Ali Ak, Abhishek Goswami, Wolf Hauser, Patrick Le Callet, Frédéric Dufaux
Publié dans: Image Quality and System Performance, IS&T International Symposium on Electronic Imaging (EI 2021), 2020
Éditeur: SPIE
DOI: 10.2352/issn.2470-1173.2021.9.iqsp-262

A machine-learning framework to predict TMO preference based on image and visual attention features

Auteurs: W. Ellahi, T. Vigier and P. L. Callet
Publié dans: 2021 IEEE 23rd International Workshop on Multimedia Signal Processing (MMSP), 2021
Éditeur: MMSP
DOI: 10.1109/mmsp53017.2021.9733461

Predicting Visible Image Differences Under Varying Display Brightness and Viewing Distance

Auteurs: Nanyang Ye, Krzysztof Wolski, Rafal K. Mantiuk
Publié dans: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019, Page(s) 5429-5437, ISBN 978-1-7281-3293-8
Éditeur: IEEE
DOI: 10.1109/cvpr.2019.00558

147th Audio Engineering Society Convention

Auteurs: Sarvesh Agrawal, Adèle Simon, Søren Bech, Klau Bærentsen, Søren Forchhammer
Publié dans: 2019, ISBN 978-1-942220-31-2
Éditeur: Audio Engineering Society
DOI: 10.17743/aesconv.2019.978-1-942220-31-2

Pixel-Wise Confidences for Stereo Disparities Using Recurrent Neural Networks

Auteurs: Muhammad Shahzeb Khan gul, Michel Bätz, Joachim Keinert
Publié dans: British Machine Vision Conference, Numéro 2019, 2019, Page(s) 1-13
Éditeur: British Machine Vision Association
DOI: 10.24406/iis-n-581312

Investigating Epipolar Plane Image Representations for Objective Quality Evaluation of Light Field Images

Auteurs: Ali Ak, Patrick Le-Callet
Publié dans: 2019 8th European Workshop on Visual Information Processing (EUVIP), 2019, Page(s) 135-139, ISBN 978-1-7281-4496-2
Éditeur: IEEE
DOI: 10.1109/EUVIP47703.2019.8946194

Towards Perceptually Plausible Training of Image Restoration Neural Networks

Auteurs: Ali Ak, Patrick Le-Callet
Publié dans: 2019 Ninth International Conference on Image Processing Theory, Tools and Applications (IPTA), 2019, Page(s) 1-5, ISBN 978-1-7281-3975-3
Éditeur: IEEE
DOI: 10.1109/IPTA.2019.8936096

A Benchmark of Light Field View Interpolation Methods

Auteurs: Dingcheng Yue, Muhammad Shahzeb Khan Gul, Michel Batz, Joachim Keinert, Rafal Mantiuk
Publié dans: 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), 2020, Page(s) 1-6, ISBN 978-1-7281-1485-9
Éditeur: IEEE
DOI: 10.1109/icmew46912.2020.9106041

A High-Resolution High Dynamic Range Light-Field Dataset with an Application to View Synthesis and Tone-Mapping

Auteurs: M. Shahzeb Khan Gul, Thorsten Wolf, Michel Batz, Matthias Ziegler, Joachim Keinert
Publié dans: 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), 2020, Page(s) 1-6, ISBN 978-1-7281-1485-9
Éditeur: IEEE
DOI: 10.1109/icmew46912.2020.9105964

Towards a Perceived Audiovisual Quality Model for Immersive Content

Auteurs: Randy Frans Fela, Nick Zacharov, Soren Forchhammer
Publié dans: 2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX), 2020, Page(s) 1-6, ISBN 978-1-7281-5965-2
Éditeur: IEEE
DOI: 10.1109/qomex48832.2020.9123134

View Synthesis-based Distributed Light Field Compression

Auteurs: M. Umair Mukati, Milan Stepanov, Giuseppe Valenzise, Frederic Dufaux, Soren Forchhammer
Publié dans: 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), Numéro 2020, 2020, Page(s) 1-6, ISBN 978-1-7281-1485-9
Éditeur: IEEE
DOI: 10.1109/icmew46912.2020.9105980

EPIC: Context Adaptive Lossless Light Field Compression using Epipolar Plane Images

Auteurs: Muhammad Umair Mukati, Soren Forchhammer
Publié dans: 2020 Data Compression Conference (DCC), Numéro 2020, 2020, Page(s) 43-52, ISBN 978-1-7281-6457-1
Éditeur: IEEE
DOI: 10.1109/dcc47342.2020.00012

RNNSC: Recurrent Neural Network-Based Stereo Compression Using Image and State Warping

Auteurs: M. Shahzeb Khan Gul, Hamid Suleman, Michel Bätz, and Joachim Keinert
Publié dans: Data Compression Conference (DCC), 2022, Page(s) 455, ISBN 978-1-6654-7893-9
Éditeur: IEEE
DOI: 10.1109/dcc52660.2022.00066

No-Reference Quality Evaluation of Light Field Content Based on Structural Representation of The Epipolar Plane Image

Auteurs: Ali Ak, Suiyi Ling, Patrick Le Callet
Publié dans: 2020
Éditeur: IEEE The 1st ICME Workshop on Hyper-Realistic Multimedia for Enhanced Quality of Experience
DOI: 10.1109/icmew46912.2020.9105975

HMM-Based Framework to Measure the Visual Fidelity of Tone Mapping Operators

Auteurs: W. Ellahi, T. Vigier and P. Le Callet
Publié dans: 2020
Éditeur: 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)
DOI: 10.1109/icmew46912.2020.9106029

Characterizing fixational eye movements as a candidate biomarker of neurodegenerative disorders

Auteurs: Allie C. Hexley, Anna K. Hauperich, Laura K. Young, Tom McLeish, Hannah E. Smithson
Publié dans: 2021
Éditeur: Opthalmic and Physiological Optics
DOI: 10.1111/opo.12900

Light-Field View Synthesis Using A Convolutional Block Attention Module

Auteurs: M. Shahzeb Khan Gul, M. Umair Mukati, Michel Batz, Soren Forchhammer, Joachim Keinert
Publié dans: 2021 IEEE International Conference on Image Processing (ICIP), 2021, Page(s) 3398-3402, ISBN 978-1-6654-4115-5
Éditeur: IEEE
DOI: 10.1109/icip42928.2021.9506586

Reliability of Crowdsourcing for Subjective Quality Evaluation of Tone Mapping Operators

Auteurs: Abhishek Goswami, Ali Ak, Wolf Hauser, Frédéric Dufaux, Patrick Le Callet.
Publié dans: International Workshop on Multimedia Signal Processing (MMSP'2021), 2021
Éditeur: IEEE

Tone Mapping Operators: Progressing Towards Semantic-Awareness

Auteurs: Abhishek Goswami, Mathis Petrovich, Wolf Hauser, Frederic Dufaux
Publié dans: 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), 2020, ISBN 978-1-7281-1485-9
Éditeur: IEEE
DOI: 10.1109/icmew46912.2020.9106057

Perception-Driven Hybrid Foveated Depth of Field Rendering for Head-Mounted Displays

Auteurs: Jingyu Liu, Claire Mantel, Søren Forchhammer
Publié dans: Proceedings of 2021 IEEE International Symposium on Mixed and Augmented Reality, Numéro 22, 2021, Page(s) 1-10, ISBN 978-1-6654-0158-6
Éditeur: IEEE
DOI: 10.1109/ismar52148.2021.00014

Learning-based lossless light field compression

Auteurs: Milan Stepanov, Muhammad Umair Mukati, Giuseppe Valenzise, Søren Forchhammer, Frédéric Dufaux
Publié dans: IEEE International Workshop on Multimedia Signal Processing (MMSP’2021), 2021
Éditeur: IEEE

Non-peer reviewed articles (1)

RV-TMO: Large-Scale Dataset for Subjective Quality Assessment of Tone Mapped Images

Auteurs: Ali Ak, Abhishek Goswami, Wolf Hauser, Patrick Le Callet, Frederic Dufaux
Publié dans: IEEE, 2022, ISSN 1520-9210
Éditeur: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tmm.2022.3203211

Other (2)

Multicamera Lightfield: High Dynamic Range Dataset Specification (Internal JPEG Input Document WG1M87038)

Auteurs: Gul, Muhammad Shahzeb Khan, Michel Bätz, Matthias Ziegler, Joachim Keinert, and Siegfried Fößel
Publié dans: Internal JPEG Input Document to ISO/IEC 21794 (JPEG PLENO), 2020
Éditeur: ISO/IEC 21794 (JPEG PLENO)

QUALINET White Paper on Definitions of Immersive Media Experience (IMEx)

Auteurs: Andrew Perkis, Christian Timmerer, Sabina Baraković, Jasmina Baraković Husić, Søren Bech, Sebastian Bosse, Jean Botev, Kjell Brunnström, Luis Cruz, Katrien De Moor, Andrea de Polo Saibanti, Wouter Durnez, Sebastian Egger-Lampl, Ulrich Engelke, Tiago H. Falk, Jesús Gutiérrez, Asim Hameed, Andrew Hines, Tanja Kojic, Dragan Kukolj, Eirini Liotou, Dragorad Milovanovic, Sebastian Möller, Niall
Publié dans: European Network on Quality of Experience in Multimedia Systems and Services, 14th QUALINET meeting (online)., 2020
Éditeur: European Network on Quality of Experience in Multimedia Systems and Services
DOI: 10.48550/arxiv.2007.07032

Book chapters (1)

Immersion in Audiovisual Experiences

Auteurs: Sarvesh Agrawal, Søren Bech
Publié dans: Sonic Interactions in Virtual Environments, 2022, ISBN 978-3-031-04020-7
Éditeur: Springer
DOI: 10.1007/978-3-031-04021-4_11