Hyperrealistic Imaging Experience

Información del proyecto

RealVision

Identificador del acuerdo de subvención: 765911

DOI

10.3030/765911

Proyecto cerrado

Fecha de la firma de la CE 10 Agosto 2017

Fecha de inicio 1 Enero 2018

Fecha de finalización 30 Junio 2022

Financiado con arreglo a

• EXCELLENT SCIENCE - Marie Skłodowska-Curie Actions

Coste total

€ 4 076 702,28

Aportación de la UE

€ 4 076 702,28

Coordinado por

DANMARKS TEKNISKE UNIVERSITET
Denmark

CORDIS proporciona enlaces a los documentos públicos y las publicaciones de los proyectos de los programas marco HORIZONTE.

Los enlaces a los documentos y las publicaciones de los proyectos del Séptimo Programa Marco, así como los enlaces a algunos tipos de resultados específicos, como conjuntos de datos y «software», se obtienen dinámicamente de OpenAIRE .

Resultado final

Other (2)

Supervisory Board

Supervisory Board of the Network established as specified in Annex 1.

Light field capture for test images in coding and processing

Demonstrators, pilots, prototypes (3)

Organization, plan and attendance of an Industrial Forum

Organization plan and attendance of an Industrial Forum

Perceptual coding of light field data with flexible access for applications
New view extraction demonstrator

Documents, reports (11)

Metric for comparing surface appearance of fabricated objects
A model explaining maximum tolerable latency of interactive displays
Rules for the contribution of focus cues to realistic appearance of scenes
Report on the influence of perceptual cues to realism
Models of differences in color perception with narrow-band light

Models of differences in color perception with narrowband light

Naturalness of hyper-realistic video

Naturalness of hyperrealistic video

Method for objective measurement of hyper-realistic image quality of light fields

Method for objective measurement of hyperrealistic image quality of light fields

A low-level vision metric for comparing displayed hyper-realistic images

A lowlevel vision metric for comparing displayed hyperrealistic images

Report on individual variations in the perception of hyper-realistic images

Report on individual variations in the perception of hyperrealistic images

Method for the subjective assessment of immersive audio-visual contents

Method for the subjective assessment of immersive audiovisual contents

Courses

Websites, patent fillings, videos etc. (4)

Project communication tools established, website online etc
Communicate with standardization bodies about contributing content
Public dissemination of project results, incl. JPEG and MPEG bodies

Public dissemination of project results, incl. JPEG and MPEG bodies. The activity is carried out throughout the project. First larger effort is at M9.

Generate test content suitable for HDR and U-HDTV processing

Publicaciones

Peer reviewed articles (13)

Method for Subjective Assessment of Immersion in Audiovisual Experiences

Autores: Sarvesh Agrawal, Søren Bech, Klaus Bærentsen, Katrien De Moor, and Søren Forchhammer
Publicado en: Journal of the Audio Engineering Society, Edición 69 (9), 2021, Página(s) 656-671, ISSN 1549-4950
Editor: Audio Engineering Society
DOI: 10.17743/jaes.2021.0013

Defining Immersion: Literature Review and Implications for Research on Audiovisual Experiences

Autores: Sarvesh Agrawal, Adèle Simon, Søren Bech, Klaus Bærentsen, Søren Forchhammer
Publicado en: Journal of the Audio Engineering Society, Edición 68/6, 2020, Página(s) 404-417, ISSN 1549-4950
Editor: Audio Engineering Society
DOI: 10.17743/jaes.2020.0039

Perceptual model for adaptive local shading and refresh rate

Autores: Akshay Jindal , Krzysztof Wolski , Karol Myszkowski , Rafał K. Mantiuk
Publicado en: ACM Transactions on Graphics, Edición Volume 40, Edición 6, December 2021, Article No.: 281, 2021, Página(s) pp 1–18, ISSN 0730-0301
Editor: Association for Computing Machinary, Inc.
DOI: 10.1145/3478513.3480514

Epipolar Plane Image-Based Lossless and Near-Lossless Light Field Compression

Autores: M. Umair Mukati, Soren Forchhammer
Publicado en: IEEE Access, Edición 9, 2021, Página(s) 1124-1136, ISSN 2169-3536
Editor: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2020.3047073

Improved Deep Distributed Light Field Coding

Autores: M. Umair Mukati, Milan Stepanov, Giuseppe Valenzise, Soren Forchhammer, Frederic Dufaux
Publicado en: IEEE Open Journal of Circuits and Systems, Edición 2, 2021, Página(s) 325-337, ISSN 2644-1225
Editor: IEEE
DOI: 10.1109/ojcas.2021.3073252

Dataset and Metrics for Predicting Local Visible Differences

Autores: Krzysztof Wolski, Daniele Giunchi, Nanyang Ye, Piotr Didyk, Karol Myszkowski, Radosław Mantiuk, Hans-Peter Seidel, Anthony Steed, Rafał K. Mantiuk
Publicado en: ACM Transactions on Graphics, Edición 37/5, 2018, Página(s) 1-14, ISSN 0730-0301
Editor: Association for Computing Machinary, Inc.
DOI: 10.1145/3196493

Selecting texture resolution using a task‐specific visibility metric

Autores: K. Wolski, D. Giunchi, S. Kinuwaki, P. Didyk, K. Myszkowski, A. Steed, R. K. Mantiuk
Publicado en: Computer Graphics Forum, Edición 38/7, 2019, Página(s) 685-696, ISSN 0167-7055
Editor: Blackwell Publishing Inc.
DOI: 10.1111/cgf.13871

DiCE

Autores: Fangcheng Zhong, George Alex Koulieris, George Drettakis, Martin S. Banks, Mathieu Chambe, Frédo Durand, Rafał K. Mantiuk
Publicado en: ACM Transactions on Graphics (TOG), Edición 38/6, 2019, Página(s) 1-13, ISSN 0730-0301
Editor: Association for Computing Machinary, Inc.
DOI: 10.1145/3355089.3356552

Demonstrating a multi-primary high dynamic range display system for vision experiments

Autores: Allie C. Hexley, Ali Özgür Yöntem, Manuel Spitschan, Hannah E. Smithson, Rafal Mantiuk
Publicado en: Journal of the Optical Society of America A, Edición 37/4, 2020, Página(s) A271, ISSN 1084-7529
Editor: Optical Society of America
DOI: 10.1364/josaa.384022

Attention Mechanism-Based Light-Field View Synthesis

Autores: M. Shahzeb Khan Gul, M. Umair Mukati, Michel Baetz, Soren Forchammer, Joachim Keinert
Publicado en: IEEE Acess, 2022, ISSN 2169-3536
Editor: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2022.3142949

Reproducing reality with a high-dynamic-range multi-focal stereo display

Autores: Fangcheng Zhong , Akshay Jindal , Ali Özgür Yöntem , Param Hanji , Simon J. Watt , Rafał K. Mantiuk
Publicado en: ACM Transactions on Graphics, Edición Volume 40, Edición 6, December 2021, Article No.: 241, 2021, Página(s) pp 1–14, ISSN 0730-0301
Editor: Association for Computing Machinary, Inc.
DOI: 10.1145/3478513.3480513

Influence of Changes in Audio Spatialization on Immersion in Audiovisual Experiences

Autores: Sarvesh Agrawal, Søren Bech, Katrien de Moor, Søren Forchhammer
Publicado en: Journal of Audio Engineering Society, Edición 70 (10), 2022, Página(s) 810-823, ISSN 1549-4950
Editor: Audio Engineering Society
DOI: 10.17743/jaes.2022.0034

A perceptual model of motion quality for rendering with adaptive refresh-rate and resolution

Autores: Gyorgy Denes, Akshay Jindal, Aliaksei Mikhailiuk, Rafał K. Mantiuk
Publicado en: ACM Transactions on Graphics, Edición 39/4, 2020, Página(s) 1, ISSN 0730-0301
Editor: Association for Computing Machinary, Inc.
DOI: 10.1145/3386569.3392411

Conference proceedings (29)

Hybrid Learning-Based And Hevc-Based Coding Of Light Fields

Autores: Milan Stepanov, Giuseppe Valenzise, Frederic Dufaux
Publicado en: 2020 IEEE International Conference on Image Processing (ICIP), 2020, Página(s) 3344-3348, ISBN 978-1-7281-6395-6
Editor: IEEE
DOI: 10.1109/icip40778.2020.9190971

Evaluation of the Bubble view Metaphor for the Crowdsourcing Study of Visual Attention Deployment in Tone-Mapped Images

Autores: W. Ellahi, T. Vigier and P. Le Callet
Publicado en: 2021 9th European Workshop on Visual Information Processing (EUVIP), 2021
Editor: EUVIP
DOI: 10.1109/euvip50544.2021.9483985

The Effect of Temporal Sub-sampling on the Accuracy of Volumetric Video Quality Assessment

Autores: Ali Ak, Emin Zerman, Suiyi Ling, Patrick Le Callet, Aljosa Smolic
Publicado en: 2021
Editor: IEEE PCS 2021, Picture Coding Symposium
DOI: 10.1109/pcs50896.2021.9477449

Can Visual Scanpath Reveal Personal Image Memorability? Investigation of HMM Tools for Gaze Patterns Analysis

Autores: W. Ellahi, T. Vigier and P. Le Callet
Publicado en: 2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX), 2020
Editor: QoMEX
DOI: 10.1109/qomex48832.2020.9123102

On Spammer Detection in Crowdsourcing Pairwise Comparison Tasks: Case Study on Two Multimedia QoE Assessment Scenarios

Autores: Ali Ak, Mona Abid, Matthieu Perreira da Silva, Patrick Le Callet
Publicado en: 2021
Editor: IEEE ICME 2021, First International Workshop on Quality of Experience in Interactive Multimedia
DOI: 10.1109/icmew53276.2021.9455992

A machine-learning approach to illuminant estimation using statistical regularities in photoreceptor signals from real-world surfaces

Autores: Allie C. Hexley, Takuma Morimoto, Keiji Uchikawa, Hannah E. Smithson
Publicado en: ECVP 43rd European Conference on Visual Perception (ECVP) 2021 Online, 2022
Editor: Perception
DOI: 10.1177/03010066211059887

Active sampling for pairwise comparisons via approximate message passing and information gain maximization

Autores: Aliaksei Mikhailiuk, Clifford Wilmot, Maria Perez-Ortiz, Dingcheng Yue, Rafał K. Mantiuk
Publicado en: International Conference on Patter Recognition (ICPR), 2020
Editor: IEEE
DOI: 10.48550/arxiv.2004.05691

A Simulation System for Scene Synthesis in Virtual Reality

Autores: Jingyu Liu, Claire Mantel, Florian Schweiger, Søren Forchhammer
Publicado en: International Conference on Virtual Reality and Mixed Reality, Edición 18, 2021, Página(s) 67-84, ISBN 978-3-030-90738-9
Editor: Springer
DOI: 10.1007/978-3-030-90739-6_5

A Comprehensive Analysis of Crowdsourcing for Subjective Evaluation of Tone Mapping Operators

Autores: Ali Ak, Abhishek Goswami, Wolf Hauser, Patrick Le Callet, Frédéric Dufaux
Publicado en: Image Quality and System Performance, IS&T International Symposium on Electronic Imaging (EI 2021), 2020
Editor: SPIE
DOI: 10.2352/issn.2470-1173.2021.9.iqsp-262

A machine-learning framework to predict TMO preference based on image and visual attention features

Autores: W. Ellahi, T. Vigier and P. L. Callet
Publicado en: 2021 IEEE 23rd International Workshop on Multimedia Signal Processing (MMSP), 2021
Editor: MMSP
DOI: 10.1109/mmsp53017.2021.9733461

Predicting Visible Image Differences Under Varying Display Brightness and Viewing Distance

Autores: Nanyang Ye, Krzysztof Wolski, Rafal K. Mantiuk
Publicado en: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019, Página(s) 5429-5437, ISBN 978-1-7281-3293-8
Editor: IEEE
DOI: 10.1109/cvpr.2019.00558

147th Audio Engineering Society Convention

Autores: Sarvesh Agrawal, Adèle Simon, Søren Bech, Klau Bærentsen, Søren Forchhammer
Publicado en: 2019, ISBN 978-1-942220-31-2
Editor: Audio Engineering Society
DOI: 10.17743/aesconv.2019.978-1-942220-31-2

Pixel-Wise Confidences for Stereo Disparities Using Recurrent Neural Networks

Autores: Muhammad Shahzeb Khan gul, Michel Bätz, Joachim Keinert
Publicado en: British Machine Vision Conference, Edición 2019, 2019, Página(s) 1-13
Editor: British Machine Vision Association
DOI: 10.24406/iis-n-581312

Investigating Epipolar Plane Image Representations for Objective Quality Evaluation of Light Field Images

Autores: Ali Ak, Patrick Le-Callet
Publicado en: 2019 8th European Workshop on Visual Information Processing (EUVIP), 2019, Página(s) 135-139, ISBN 978-1-7281-4496-2
Editor: IEEE
DOI: 10.1109/EUVIP47703.2019.8946194

Towards Perceptually Plausible Training of Image Restoration Neural Networks

Autores: Ali Ak, Patrick Le-Callet
Publicado en: 2019 Ninth International Conference on Image Processing Theory, Tools and Applications (IPTA), 2019, Página(s) 1-5, ISBN 978-1-7281-3975-3
Editor: IEEE
DOI: 10.1109/IPTA.2019.8936096

A Benchmark of Light Field View Interpolation Methods

Autores: Dingcheng Yue, Muhammad Shahzeb Khan Gul, Michel Batz, Joachim Keinert, Rafal Mantiuk
Publicado en: 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), 2020, Página(s) 1-6, ISBN 978-1-7281-1485-9
Editor: IEEE
DOI: 10.1109/icmew46912.2020.9106041

A High-Resolution High Dynamic Range Light-Field Dataset with an Application to View Synthesis and Tone-Mapping

Autores: M. Shahzeb Khan Gul, Thorsten Wolf, Michel Batz, Matthias Ziegler, Joachim Keinert
Publicado en: 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), 2020, Página(s) 1-6, ISBN 978-1-7281-1485-9
Editor: IEEE
DOI: 10.1109/icmew46912.2020.9105964

Towards a Perceived Audiovisual Quality Model for Immersive Content

Autores: Randy Frans Fela, Nick Zacharov, Soren Forchhammer
Publicado en: 2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX), 2020, Página(s) 1-6, ISBN 978-1-7281-5965-2
Editor: IEEE
DOI: 10.1109/qomex48832.2020.9123134

View Synthesis-based Distributed Light Field Compression

Autores: M. Umair Mukati, Milan Stepanov, Giuseppe Valenzise, Frederic Dufaux, Soren Forchhammer
Publicado en: 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), Edición 2020, 2020, Página(s) 1-6, ISBN 978-1-7281-1485-9
Editor: IEEE
DOI: 10.1109/icmew46912.2020.9105980

EPIC: Context Adaptive Lossless Light Field Compression using Epipolar Plane Images

Autores: Muhammad Umair Mukati, Soren Forchhammer
Publicado en: 2020 Data Compression Conference (DCC), Edición 2020, 2020, Página(s) 43-52, ISBN 978-1-7281-6457-1
Editor: IEEE
DOI: 10.1109/dcc47342.2020.00012

RNNSC: Recurrent Neural Network-Based Stereo Compression Using Image and State Warping

Autores: M. Shahzeb Khan Gul, Hamid Suleman, Michel Bätz, and Joachim Keinert
Publicado en: Data Compression Conference (DCC), 2022, Página(s) 455, ISBN 978-1-6654-7893-9
Editor: IEEE
DOI: 10.1109/dcc52660.2022.00066

No-Reference Quality Evaluation of Light Field Content Based on Structural Representation of The Epipolar Plane Image

Autores: Ali Ak, Suiyi Ling, Patrick Le Callet
Publicado en: 2020
Editor: IEEE The 1st ICME Workshop on Hyper-Realistic Multimedia for Enhanced Quality of Experience
DOI: 10.1109/icmew46912.2020.9105975

HMM-Based Framework to Measure the Visual Fidelity of Tone Mapping Operators

Autores: W. Ellahi, T. Vigier and P. Le Callet
Publicado en: 2020
Editor: 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)
DOI: 10.1109/icmew46912.2020.9106029

Characterizing fixational eye movements as a candidate biomarker of neurodegenerative disorders

Autores: Allie C. Hexley, Anna K. Hauperich, Laura K. Young, Tom McLeish, Hannah E. Smithson
Publicado en: 2021
Editor: Opthalmic and Physiological Optics
DOI: 10.1111/opo.12900

Light-Field View Synthesis Using A Convolutional Block Attention Module

Autores: M. Shahzeb Khan Gul, M. Umair Mukati, Michel Batz, Soren Forchhammer, Joachim Keinert
Publicado en: 2021 IEEE International Conference on Image Processing (ICIP), 2021, Página(s) 3398-3402, ISBN 978-1-6654-4115-5
Editor: IEEE
DOI: 10.1109/icip42928.2021.9506586

Reliability of Crowdsourcing for Subjective Quality Evaluation of Tone Mapping Operators

Autores: Abhishek Goswami, Ali Ak, Wolf Hauser, Frédéric Dufaux, Patrick Le Callet.
Publicado en: International Workshop on Multimedia Signal Processing (MMSP'2021), 2021
Editor: IEEE

Tone Mapping Operators: Progressing Towards Semantic-Awareness

Autores: Abhishek Goswami, Mathis Petrovich, Wolf Hauser, Frederic Dufaux
Publicado en: 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), 2020, ISBN 978-1-7281-1485-9
Editor: IEEE
DOI: 10.1109/icmew46912.2020.9106057

Perception-Driven Hybrid Foveated Depth of Field Rendering for Head-Mounted Displays

Autores: Jingyu Liu, Claire Mantel, Søren Forchhammer
Publicado en: Proceedings of 2021 IEEE International Symposium on Mixed and Augmented Reality, Edición 22, 2021, Página(s) 1-10, ISBN 978-1-6654-0158-6
Editor: IEEE
DOI: 10.1109/ismar52148.2021.00014

Learning-based lossless light field compression

Autores: Milan Stepanov, Muhammad Umair Mukati, Giuseppe Valenzise, Søren Forchhammer, Frédéric Dufaux
Publicado en: IEEE International Workshop on Multimedia Signal Processing (MMSP’2021), 2021
Editor: IEEE

Non-peer reviewed articles (1)

RV-TMO: Large-Scale Dataset for Subjective Quality Assessment of Tone Mapped Images

Autores: Ali Ak, Abhishek Goswami, Wolf Hauser, Patrick Le Callet, Frederic Dufaux
Publicado en: IEEE, 2022, ISSN 1520-9210
Editor: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tmm.2022.3203211

Other (2)

Multicamera Lightfield: High Dynamic Range Dataset Specification (Internal JPEG Input Document WG1M87038)

Autores: Gul, Muhammad Shahzeb Khan, Michel Bätz, Matthias Ziegler, Joachim Keinert, and Siegfried Fößel
Publicado en: Internal JPEG Input Document to ISO/IEC 21794 (JPEG PLENO), 2020
Editor: ISO/IEC 21794 (JPEG PLENO)

QUALINET White Paper on Definitions of Immersive Media Experience (IMEx)

Autores: Andrew Perkis, Christian Timmerer, Sabina Baraković, Jasmina Baraković Husić, Søren Bech, Sebastian Bosse, Jean Botev, Kjell Brunnström, Luis Cruz, Katrien De Moor, Andrea de Polo Saibanti, Wouter Durnez, Sebastian Egger-Lampl, Ulrich Engelke, Tiago H. Falk, Jesús Gutiérrez, Asim Hameed, Andrew Hines, Tanja Kojic, Dragan Kukolj, Eirini Liotou, Dragorad Milovanovic, Sebastian Möller, Niall
Publicado en: European Network on Quality of Experience in Multimedia Systems and Services, 14th QUALINET meeting (online)., 2020
Editor: European Network on Quality of Experience in Multimedia Systems and Services
DOI: 10.48550/arxiv.2007.07032

Book chapters (1)

Immersion in Audiovisual Experiences

Autores: Sarvesh Agrawal, Søren Bech
Publicado en: Sonic Interactions in Virtual Environments, 2022, ISBN 978-3-031-04020-7
Editor: Springer
DOI: 10.1007/978-3-031-04021-4_11