Hyperrealistic Imaging Experience

Informacje na temat projektu

RealVision

Identyfikator umowy o grant: 765911

DOI

10.3030/765911

Projekt został zamknięty

Data podpisania przez KE 10 Sierpnia 2017

Data rozpoczęcia 1 Stycznia 2018

Data zakończenia 30 Czerwca 2022

Finansowanie w ramach

• EXCELLENT SCIENCE - Marie Skłodowska-Curie Actions

Koszt całkowity

€ 4 076 702,28

Wkład UE

€ 4 076 702,28

Koordynowany przez

DANMARKS TEKNISKE UNIVERSITET
Denmark

CORDIS oferuje możliwość skorzystania z odnośników do publicznie dostępnych publikacji i rezultatów projektów realizowanych w ramach programów ramowych HORYZONT.

Odnośniki do rezultatów i publikacji związanych z poszczególnymi projektami 7PR, a także odnośniki do niektórych konkretnych kategorii wyników, takich jak zbiory danych i oprogramowanie, są dynamicznie pobierane z systemu OpenAIRE .

Rezultaty

Other (2)

Supervisory Board

Supervisory Board of the Network established as specified in Annex 1.

Light field capture for test images in coding and processing

Demonstrators, pilots, prototypes (3)

Organization, plan and attendance of an Industrial Forum

Organization plan and attendance of an Industrial Forum

Perceptual coding of light field data with flexible access for applications
New view extraction demonstrator

Documents, reports (11)

Metric for comparing surface appearance of fabricated objects
A model explaining maximum tolerable latency of interactive displays
Rules for the contribution of focus cues to realistic appearance of scenes
Report on the influence of perceptual cues to realism
Models of differences in color perception with narrow-band light

Models of differences in color perception with narrowband light

Naturalness of hyper-realistic video

Naturalness of hyperrealistic video

Method for objective measurement of hyper-realistic image quality of light fields

Method for objective measurement of hyperrealistic image quality of light fields

A low-level vision metric for comparing displayed hyper-realistic images

A lowlevel vision metric for comparing displayed hyperrealistic images

Report on individual variations in the perception of hyper-realistic images

Report on individual variations in the perception of hyperrealistic images

Method for the subjective assessment of immersive audio-visual contents

Method for the subjective assessment of immersive audiovisual contents

Courses

Websites, patent fillings, videos etc. (4)

Project communication tools established, website online etc
Communicate with standardization bodies about contributing content
Public dissemination of project results, incl. JPEG and MPEG bodies

Public dissemination of project results, incl. JPEG and MPEG bodies. The activity is carried out throughout the project. First larger effort is at M9.

Generate test content suitable for HDR and U-HDTV processing

Publikacje

Peer reviewed articles (13)

Method for Subjective Assessment of Immersion in Audiovisual Experiences

Autorzy: Sarvesh Agrawal, Søren Bech, Klaus Bærentsen, Katrien De Moor, and Søren Forchhammer
Opublikowane w: Journal of the Audio Engineering Society, Numer 69 (9), 2021, Strona(/y) 656-671, ISSN 1549-4950
Wydawca: Audio Engineering Society
DOI: 10.17743/jaes.2021.0013

Defining Immersion: Literature Review and Implications for Research on Audiovisual Experiences

Autorzy: Sarvesh Agrawal, Adèle Simon, Søren Bech, Klaus Bærentsen, Søren Forchhammer
Opublikowane w: Journal of the Audio Engineering Society, Numer 68/6, 2020, Strona(/y) 404-417, ISSN 1549-4950
Wydawca: Audio Engineering Society
DOI: 10.17743/jaes.2020.0039

Perceptual model for adaptive local shading and refresh rate

Autorzy: Akshay Jindal , Krzysztof Wolski , Karol Myszkowski , Rafał K. Mantiuk
Opublikowane w: ACM Transactions on Graphics, Numer Volume 40, Numer 6, December 2021, Article No.: 281, 2021, Strona(/y) pp 1–18, ISSN 0730-0301
Wydawca: Association for Computing Machinary, Inc.
DOI: 10.1145/3478513.3480514

Epipolar Plane Image-Based Lossless and Near-Lossless Light Field Compression

Autorzy: M. Umair Mukati, Soren Forchhammer
Opublikowane w: IEEE Access, Numer 9, 2021, Strona(/y) 1124-1136, ISSN 2169-3536
Wydawca: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2020.3047073

Improved Deep Distributed Light Field Coding

Autorzy: M. Umair Mukati, Milan Stepanov, Giuseppe Valenzise, Soren Forchhammer, Frederic Dufaux
Opublikowane w: IEEE Open Journal of Circuits and Systems, Numer 2, 2021, Strona(/y) 325-337, ISSN 2644-1225
Wydawca: IEEE
DOI: 10.1109/ojcas.2021.3073252

Dataset and Metrics for Predicting Local Visible Differences

Autorzy: Krzysztof Wolski, Daniele Giunchi, Nanyang Ye, Piotr Didyk, Karol Myszkowski, Radosław Mantiuk, Hans-Peter Seidel, Anthony Steed, Rafał K. Mantiuk
Opublikowane w: ACM Transactions on Graphics, Numer 37/5, 2018, Strona(/y) 1-14, ISSN 0730-0301
Wydawca: Association for Computing Machinary, Inc.
DOI: 10.1145/3196493

Selecting texture resolution using a task‐specific visibility metric

Autorzy: K. Wolski, D. Giunchi, S. Kinuwaki, P. Didyk, K. Myszkowski, A. Steed, R. K. Mantiuk
Opublikowane w: Computer Graphics Forum, Numer 38/7, 2019, Strona(/y) 685-696, ISSN 0167-7055
Wydawca: Blackwell Publishing Inc.
DOI: 10.1111/cgf.13871

DiCE

Autorzy: Fangcheng Zhong, George Alex Koulieris, George Drettakis, Martin S. Banks, Mathieu Chambe, Frédo Durand, Rafał K. Mantiuk
Opublikowane w: ACM Transactions on Graphics (TOG), Numer 38/6, 2019, Strona(/y) 1-13, ISSN 0730-0301
Wydawca: Association for Computing Machinary, Inc.
DOI: 10.1145/3355089.3356552

Demonstrating a multi-primary high dynamic range display system for vision experiments

Autorzy: Allie C. Hexley, Ali Özgür Yöntem, Manuel Spitschan, Hannah E. Smithson, Rafal Mantiuk
Opublikowane w: Journal of the Optical Society of America A, Numer 37/4, 2020, Strona(/y) A271, ISSN 1084-7529
Wydawca: Optical Society of America
DOI: 10.1364/josaa.384022

Attention Mechanism-Based Light-Field View Synthesis

Autorzy: M. Shahzeb Khan Gul, M. Umair Mukati, Michel Baetz, Soren Forchammer, Joachim Keinert
Opublikowane w: IEEE Acess, 2022, ISSN 2169-3536
Wydawca: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2022.3142949

Reproducing reality with a high-dynamic-range multi-focal stereo display

Autorzy: Fangcheng Zhong , Akshay Jindal , Ali Özgür Yöntem , Param Hanji , Simon J. Watt , Rafał K. Mantiuk
Opublikowane w: ACM Transactions on Graphics, Numer Volume 40, Numer 6, December 2021, Article No.: 241, 2021, Strona(/y) pp 1–14, ISSN 0730-0301
Wydawca: Association for Computing Machinary, Inc.
DOI: 10.1145/3478513.3480513

Influence of Changes in Audio Spatialization on Immersion in Audiovisual Experiences

Autorzy: Sarvesh Agrawal, Søren Bech, Katrien de Moor, Søren Forchhammer
Opublikowane w: Journal of Audio Engineering Society, Numer 70 (10), 2022, Strona(/y) 810-823, ISSN 1549-4950
Wydawca: Audio Engineering Society
DOI: 10.17743/jaes.2022.0034

A perceptual model of motion quality for rendering with adaptive refresh-rate and resolution

Autorzy: Gyorgy Denes, Akshay Jindal, Aliaksei Mikhailiuk, Rafał K. Mantiuk
Opublikowane w: ACM Transactions on Graphics, Numer 39/4, 2020, Strona(/y) 1, ISSN 0730-0301
Wydawca: Association for Computing Machinary, Inc.
DOI: 10.1145/3386569.3392411

Conference proceedings (29)

Hybrid Learning-Based And Hevc-Based Coding Of Light Fields

Autorzy: Milan Stepanov, Giuseppe Valenzise, Frederic Dufaux
Opublikowane w: 2020 IEEE International Conference on Image Processing (ICIP), 2020, Strona(/y) 3344-3348, ISBN 978-1-7281-6395-6
Wydawca: IEEE
DOI: 10.1109/icip40778.2020.9190971

Evaluation of the Bubble view Metaphor for the Crowdsourcing Study of Visual Attention Deployment in Tone-Mapped Images

Autorzy: W. Ellahi, T. Vigier and P. Le Callet
Opublikowane w: 2021 9th European Workshop on Visual Information Processing (EUVIP), 2021
Wydawca: EUVIP
DOI: 10.1109/euvip50544.2021.9483985

The Effect of Temporal Sub-sampling on the Accuracy of Volumetric Video Quality Assessment

Autorzy: Ali Ak, Emin Zerman, Suiyi Ling, Patrick Le Callet, Aljosa Smolic
Opublikowane w: 2021
Wydawca: IEEE PCS 2021, Picture Coding Symposium
DOI: 10.1109/pcs50896.2021.9477449

Can Visual Scanpath Reveal Personal Image Memorability? Investigation of HMM Tools for Gaze Patterns Analysis

Autorzy: W. Ellahi, T. Vigier and P. Le Callet
Opublikowane w: 2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX), 2020
Wydawca: QoMEX
DOI: 10.1109/qomex48832.2020.9123102

On Spammer Detection in Crowdsourcing Pairwise Comparison Tasks: Case Study on Two Multimedia QoE Assessment Scenarios

Autorzy: Ali Ak, Mona Abid, Matthieu Perreira da Silva, Patrick Le Callet
Opublikowane w: 2021
Wydawca: IEEE ICME 2021, First International Workshop on Quality of Experience in Interactive Multimedia
DOI: 10.1109/icmew53276.2021.9455992

A machine-learning approach to illuminant estimation using statistical regularities in photoreceptor signals from real-world surfaces

Autorzy: Allie C. Hexley, Takuma Morimoto, Keiji Uchikawa, Hannah E. Smithson
Opublikowane w: ECVP 43rd European Conference on Visual Perception (ECVP) 2021 Online, 2022
Wydawca: Perception
DOI: 10.1177/03010066211059887

Active sampling for pairwise comparisons via approximate message passing and information gain maximization

Autorzy: Aliaksei Mikhailiuk, Clifford Wilmot, Maria Perez-Ortiz, Dingcheng Yue, Rafał K. Mantiuk
Opublikowane w: International Conference on Patter Recognition (ICPR), 2020
Wydawca: IEEE
DOI: 10.48550/arxiv.2004.05691

A Simulation System for Scene Synthesis in Virtual Reality

Autorzy: Jingyu Liu, Claire Mantel, Florian Schweiger, Søren Forchhammer
Opublikowane w: International Conference on Virtual Reality and Mixed Reality, Numer 18, 2021, Strona(/y) 67-84, ISBN 978-3-030-90738-9
Wydawca: Springer
DOI: 10.1007/978-3-030-90739-6_5

A Comprehensive Analysis of Crowdsourcing for Subjective Evaluation of Tone Mapping Operators

Autorzy: Ali Ak, Abhishek Goswami, Wolf Hauser, Patrick Le Callet, Frédéric Dufaux
Opublikowane w: Image Quality and System Performance, IS&T International Symposium on Electronic Imaging (EI 2021), 2020
Wydawca: SPIE
DOI: 10.2352/issn.2470-1173.2021.9.iqsp-262

A machine-learning framework to predict TMO preference based on image and visual attention features

Autorzy: W. Ellahi, T. Vigier and P. L. Callet
Opublikowane w: 2021 IEEE 23rd International Workshop on Multimedia Signal Processing (MMSP), 2021
Wydawca: MMSP
DOI: 10.1109/mmsp53017.2021.9733461

Predicting Visible Image Differences Under Varying Display Brightness and Viewing Distance

Autorzy: Nanyang Ye, Krzysztof Wolski, Rafal K. Mantiuk
Opublikowane w: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019, Strona(/y) 5429-5437, ISBN 978-1-7281-3293-8
Wydawca: IEEE
DOI: 10.1109/cvpr.2019.00558

147th Audio Engineering Society Convention

Autorzy: Sarvesh Agrawal, Adèle Simon, Søren Bech, Klau Bærentsen, Søren Forchhammer
Opublikowane w: 2019, ISBN 978-1-942220-31-2
Wydawca: Audio Engineering Society
DOI: 10.17743/aesconv.2019.978-1-942220-31-2

Pixel-Wise Confidences for Stereo Disparities Using Recurrent Neural Networks

Autorzy: Muhammad Shahzeb Khan gul, Michel Bätz, Joachim Keinert
Opublikowane w: British Machine Vision Conference, Numer 2019, 2019, Strona(/y) 1-13
Wydawca: British Machine Vision Association
DOI: 10.24406/iis-n-581312

Investigating Epipolar Plane Image Representations for Objective Quality Evaluation of Light Field Images

Autorzy: Ali Ak, Patrick Le-Callet
Opublikowane w: 2019 8th European Workshop on Visual Information Processing (EUVIP), 2019, Strona(/y) 135-139, ISBN 978-1-7281-4496-2
Wydawca: IEEE
DOI: 10.1109/EUVIP47703.2019.8946194

Towards Perceptually Plausible Training of Image Restoration Neural Networks

Autorzy: Ali Ak, Patrick Le-Callet
Opublikowane w: 2019 Ninth International Conference on Image Processing Theory, Tools and Applications (IPTA), 2019, Strona(/y) 1-5, ISBN 978-1-7281-3975-3
Wydawca: IEEE
DOI: 10.1109/IPTA.2019.8936096

A Benchmark of Light Field View Interpolation Methods

Autorzy: Dingcheng Yue, Muhammad Shahzeb Khan Gul, Michel Batz, Joachim Keinert, Rafal Mantiuk
Opublikowane w: 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), 2020, Strona(/y) 1-6, ISBN 978-1-7281-1485-9
Wydawca: IEEE
DOI: 10.1109/icmew46912.2020.9106041

A High-Resolution High Dynamic Range Light-Field Dataset with an Application to View Synthesis and Tone-Mapping

Autorzy: M. Shahzeb Khan Gul, Thorsten Wolf, Michel Batz, Matthias Ziegler, Joachim Keinert
Opublikowane w: 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), 2020, Strona(/y) 1-6, ISBN 978-1-7281-1485-9
Wydawca: IEEE
DOI: 10.1109/icmew46912.2020.9105964

Towards a Perceived Audiovisual Quality Model for Immersive Content

Autorzy: Randy Frans Fela, Nick Zacharov, Soren Forchhammer
Opublikowane w: 2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX), 2020, Strona(/y) 1-6, ISBN 978-1-7281-5965-2
Wydawca: IEEE
DOI: 10.1109/qomex48832.2020.9123134

View Synthesis-based Distributed Light Field Compression

Autorzy: M. Umair Mukati, Milan Stepanov, Giuseppe Valenzise, Frederic Dufaux, Soren Forchhammer
Opublikowane w: 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), Numer 2020, 2020, Strona(/y) 1-6, ISBN 978-1-7281-1485-9
Wydawca: IEEE
DOI: 10.1109/icmew46912.2020.9105980

EPIC: Context Adaptive Lossless Light Field Compression using Epipolar Plane Images

Autorzy: Muhammad Umair Mukati, Soren Forchhammer
Opublikowane w: 2020 Data Compression Conference (DCC), Numer 2020, 2020, Strona(/y) 43-52, ISBN 978-1-7281-6457-1
Wydawca: IEEE
DOI: 10.1109/dcc47342.2020.00012

RNNSC: Recurrent Neural Network-Based Stereo Compression Using Image and State Warping

Autorzy: M. Shahzeb Khan Gul, Hamid Suleman, Michel Bätz, and Joachim Keinert
Opublikowane w: Data Compression Conference (DCC), 2022, Strona(/y) 455, ISBN 978-1-6654-7893-9
Wydawca: IEEE
DOI: 10.1109/dcc52660.2022.00066

No-Reference Quality Evaluation of Light Field Content Based on Structural Representation of The Epipolar Plane Image

Autorzy: Ali Ak, Suiyi Ling, Patrick Le Callet
Opublikowane w: 2020
Wydawca: IEEE The 1st ICME Workshop on Hyper-Realistic Multimedia for Enhanced Quality of Experience
DOI: 10.1109/icmew46912.2020.9105975

HMM-Based Framework to Measure the Visual Fidelity of Tone Mapping Operators

Autorzy: W. Ellahi, T. Vigier and P. Le Callet
Opublikowane w: 2020
Wydawca: 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)
DOI: 10.1109/icmew46912.2020.9106029

Characterizing fixational eye movements as a candidate biomarker of neurodegenerative disorders

Autorzy: Allie C. Hexley, Anna K. Hauperich, Laura K. Young, Tom McLeish, Hannah E. Smithson
Opublikowane w: 2021
Wydawca: Opthalmic and Physiological Optics
DOI: 10.1111/opo.12900

Light-Field View Synthesis Using A Convolutional Block Attention Module

Autorzy: M. Shahzeb Khan Gul, M. Umair Mukati, Michel Batz, Soren Forchhammer, Joachim Keinert
Opublikowane w: 2021 IEEE International Conference on Image Processing (ICIP), 2021, Strona(/y) 3398-3402, ISBN 978-1-6654-4115-5
Wydawca: IEEE
DOI: 10.1109/icip42928.2021.9506586

Reliability of Crowdsourcing for Subjective Quality Evaluation of Tone Mapping Operators

Autorzy: Abhishek Goswami, Ali Ak, Wolf Hauser, Frédéric Dufaux, Patrick Le Callet.
Opublikowane w: International Workshop on Multimedia Signal Processing (MMSP'2021), 2021
Wydawca: IEEE

Tone Mapping Operators: Progressing Towards Semantic-Awareness

Autorzy: Abhishek Goswami, Mathis Petrovich, Wolf Hauser, Frederic Dufaux
Opublikowane w: 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), 2020, ISBN 978-1-7281-1485-9
Wydawca: IEEE
DOI: 10.1109/icmew46912.2020.9106057

Perception-Driven Hybrid Foveated Depth of Field Rendering for Head-Mounted Displays

Autorzy: Jingyu Liu, Claire Mantel, Søren Forchhammer
Opublikowane w: Proceedings of 2021 IEEE International Symposium on Mixed and Augmented Reality, Numer 22, 2021, Strona(/y) 1-10, ISBN 978-1-6654-0158-6
Wydawca: IEEE
DOI: 10.1109/ismar52148.2021.00014

Learning-based lossless light field compression

Autorzy: Milan Stepanov, Muhammad Umair Mukati, Giuseppe Valenzise, Søren Forchhammer, Frédéric Dufaux
Opublikowane w: IEEE International Workshop on Multimedia Signal Processing (MMSP’2021), 2021
Wydawca: IEEE

Non-peer reviewed articles (1)

RV-TMO: Large-Scale Dataset for Subjective Quality Assessment of Tone Mapped Images

Autorzy: Ali Ak, Abhishek Goswami, Wolf Hauser, Patrick Le Callet, Frederic Dufaux
Opublikowane w: IEEE, 2022, ISSN 1520-9210
Wydawca: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tmm.2022.3203211

Other (2)

Multicamera Lightfield: High Dynamic Range Dataset Specification (Internal JPEG Input Document WG1M87038)

Autorzy: Gul, Muhammad Shahzeb Khan, Michel Bätz, Matthias Ziegler, Joachim Keinert, and Siegfried Fößel
Opublikowane w: Internal JPEG Input Document to ISO/IEC 21794 (JPEG PLENO), 2020
Wydawca: ISO/IEC 21794 (JPEG PLENO)

QUALINET White Paper on Definitions of Immersive Media Experience (IMEx)

Autorzy: Andrew Perkis, Christian Timmerer, Sabina Baraković, Jasmina Baraković Husić, Søren Bech, Sebastian Bosse, Jean Botev, Kjell Brunnström, Luis Cruz, Katrien De Moor, Andrea de Polo Saibanti, Wouter Durnez, Sebastian Egger-Lampl, Ulrich Engelke, Tiago H. Falk, Jesús Gutiérrez, Asim Hameed, Andrew Hines, Tanja Kojic, Dragan Kukolj, Eirini Liotou, Dragorad Milovanovic, Sebastian Möller, Niall
Opublikowane w: European Network on Quality of Experience in Multimedia Systems and Services, 14th QUALINET meeting (online)., 2020
Wydawca: European Network on Quality of Experience in Multimedia Systems and Services
DOI: 10.48550/arxiv.2007.07032

Book chapters (1)

Immersion in Audiovisual Experiences

Autorzy: Sarvesh Agrawal, Søren Bech
Opublikowane w: Sonic Interactions in Virtual Environments, 2022, ISBN 978-3-031-04020-7
Wydawca: Springer
DOI: 10.1007/978-3-031-04021-4_11