An end-to-end system for the production and delivery of photorealistic social immersive virtual reality experiences

Resultado final

Report on the initial software versions, including their applicability for use in the pilots.

Documentation and technical fact sheets v3

his deliverable provides all the printable support documentation of VRTogether.

Final Software release, with documentation and Technical report targeting its use beyond the scope of the VR-Together project,

Technical report on third pilot

Technical report on third pilot, explaining the outcome of the deployment and its evaluation

Documentation and technical fact sheets v2

This deliverable provides all the printable support documentation of VRTogether.

User scenarios, requirements and architecture v3

This document will describe the use cases, functional and non-functional requirements, and software architecture needed to demonstrate the VR-Together approach to social photorealistic VR. It will be developed iteratively, with a new version issued for each pilot deployment

Market analysis report v3

This deliverable describes the market for audiovisual immersive products and provides a set of recommendations as input for the use cases and the exploitation and innovation transfer activities in T.5.1.

Documentation and technical fact sheets. v1

This deliverable provides all the printable support documentation of VRTogether.

Market Analysis Report v2

This deliverable describes the market for audiovisual immersive products and provides a set of recommendations as input for the use cases and the exploitation and innovation transfer activities in T.5.1.

User scenarios, requirements and architecture v1

This document will describe the use cases, functional and non-functional requirements, and software architecture needed to demonstrate the VR-Together approach to social photorealistic VR. It will be developed iteratively, with a new version issued for each pilot deployment

User scenarios, requirements and architecture v2

This document will describe the use cases, functional and non-functional requirements, and software architecture needed to demonstrate the VR-Together approach to social photorealistic VR. It will be developed iteratively, with a new version issued for each pilot deployment

Market analysis report v1

This deliverable describes the market for audiovisual immersive products and provides a set of recommendations as input for the use cases and the exploitation and innovation transfer activities in T.5.1.

Technical report on second pilot

Technical report on second pilot, explaining the outcome of the deployment and its evaluation

Technical report on first pilot

Technical report on first pilot explaining the outcome of the deployment and its evaluation

Third example of content delivered

Third example of content delivered, together with production and deployment plan for live content production and delivery

Second example of content

Second example of content tested production and deployment plan for live content production and delivery

First example of content

First example of content delivered together with production and deployment plan for live content production and delivery

Final version of the content demonstrations

Publicaciones

ImAc : enabling immersive and accessible media services

Autores: Montagud, Mario; Núñez, Juan A.; Fernández, Sergi; Orero, Pilar; Matamala, Anna
Publicado en: Frontiers Blogs, Edición 12, 2018
Editor: WoRLD: Workshop on Reading, Language and Deafness
DOI: 10.5281/zenodo.3755775

AR/VR for conferencing and remote assistance

Autores: Hans Stocking, Simon N.B. Gunkel, Tom De Koninck, Michel van Eersel, Bart Kok
Publicado en: VRIC ConVRgence 2020, 2020, Página(s) 175-177
Editor: Laval Virtual
DOI: 10.5281/zenodo.4040587

PC-MCU - point cloud multipoint control unit for multi-user holoconferencing systems

Autores: Gianluca Cernigliaro, Marc Martos, Mario Montagud, Amir Ansari, Sergi Fernandez
Publicado en: Proceedings of the 30th ACM Workshop on Network and Operating Systems Support for Digital Audio and Video, 2020, Página(s) 47-53, ISBN 9781450379458
Editor: ACM
DOI: 10.1145/3386290.3396936

Self-Supervised Deep Depth Denoising

Autores: Sterzentsenko, Vladimiros; Saroglou, Leonidas; Chatzitofis, Anargyros; Thermos, Spyridon; Zioulis, Nikolaos; Doumanoglou, Alexandros; Zarpalas, Dimitrios; Daras, Petros
Publicado en: ICCV 2019, 2019
Editor: IEEE Xplore
DOI: 10.5281/zenodo.4032773

360-Degree Photo-realistic VR Conferencing

Autores: Simon N.B Gunkel, Marleen D.W. Dohmen, Hans Stokking, Omar Niamut
Publicado en: 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2019, Página(s) 946-947, ISBN 978-1-7281-1377-7
Editor: IEEE
DOI: 10.1109/vr.2019.8797971

A pipeline for multiparty volumetric video conferencing - transmission of point clouds over low latency DASH

Autores: Jack Jansen, Shishir Subramanyam, Romain Bouqueau, Gianluca Cernigliaro, Marc Martos Cabré, Fernando Pérez, Pablo Cesar
Publicado en: Proceedings of the 11th ACM Multimedia Systems Conference, 2020, Página(s) 341-344, ISBN 9781450368452
Editor: ACM
DOI: 10.1145/3339825.3393578

[DC] Multi-user (Social) Virtual Reality Commnunication

Autores: Simon N.B. Gunkel
Publicado en: 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2019, Página(s) 1359-1360, ISBN 978-1-7281-1377-7
Editor: IEEE
DOI: 10.1109/vr.2019.8797877

Measuring and Understanding Photo Sharing Experiences in Social Virtual Reality

Autores: Jie Li, Yiping Kong, Thomas Röggla, Francesca De Simone, Swamy Ananthanarayan, Huib de Ridder, Abdallah El Ali, Pablo Cesar
Publicado en: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI '19, 2019, Página(s) 1-14, ISBN 9781450359702
Editor: ACM Press
DOI: 10.1145/3290605.3300897

Social VR: A New Medium for Remote Communication and Collaboration

Autores: Li, J., Vinayagamoorthy, V., Williamson, J., Shamma, D. A. & Cesar, P.
Publicado en: Proceedings of ACM CHI2021 Conference on Human Factors in Computing Systems, 2021
Editor: Proceedings of ACM CHI2021 Conference on Human Factors in Computing Systems

A Social VR Clinic for Knee Arthritis Patients with Haptics

Autores: Tong Xue, Jie Li, Guo Chen, and Pablo Cesar
Publicado en: IMX-20, 2020
Editor: IMX-20
DOI: 10.6084/m9.figshare.12479204.v2

Social VR: A New Medium for Remote Communication and Collaboration

Autores: Jie Li, Vinoba Vinayagamoorthy, Raz Schwartz, Wijnand IJsselsteijn, David A. Shamma, Pablo Cesar
Publicado en: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, 2020, Página(s) 1-8, ISBN 9781450368193
Editor: ACM
DOI: 10.1145/3334480.3375160

CakeVR: A Social Virtual Reality (VR) Tool for Co-designing Cakes

Autores: Mei, Y., Li, J., De Ridder, H. & Cesar, P.
Publicado en: Proceedings of ACM CHI2021 Conference on Human Factors in Computing Systems, 2021
Editor: Proceedings of ACM CHI2021 Conference on Human Factors in Computing Systems

Understanding User Proxemics and Social Formations in an Instrumented Virtual Reality Workshop

Autores: Williamson, J., Li, J., Shamma, D.A., Vinayagamoorthy, V. & Cesar, P.
Publicado en: Proceedings of ACM CHI2021 Conference on Human Factors in Computing Systems, 2021
Editor: Proceedings of ACM CHI2021 Conference on Human Factors in Computing Systems

Measuring User Quality of Experience in Social VR systems

Autores: Francesca De Simone
Publicado en: Proceedings of the 3rd International Workshop on Multimedia Alternate Realities - AltMM'18, 2018, Página(s) 25-26, ISBN 9781450359795
Editor: ACM Press
DOI: 10.1145/3268998.3277702

Comparing the Quality of Highly Realistic Digital Humans in 3DoF and 6DoF: A Volumetric Video Case Study

Autores: Shishir Subramanyam, Jie Li, Irene Viola, Pablo Cesar
Publicado en: 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2020, Página(s) 127-136, ISBN 978-1-7281-5608-8
Editor: IEEE
DOI: 10.1109/vr46266.2020.00031

Open-source software tools for measuring resources consumption and DASH metrics

Autores: Mario Montagud, Juan Antonio De Rus, Rafael Fayos-Jordan, Miguel Garcia-Pineda, Jaume Segura-Garcia
Publicado en: Proceedings of the 11th ACM Multimedia Systems Conference, 2020, Página(s) 261-266, ISBN 9781450368452
Editor: ACM
DOI: 10.1145/3339825.3394931

VR Conferencing: communicating and collaborating in photo-realistic social immersive environments

Autores: F. De Simone, J. Li, A. El Ali, H. Galvan, S. Gunkel, P. Cesar
Publicado en: ConVRgence 3 Days Scientific Conference, 2019, Página(s) 45-46, ISBN 978-2-9566251-2-4
Editor: Laval Virtual
DOI: 10.5281/zenodo.4036168

Temporal Interpolation of Dynamic Digital Humans using Convolutional Neural Networks

Autores: Irene Viola, Jelmer Mulder, Francesca De Simone, Pablo Cesar
Publicado en: 2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR), 2019, Página(s) 90-907, ISBN 978-1-7281-5604-0
Editor: IEEE
DOI: 10.1109/aivr46125.2019.00022

A Color-Based Objective Quality Metric for Point Cloud Contents

Autores: Irene Viola, Shishir Subramanyam, Pablo Cesar
Publicado en: 2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX), 2020, Página(s) 1-6, ISBN 978-1-7281-5965-2
Editor: IEEE
DOI: 10.1109/qomex48832.2020.9123089

Multi-sensor capture and network processing for virtual reality conferencing

Autores: Sylvie Dijkstra-Soudarissanane, Karim El Assal, Simon Gunkel, Frank ter Haar, Rick Hindriks, Jan Willem Kleinrouweler, Omar Niamut
Publicado en: Proceedings of the 10th ACM Multimedia Systems Conference, 2019, Página(s) 316-319, ISBN 9781450362979
Editor: ACM
DOI: 10.1145/3304109.3323838

Experiencing Virtual Reality Together - Social VR Use Case Study

Autores: Simon Gunkel, Hans Stokking, Martin Prins, Omar Niamut, Ernestasia Siahaan, Pablo Cesar
Publicado en: Proceedings of the 2018 ACM International Conference on Interactive Experiences for TV and Online Video - TVX '18, 2018, Página(s) 233-238, ISBN 9781-450351157
Editor: ACM Press
DOI: 10.1145/3210825.3213566

Convergence between TV and VR: Enabling Truly Immersive and Social Experience

Autores: Mario Montagud, Juan A. Núñez, Themistoklis Karavellas, Ibai Jurado, Sergi Fernández
Publicado en: ACM TVX2018, 2018
Editor: ACM TVX2018
DOI: 10.5281/zenodo.4032839

Attention-Enhanced Sensorimotor Object Recognition

Autores: Spyridon Thermos, Georgios Th. Papadopulos, Petros Daras, Gerasimos Potamianos
Publicado en: 2018 25th IEEE International Conference on Image Processing (ICIP), 2018, Página(s) 336-340, ISBN 978-1-4799-7061-2
Editor: IEEE
DOI: 10.1109/icip.2018.8451158

Subjective Visual Quality Assessment of Immersive 3D Media Compressed by Open-Source Static 3D Mesh Codecs

Autores: Kyriaki Christaki, Emmanouil Christakis, Petros Drakoulis, Alexandros Doumanoglou, Nikolaos Zioulis, Dimitrios Zarpalas, and Petros Daras
Publicado en: 25th International Conference on MultiMedia Modeling (MMM), Thessaloniki, Greece, January 8-11, 2019., 2018
Editor: Visual Computing lab
DOI: 10.29007/ms1v

Virtual reality conferencing - multi-user immersive VR experiences on the web

Autores: Simon N. B. Gunkel, Hans M. Stokking, Martin J. Prins, Nanda van der Stap, Frank B. ter Haar, Omar A. Niamut
Publicado en: Proceedings of the 9th ACM Multimedia Systems Conference, 2018, Página(s) 498-501, ISBN 9781450351928
Editor: ACM
DOI: 10.1145/3204949.3208115

Let’s Get in Touch! Adding Haptics to Social VR

Autores: Leonor Fermoselle, Simon Gunkel, Frank ter ter Haar, Sylvie Dijkstra-Soudarissanane, Alexander Toet, Omar Niamut, Nanda van van der Stap
Publicado en: ACM International Conference on Interactive Media Experiences, Edición (pre-print available), 2020, Página(s) 174-179, ISBN 9781450379762
Editor: ACM
DOI: 10.1145/3391614.3399396

Watching Videos Together in Social Virtual Reality: An Experimental Study on User's QoE

Autores: Francesca De Simone, Jie Li, Henrique Galvan Debarba, Abdallah El Ali, Simon N.B Gunkel, Pablo Cesar
Publicado en: 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2019, Página(s) 890-891, ISBN 978-1-7281-1377-7
Editor: IEEE
DOI: 10.1109/vr.2019.8798264

User Centered Adaptive Streaming of Dynamic Point Clouds with Low Complexity Tiling

Autores: Shishir Subramanyam, Irene Viola, Alan Hanjalic, Pablo Cesar
Publicado en: Proceedings of the 28th ACM International Conference on Multimedia, 2020, Página(s) 3669-3677, ISBN 9781450379885
Editor: ACM
DOI: 10.1145/3394171.3413535

Augmented VR

Autores: Antonis Karakottas, Alexandros Papachristou, Alexandros Doumanoqlou, Nikolaos Zioulis, Dimitrios Zarpalas, Petros Daras
Publicado en: 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2018, Página(s) 1-1, ISBN 978-1-5386-3365-6
Editor: IEEE
DOI: 10.1109/vr.2018.8446561

Designing a Social VR Clinic for Medical Consultations

Autores: Jie Li, Guo Chen, Huib de Ridder, Pablo Cesar
Publicado en: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, 2020, Página(s) 1-9, ISBN 9781450368193
Editor: ACM
DOI: 10.1145/3334480.3382836

Everyday photo-realistic social VR: communicate and collaborate with an enhanced co-presence and immersion

Autores: Simon NB Gunkel; Hans Stokking; Tom De Koninck; Omar Niamut
Publicado en: Proceedings of International Broadcast Conference (IBC 2019), 2019
Editor: Proceedings of International Broadcast Conference (IBC 2019)
DOI: 10.5281/zenodo.4040503

Realidad Virtual inmersiva. Un mundo de posibilidades(Case study at the Museo Thyssen-Bornemisza)

Autores: Ana Revilla, Ignacio Lacosta
Publicado en: Arte, Patrimonio y Tecnología en la Era Digital, 2019, Página(s) 427-436, ISBN 978848380411
Editor: Gobierno de Aragón
DOI: 10.5281/zenodo.4036250

Space Wars: An AugmentedVR Game

Autores: Kyriaki Christaki, Konstantinos C. Apostolakis, Alexandros Doumanoglou, Nikolaos Zioulis, Dimitrios Zarpalas, Petros Daras
Publicado en: MultiMedia Modeling - 25th International Conference, MMM 2019, Thessaloniki, Greece, January 8–11, 2019, Proceedings, Part II, Edición 11296, 2019, Página(s) 566-570, ISBN 978-3-030-05715-2
Editor: Springer International Publishing
DOI: 10.1007/978-3-030-05716-9_47

Deep sensorimotor learning for RGB-D object recognition

Autores: Spyridon Thermos, Georgios Th. Papadopoulos, Petros Daras, Gerasimos Potamianos
Publicado en: Computer Vision and Image Understanding, Edición 190, 2020, Página(s) 102844, ISSN 1077-3142
Editor: Academic Press
DOI: 10.1016/j.cviu.2019.102844

A Reduced Reference Metric for Visual Quality Evaluation of Point Cloud Contents

Autores: Irene Viola, Pablo Cesar
Publicado en: IEEE Signal Processing Letters, Edición 27, 2020, Página(s) 1660-1664, ISSN 1070-9908
Editor: Institute of Electrical and Electronics Engineers
DOI: 10.1109/lsp.2020.3024065

HUMAN4D: A Human-Centric Multimodal Dataset for Motions and Immersive Media

Autores: Anargyros Chatzitofis, Leonidas Saroglou, Prodromos Boutis, Petros Drakoulis, Nikolaos Zioulis, Shishir Subramanyam, Bart Kevelham, Caecilia Charbonnier, Pablo Cesar, Dimitrios Zarpalas, Stefanos Kollias, Petros Daras
Publicado en: IEEE Access, Edición 8, 2020, Página(s) 176241-176262, ISSN 2169-3536
Editor: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2020.3026276

TogetherVR: A Framework for Photorealistic Shared Media Experiences in 360-Degree VR

Autores: Martin J. Prins, Simon N. B. Gunkel, Hans M. Stokking, Omar A. Niamut
Publicado en: SMPTE Motion Imaging Journal, Edición 127/7, 2018, Página(s) 39-44, ISSN 1545-0279
Editor: Society of Motion and Television Engineers
DOI: 10.5594/JMI.2018.2840618

Social viewing in cinematic virtual reality: a design space for social movie applications

Autores: Sylvia Rothe, Alexander Schmidt, Mario Montagud, Daniel Buschek, Heinrich Hußmann
Publicado en: Virtual Reality, 2020, ISSN 1359-4338
Editor: Springer London
DOI: 10.1007/s10055-020-00472-4

DeepMoCap: Deep Optical Motion Capture Using Multiple Depth Sensors and Retro-Reflectors

Autores: Anargyros Chatzitofis, Dimitrios Zarpalas, Stefanos Kollias, Petros Daras
Publicado en: Sensors, Edición 19/2, 2019, Página(s) 282, ISSN 1424-8220
Editor: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/s19020282

On the Plausibility of Virtual Body Animation Features in Virtual Reality

Autores: Henrique Galvan Debarba, Sylvain Chagué, Caecilia Charbonnier
Publicado en: IEEE Transactions on Visualization & Computer Graphics, Edición (pre-print available), 2020, Página(s) tbd, ISSN 1077-2626
Editor: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tvcg.2020.3025175

Resultado final

Publicaciones

Compartir esta página Compartir esta página en las redes sociales

Descargar Descargar el contenido de la página