Levitation with localised tactile and audio feedback for mid-air interactions

Informacje na temat projektu

Levitate

Identyfikator umowy o grant: 737087

DOI

10.3030/737087

Projekt został zamknięty

Data podpisania przez KE 8 Grudnia 2016

Data rozpoczęcia 1 Stycznia 2017

Data zakończenia 31 Marca 2021

Finansowanie w ramach

• EXCELLENT SCIENCE - Future and Emerging Technologies (FET)

Koszt całkowity

€ 2 999 870,00

Wkład UE

€ 2 999 870,00

Koordynowany przez

UNIVERSITY OF GLASGOW
United Kingdom

CORDIS oferuje możliwość skorzystania z odnośników do publicznie dostępnych publikacji i rezultatów projektów realizowanych w ramach programów ramowych HORYZONT.

Odnośniki do rezultatów i publikacji związanych z poszczególnymi projektami 7PR, a także odnośniki do niektórych konkretnych kategorii wyników, takich jak zbiory danych i oprogramowanie, są dynamicznie pobierane z systemu OpenAIRE .

Rezultaty

Demonstrators, pilots, prototypes (10)

Demonstrator v1 illustrating interaction techniques for atomic selection action
Demonstrator v3 presenting two applications combining all modalities
A working prototype of the transducer array with haptics + audio + visual

The software API concept will be taken from Python toolbox D12 requirements regarding functionality will be identified in WP3 and WP4

"Organization of demonstrators and workshops as part of outreach activities #1"

Organization of demonstrators and workshops as part of outreach activities

"Organization of demonstrators and workshops as part of outreach activities #3"

Organization of demonstrators and workshops as part of outreach activities 3

Demonstrator v2 illustrating interaction techniques for positioning, rotation, scaling and deformation
"Organization of demonstrators and workshops as part of outreach activities #4"
Prototype with levitation + haptics + visual

requirements for this identified in WP3 and WP4

"Organization of demonstrators and workshops as part of outreach activities #2"

Organization of demonstrators and workshops as part of outreach activities 2

Prototype with all modalities

API concept taken from D1.2; requirements identified in WP3 and WP4

Websites, patent fillings, videos etc. (1)

Website and logo. weekly social media tweets/updates

Outwardfacing and internal website weekly social media tweets

Open Research Data Pilot (1)

Data managment plan

plan on how we will manage data generated from the project

Documents, reports (5)

Report on multisensory integration, including ventriloquism and interaction techniques

Report on multisensory integration, including ventriloquism eddefct

Database of broadband radiation characteristics across multiple transducer types
Evaluation report on final demonstrators

Evaluation report on demonstrators

Catalogue of effective haptic experiences, together with guidelines on how to create them

Catalogue of effective haptic experiences together with guidelines on how to create them

Signal processing model for de-modulating non-linearity for a range of operating points

Other (2)

Python toolbox of sound field/beamformer design methods

This will support the full functionality and API of the realtime implementations in WP2

Python tool box - final version

Publikacje

Conference proceedings (29)

HaptiRead - Reading Braille as Mid-Air Haptic Information

Autorzy: Viktorija Paneva, Sofia Seinfeld, Michael Kraiczi, Jörg Müller
Opublikowane w: Proceedings of the 2020 ACM Designing Interactive Systems Conference, 2020, Strona(/y) 13-20, ISBN 9781450369749
Wydawca: ACM
DOI: 10.1145/3357236.3395515

Measurement-Based Modeling of Higher-Order Non-Linearities of the Parametric Loudspeaker

Autorzy: Carl Andersson, Jens Ahrens
Opublikowane w: 'Fortschritte der Akustik - DAGA 2019, Numer 2019, 2019, Strona(/y) 330-333, ISBN 978-3-939296-14-0
Wydawca: DEGA

Levitation Simulator: Prototyping Ultrasonic Levitation Interfaces in Virtual Reality

Autorzy: Viktorija Paneva, Myroslav Bachynskyi, Jörg Müller
Opublikowane w: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 2020, Strona(/y) 1-12, ISBN 9781450367080
Wydawca: ACM
DOI: 10.1145/3313831.3376409

UltraPower: Powering Tangible & Wearable Devices with Focused Ultrasound

Autorzy: Rafael Morales González, Asier Marzo, Euan Freeman, William Frier, Orestis Georgiou
Opublikowane w: Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction, 2021, Strona(/y) 1-13, ISBN 9781450382137
Wydawca: ACM
DOI: 10.1145/3430524.3440620

Floating Widgets - Interaction with Acoustically-Levitated Widgets

Autorzy: Euan Freeman, Ross Anderson, Carl Andersson, Julie Williamson, Stephen Brewster
Opublikowane w: Proceedings of the Interactive Surfaces and Spaces on ZZZ - ISS '17, 2017, Strona(/y) 417-420, ISBN 9781-450346917
Wydawca: ACM Press
DOI: 10.1145/3132272.3132294

Levitate - interaction with floating particle displays

Autorzy: Julie R. Williamson, Euan Freeman, Stephen Brewster
Opublikowane w: Proceedings of the 6th ACM International Symposium on Pervasive Displays - PerDis '17, 2017, Strona(/y) 1-2, ISBN 9781-450350457
Wydawca: ACM Press
DOI: 10.1145/3078810.3084347

TastyFloats - A Contactless Food Delivery System

Autorzy: Chi Thanh Vi, Asier Marzo, Damien Ablart, Gianluca Memoli, Sriram Subramanian, Bruce Drinkwater, Marianna Obrist
Opublikowane w: Proceedings of the Interactive Surfaces and Spaces on ZZZ - ISS '17, 2017, Strona(/y) 161-170, ISBN 9781-450346917
Wydawca: ACM Press
DOI: 10.1145/3132272.3134123

Textured surfaces for ultrasound haptic displays

Autorzy: Euan Freeman, Ross Anderson, Julie Williamson, Graham Wilson, Stephen A. Brewster
Opublikowane w: Proceedings of the 19th ACM International Conference on Multimodal Interaction - ICMI 2017, 2017, Strona(/y) 491-492, ISBN 9781-450355438
Wydawca: ACM Press
DOI: 10.1145/3136755.3143020

Point-and-Shake - Selecting from Levitating Object Displays

Autorzy: Euan Freeman, Julie Williamson, Sriram Subramanian, Stephen Brewster
Opublikowane w: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18, 2018, Strona(/y) 1-10, ISBN 9781-450356206
Wydawca: ACM Press
DOI: 10.1145/3173574.3173592

Touchless Tactile Displays for Digital Signage - Mid-air Haptics meets Large Screens

Autorzy: Loic Corenthy, Sriram Subramanian, Marcello Giordano, Richard Hayden, Daniel Griffiths, Craig Jeffrey, Hannah Limerick, Orestis Georgiou, Tom Carter, Jörg Müller
Opublikowane w: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18, 2018, Strona(/y) 1-4, ISBN 9781450356213
Wydawca: ACM Press
DOI: 10.1145/3170427.3186533

A Method for Simultaneous Creation of an Acoustic Trap and a Quiet Zone

Autorzy: Carl Andersson, Jens Ahrens
Opublikowane w: 2018 IEEE 10th Sensor Array and Multichannel Signal Processing Workshop (SAM), 2018, Strona(/y) 622-626, ISBN 978-1-5386-4752-3
Wydawca: IEEE
DOI: 10.1109/sam.2018.8448949

Levitating Particle Displays with Interactive Voxels

Autorzy: Euan Freeman, Julie R. Williamson, Praxitelis Kourtelos, Stephen Brewster
Opublikowane w: Proceedings of the 7th ACM International Symposium on Pervasive Displays - PerDis '18, 2018, Strona(/y) 1-6, ISBN 9781-450357654
Wydawca: ACM Press
DOI: 10.1145/3205873.3205878

Pulsed schlieren imaging of ultrasonic haptics and levitation using phased arrays

Autorzy: Michele Iodice, William Frier, William Frier, James Wilcox, Ben Long, Orestis Georgiou
Opublikowane w: Proceedings of the ICSV 2018, Numer 2018, 2018
Wydawca: Elsevier / SCOPUS

LeviCursor - Dexterous Interaction with a Levitating Object

Autorzy: Myroslav Bachynskyi, Viktorija Paneva, Jörg Müller
Opublikowane w: Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces - ISS '18, 2018, Strona(/y) 253-262, ISBN 9781450356947
Wydawca: ACM Press
DOI: 10.1145/3279778.3279802

Touchless Haptic Feedback for VR Rhythm Games

Autorzy: Orestis Georgiou, Craig Jeffrey, Ziyuan Chen, Bao Xiao Tong, Shing Hei Chan, Boyin Yang, Adam Harwood, Tom Carter
Opublikowane w: 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2018, Strona(/y) 553-554, ISBN 978-1-5386-3365-6
Wydawca: IEEE
DOI: 10.1109/vr.2018.8446619

Fibonacci Spiral Arranged Ultrasound Phased Array for Mid-Air Haptics

Autorzy: Adam Price, Benjamin Long
Opublikowane w: 2018 IEEE International Ultrasonics Symposium (IUS), 2018, Strona(/y) 1-4, ISBN 978-1-5386-3425-7
Wydawca: IEEE
DOI: 10.1109/ultsym.2018.8580072

SoundBender - Dynamic Acoustic Control Behind Obstacles

Autorzy: Mohd Adili Norasikin, Diego Martinez Plasencia, Spyros Polychronopoulos, Gianluca Memoli, Yutaka Tokuda, Sriram Subramanian
Opublikowane w: The 31st Annual ACM Symposium on User Interface Software and Technology - UIST '18, Numer 2018, 2018, Strona(/y) 247-259, ISBN 9781-450359481
Wydawca: ACM Press
DOI: 10.1145/3242587.3242590

Acoustic Levitation from Superposition of Spherical Harmonics Expansions of Elementary Sources: Analysis of Dependency on Wavenumber and Order

Autorzy: Carl Andersson, Jens Ahrens
Opublikowane w: 2019 IEEE International Ultrasonics Symposium (IUS), Numer 2019, 2019, Strona(/y) 920-923, ISBN 978-1-7281-4596-9
Wydawca: IEEE
DOI: 10.1109/ultsym.2019.8926167

Enhancing physical objects with actuated levitating particles

Autorzy: Euan Freeman, Asier Marzo, Praxitelis B. Kourtelos, Julie R. Williamson, Stephen Brewster
Opublikowane w: Proceedings of the 8th ACM International Symposium on Pervasive Displays, Numer 2019, 2019, Strona(/y) 1-7, ISBN 9781-450367516
Wydawca: ACM
DOI: 10.1145/3321335.3324939

HaptiGlow: Helping Users Position their Hands for Better Mid-Air Gestures and Ultrasound Haptic Feedback

Autorzy: Euan Freeman, Dong-Bach Vo, Stephen Brewster
Opublikowane w: 2019 IEEE World Haptics Conference (WHC), Numer 2019, 2019, Strona(/y) 289-294, ISBN 978-1-5386-9461-9
Wydawca: IEEE
DOI: 10.1109/whc.2019.8816092

Sampling Strategy for Ultrasonic Mid-Air Haptics

Autorzy: William Frier, Dario Pittera, Damien Ablart, Marianna Obrist, Sriram Subramanian
Opublikowane w: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI '19, Numer 2019, 2019, Strona(/y) 1-11, ISBN 9781-450359702
Wydawca: ACM Press
DOI: 10.1145/3290605.3300351

Three-in-one - Levitation, Parametric Audio, and Mid-Air Haptic Feedback

Autorzy: Gözel Shakeri, Euan Freeman, William Frier, Michele Iodice, Benjamin Long, Orestis Georgiou, Carl Andersson
Opublikowane w: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems - CHI EA '19, Numer 2019, 2019, Strona(/y) 1-4, ISBN 9781450359719
Wydawca: ACM Press
DOI: 10.1145/3290607.3313264

User engagement for mid-air haptic interactions with digital signage

Autorzy: Hannah Limerick, Richard Hayden, David Beattie, Orestis Georgiou, Jörg Müller
Opublikowane w: Proceedings of the 8th ACM International Symposium on Pervasive Displays, Numer 2019, 2019, Strona(/y) 1-7, ISBN 9781-450367516
Wydawca: ACM
DOI: 10.1145/3321335.3324944

Using Ultrasonic Mid-air Haptic Patterns in Multi-Modal User Experiences

Autorzy: Damien Ablart, William Frier, Hannah Limerick, Orestis Georgiou, Marianna Obrist
Opublikowane w: 2019 IEEE International Symposium on Haptic, Audio and Visual Environments and Games (HAVE), Numer 2019, 2019, Strona(/y) 1-6, ISBN 978-1-7281-2355-4
Wydawca: IEEE
DOI: 10.1109/have.2019.8920969

LeviProps - Animating Levitated Optimized Fabric Structures using Holographic Acoustic Tweezers

Autorzy: Rafael Morales, Asier Marzo, Sriram Subramanian, Diego Martínez
Opublikowane w: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology, 2019, Strona(/y) 651-661, ISBN 9781-450368162
Wydawca: ACM
DOI: 10.1145/3332165.3347882

Avoiding Collisions when Interacting with Levitating Particle Displays

Autorzy: Maxime Reynal, Euan Freeman, Stephen Brewster
Opublikowane w: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, 2020, Strona(/y) 1-7, ISBN 9781450368193
Wydawca: ACM
DOI: 10.1145/3334480.3382965

Minimum trap separation for acoustical levitation using phased ultrasonic transducer arrays

Autorzy: Carl Andersson, Jens Ahrens
Opublikowane w: Proceedings of ICA, Numer 2019, 2019, Strona(/y) 1117-1123, ISBN 978-3-939296-15-7
Wydawca: DEGA
DOI: 10.18154/rwth-conv-239242

Levi-loop: A Mid-Air Gesture Controlled Levitating Particle Game

Autorzy: Rafael Morales González, Euan Freeman, Orestis Georgiou
Opublikowane w: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, 2020, Strona(/y) 1-4, ISBN 9781450368193
Wydawca: ACM
DOI: 10.1145/3334480.3383152

Reducing Spiraling in Transducer Array Based Acoustic Levitation

Autorzy: Carl Andersson, Jens Ahrens
Opublikowane w: 2020 IEEE International Ultrasonics Symposium (IUS), 2020, Strona(/y) 1-4, ISBN 978-1-7281-5448-0
Wydawca: IEEE
DOI: 10.1109/ius46767.2020.9251489

Peer reviewed articles (6)

Impact of Information Placement and User Representations in VR on Performance and Embodiment

Autorzy: Sofia Seinfeld, Tiare Feuchtner, Johannes Pinzek, Jorg Muller
Opublikowane w: IEEE Transactions on Visualization and Computer Graphics, 2020, Strona(/y) 1-1, ISSN 1077-2626
Wydawca: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tvcg.2020.3021342

Acoustic levitation with optimized reflective metamaterials

Autorzy: Spyros Polychronopoulos, Gianluca Memoli
Opublikowane w: Scientific Reports, Numer 10/1, 2020, ISSN 2045-2322
Wydawca: Nature Publishing Group
DOI: 10.1038/s41598-020-60978-4

Impact of visuomotor feedback on the embodiment of virtual hands detached from the body

Autorzy: Sofia Seinfeld, Jörg Müller
Opublikowane w: Scientific Reports, Numer 10/1, 2020, ISSN 2045-2322
Wydawca: Nature Publishing Group
DOI: 10.1038/s41598-020-79255-5

User Representations in Human-Computer Interaction

Autorzy: Sofia Seinfeld, Tiare Feuchtner, Antonella Maselli, Jörg Müller
Opublikowane w: Human–Computer Interaction, Numer 2020, 2020, Strona(/y) 1-39, ISSN 0737-0024
Wydawca: Lawrence Erlbaum Associates Inc.
DOI: 10.1080/07370024.2020.1724790

A volumetric display for visual, tactile and audio presentation using acoustic trapping

Autorzy: Ryuji Hirayama, Diego Martinez Plasencia, Nobuyuki Masuda, Sriram Subramanian
Opublikowane w: Nature, Numer 575/7782, 2019, Strona(/y) 320-323, ISSN 0028-0836
Wydawca: Nature Publishing Group
DOI: 10.1038/s41586-019-1739-5

GS-PAT

Autorzy: Diego Martinez Plasencia, Ryuji Hirayama, Roberto Montano-Murillo, Sriram Subramanian
Opublikowane w: ACM Transactions on Graphics, Numer 39/4, 2020, ISSN 0730-0301
Wydawca: Association for Computing Machinary, Inc.
DOI: 10.1145/3386569.3392492

Book chapters (1)

Using Spatiotemporal Modulation to Draw Tactile Patterns in Mid-Air

Autorzy: William Frier, Damien Ablart, Jamie Chilles, Benjamin Long, Marcello Giordano, Marianna Obrist, Sriram Subramanian
Opublikowane w: Haptics: Science, Technology, and Applications, Numer 10893, 2018, Strona(/y) 270-281, ISBN 978-3-319-93444-0
Wydawca: Springer International Publishing
DOI: 10.1007/978-3-319-93445-7_24