INnovative Network for Training in ToUch InteracTIVE Interfaces

Project Information

INTUITIVE

Grant agreement ID: 861166

DOI

10.3030/861166

Project closed

EC signature date 4 September 2019

Start date 1 October 2019

End date 31 March 2024

Funded under

• EXCELLENT SCIENCE - Marie Skłodowska-Curie Actions

Total cost

€ 4 092 250,15

EU contribution

€ 4 092 250,15

Coordinated by

LUNDS UNIVERSITET
Sweden

CORDIS provides links to public deliverables and publications of HORIZON projects.

Links to deliverables and publications from FP7 projects, as well as links to some specific result types such as dataset and software, are dynamically retrieved from OpenAIRE .

Deliverables

Demonstrators, pilots, prototypes (1)

Sensors with memory

Demonstrator of the properties of the sensors based on memristive device

Documents, reports (25)

Third year research schools, workshops, & tutorials

Report on the research schools, workshops, and tutorials organized the third year of the project

Brain state estimation method

A method to combine information from 1000s of isolated neurons recorded electrophysiologically in the brain in vivo to achieve high-precision brain state estimation for brain interpretation of haptic input features

Predictive coding model of haptic sensing

Abstract model of haptic sensing integrating tactile and proprioceptive information. Predictive coding modelling of tactile sensing in rodents. Human-like computational model of haptic sensing for robots.

Third year progress report

Report on the progress for the first three years

Graphene based touch sensor and benchmarking

Fabrication of graphene based touch sensors

Taxonomy of image processing algorithms in the context of categorizing tactile graphics

Systematic analysis of ‘translating and simplifying visual to tactile graphics’ by a literature review

Design principles and basic version of the intuitive tactile user interface

Software prototype for the new user interface allowing interaction between the Tactonom and computer

Low-power sensory readout and electronic interface

Architectural study of timebased sensor readout in CMOS Circuit design and layout of a lowpower timebased sensor interface in CMOS

First year research schools, workshops, & tutorials

Report on the research schools workshops and tutorials organized the first year of the project

Human-like haptic exploration and manipulation

Comparison of robotic and human manipulation and haptic exploration

Multi-scale model of synthetic materials mimicking tactile sensing in skin

Validate in-silico model with experimental data. Use the in silico model for design and development of realistic tactile sensing skin

Principles of brain state influence on neural representation of haptic input features

Controlled manipulation of brain states via basal ganglia or corticocortical manipulation. Investigation of neural representation of haptic events across brain states

First prototype of tactile transducer for use in rodents developed

Analyse closedform electrothermal scaling laws for miniaturization Realise computer aideddesign based on the analysis and perform multiphysics simulation Implement physical miniaturized system

Haptic integration of proprioception and tactile information for robots

Implementation of predictive coding based haptic exploration with a robot hand. Complex haptic exploration (using Markov chain formalism) and manipulation.

Audio-Tactile Design Pattern Repository

Repository of designed patterns for combination of audio-output with tactile output

Classification of 2D refreshable tactile user interfaces

Literature review of the user interfaces and interaction

Integration on flexible substrates - survey and limitation of existing methods

Literature survey analysing the suitability of some of planar electronics integration methods for soft electronics. Stretchable interconnections and stiff sensor/electronics integration configuration.

softMEMS based stress and slip sensors

Design and fabrication cantilever based sensors on ultra-thin chips. Characterization of sensors for stress and slip. Embedding sensors in soft materials and connecting to electronics with transparent electrodes

Next generation sensory augmentation device

Integration of tactile stimulators in a sensory augmentation device. Design and test mapping of sensory information (orientation, distance to obstacles, dynamics of approach and recess) to degrees of freedom of sensory augmentation device (frequency domain, AM-modulation, selection of simultaneously active tactors (UOS). Usability study and validation of behavioural benefits

Embedded integration of sensors/electronics at various depths in soft substrates

Integration of sensors at various depths in soft substrates – towards 3D integration of sensor distribution.

First representation of haptic input features across a population of cortical neurons

Learning the multiple, parallel in vivo whole cell patch clamp recording technique in the neocortex of the rat. Exploring the representation of haptic input features in neocortical neurons. Tuning properties of neocortical neurons with respect to the haptic input features representation of haptic input features across a population of cortical neurons.

Learning classifier system for high-dimensional sensorimotor data

Characterization of neuromimetic sensorimotor processing. Identification of tactile interaction invariants. Implement learning classifier system for high-dimensional data

Design guidelines for representing audio-tactile graphics on a two-dimensional display

Employ deep learning to categorise certain types of graphics. Development of a prototype to translate visual to tactile information. Evaluate the system with blind users on a two-dimensional tactile display. Investigate the combination of audio-output with tactile output.

Second year research schools, workshops, & tutorials

Report on the research schools, workshops, and tutorials organized the second year of the project.

Report on molecular scale mechanism of mechanoreceptors in skin

Develop molecular scale model of mechanoreceptors of the skin. Incorporate biomimetic mechanoreceptor models in synthetic material to be used for artificial skin.

Other (3)

Advertising Vacancies

Standardized advertisement for ESR recruitment

Project Website; Welcome kit

Project website and a popularized version of the overall aims and research of INTUITIVE to be provided to ESRs at the start of their training.

Supervisory board

Supervisory board appointed

Open Research Data Pilot (1)

Data Management Plan

Guidlines for Open Data Management within the project

Publications

Conference proceedings (11)

Sensitivity Analysis of ZnO NWs Based Soft Capacitive Pressure Sensors Using Finite Element Modeling

Author(s): Shashank Mishra; Mahdieh Shojaei Baghini; Dhayalan Shakthivel; Beena Rai; Ravinder Dahiya
Published in: 2022
Publisher: IEEE
DOI: 10.1109/fleps53764.2022.9781566

Accessible Document Layout: An Interface for 2D Tactile Displays

Author(s): Omar Moured, Sara Alzalabny, Thorsten Schwarz, Bastian Rapp, Rainer Stiefelhagen
Published in: 2023
Publisher: Association for Computing Machinery
DOI: 10.1145/3594806.3594811

End-to-End Optimization of High-Density e-Skin Design: From Spiking Taxel Readout to Texture Classification

Author(s): Jiaqi Wang; Mark Daniel Alea; Jonah Van Assche; Georges G.E. Gielen
Published in: 2023 Design, Automation & Test in Europe Conference & Exhibition (DATE), 2023, ISBN 979-8-3503-9624-9
Publisher: IEEE
DOI: 10.23919/date56975.2023.10137077

Concurrent Haptic, Audio, and Visual Data Set During Bare Finger Interaction with Textured Surfaces

Author(s): Alexis Devillard; Aruna Ramasamy; Damien Faux; Vincent Hayward; Etienne Burdet
Published in: 2023, ISBN 979-8-3503-9994-3
Publisher: IEEE
DOI: 10.1109/whc56415.2023.10224372

Power-Efficient and Accurate Texture Sensing Using Spiking Readouts for High-Density e-Skins

Author(s): Mark Daniel Alea; Ali Safa; Jonah Van Assche; Georges G. E. Gielen
Published in: 2022 IEEE Biomedical Circuits and Systems Conference (BioCAS), 2022, ISBN 9781665469173
Publisher: IEEE
DOI: 10.1109/biocas54905.2022.9948546

Classification of 2d Refreshable Tactile User Interfaces

Author(s): Ramôa, Gaspar
Published in: 2022, ISBN 9783950499780
Publisher: Association ICCHP
DOI: 10.35011/icchp-aaate22-p1-24

Human Self-touch vs Other-Touch Resolved by Machine Learning

Author(s): Aruna Ramasamy, Damien Faux, Vincent Hayward, Malika Auvray, Xavier Job & Louise Kirsch
Published in: Haptics: Science, Technology, Applications, 2022, ISBN 978-3-031-06248-3
Publisher: Springer, Cham
DOI: 10.1007/978-3-031-06249-0_25

A Fingertip-Mimicking 12×16 200μm-Resolution e-skin Taxel Readout Chip with per-Taxel Spiking Readout and Embedded Receptive Field Processing

Author(s): Mark Daniel Alea; Ali Safa; Flavio Giacomozzi; Andrea Adami; Inci Rüya Temel; Leandro Lorenzelli; Georges Gielen
Published in: 2023 IEEE Symposium on VLSI Technology and Circuits (VLSI Technology and Circuits), 2023
Publisher: IEEE
DOI: 10.23919/vlsitechnologyandcir57934.2023.10185346

Chart4Blind: An Intelligent Interface for Chart Accessibility Conversion

Author(s): Omar Moured , Morris Baumgarten-Egemole , Karin Müller , Alina Roitberg , Thorsten Schwarz , Rainer Stiefelhagen
Published in: 2024
Publisher: Association for Computing Machinery
DOI: 10.1145/3640543.3645175

Push to Know! - Visuo-Tactile Based Active Object Parameter Inference with Dual Differentiable Filtering

Author(s): Anirvan Dutta; Etienne Burdet; Mohsen Kaboli
Published in: 2023
Publisher: IEEE
DOI: 10.1109/iros55552.2023.10341832

Line Graphics Digitization: A Step Towards Full Automation

Author(s): Omar Moured, Jiaming Zhang, Alina Roitberg, Thorsten Schwarz, Rainer Stiefelhagen
Published in: 2023
Publisher: Springer, Cham
DOI: 10.48550/arxiv.2307.02065

Peer reviewed articles (11)

Capacitive-triboelectric based hybrid sensor system for human-like tactile perception

Author(s): Mishra, S. , Nair, N. M. , Khandelwal, G. , Rai, B. and Georgiev, V.
Published in: IEEE Sensors Letters, 2024, ISSN 2475-1472
Publisher: IEEE
DOI: 10.1109/lsens.2024.3351692

Ultra-Thin Chips with ISFET Array for Continuous Monitoring of Body Fluids pH

Author(s): Mahdieh Shojaei Baghini; Anastasios Vilouras; Ravinder Dahiya
Published in: IEEE Transactions on Biomedical Circuits and Systems, 2021, ISSN 1932-4545
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tbcas.2022.3141553

Active visuo-tactile interactive robotic perception for accurate object pose estimation in dense clutter

Author(s): Prajval Kumar Murali, Anirvan Dutta, Michael Gentner, Etienne Burdet, Ravinder Dahiya, Mohsen Kaboli
Published in: IEEE Robotics and Automation Letters, 2022, ISSN 2377-3766
Publisher: IEEE
DOI: 10.1109/lra.2022.3150045

Developing Dynamic Audio Navigation UIs to Pinpoint Elements in Tactile Graphics

Author(s): Gaspar Ramôa, Vincent Schmidt and Peter König
Published in: Multimodal Technol. Interact., 2022, ISSN 2414-4088
Publisher: MDPI
DOI: 10.3390/mti6120113

Local field potential sharp waves with diversified impact on cortical neuronal encoding of haptic input

Author(s): Sofie S. Kristensen, Henrik Jörntell
Published in: Scientific Reports, 2024, ISSN 2045-2322
Publisher: Nature Publishing Group
DOI: 10.1038/s41598-024-65200-3

Improved Spatial Knowledge Acquisition through Sensory Augmentation

Author(s): Vincent Schmidt, Sabine U. König, Rabia Dilawar, Tracy Sánchez Pacheco and Peter König
Published in: Brain Science, Issue 13, 720, 2023, ISSN 2076-3425
Publisher: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/brainsci13050720

Bioinspired Distributed Energy in Robotics and Enabling Technologies

Author(s): Rudra Mukherjee, Priyanka Ganguly, Ravinder Dahiya
Published in: Advanced Intelligent Systems, 2021, ISSN 2640-4567
Publisher: Wiley
DOI: 10.1002/aisy.202100036

Differential encoding of temporally evolving color patterns across nearby V1 neurons

Author(s): Sofie Skårup Kristensen; Henrik Jörntell
Published in: Front. Cell. Neurosci, 2023, ISSN 1662-5102
Publisher: Frontiers Research Foundation
DOI: 10.3389/fncel.2023.1249522

Neuromorphic Near-Sensor Computing: From Event-Based Sensing to Edge Learning

Author(s): Ali Safa; Jonah Van Assche; Mark Daniel Alea; Francky Catthoor; Georges G.E. Gielen
Published in: IEEE Micro, Issue 42; 6, 2022, Page(s) 88-95, ISSN 0272-1732
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/mm.2022.3195634

Ultra‐High Gauge Factor Strain Sensor with Wide‐Range Stretchability

Author(s): Yogeenth Kumaresan, Shashank Mishra, Oliver Ozioko, Radu Chirila, Ravinder Dahiya
Published in: Advanced Intelligent Systems, 2022, ISSN 2640-4567
Publisher: Wiley
DOI: 10.1002/aisy.202200043

Distributed Tactile Display with Dual Array Design

Author(s): Yerkebulan Massalim; Damien Faux; Vincent Hayward
Published in: IEEE Transactions on Haptics, 2023, ISSN 2329-4051
Publisher: IEEE
DOI: 10.1109/toh.2023.3254373

Other (2)

High-dimensional cortical signals reveal rich bimodal and working memory-like representations among S1 neuron populations

Author(s): Sofie S. Kristensen, Kaan Kesgin, Henrik Jörntell
Published in: BioRxiv, 2024
Publisher: Cold Spring Harbor Laboratory
DOI: 10.1101/2024.01.26.577171

Singular superlet transform achieves markedly improved time-frequency super-resolution for separating complex neural signals

Author(s): Kaan Kesgin, Henrik Jörntell
Published in: BioRxiv, 2023
Publisher: Cold Spring Harbor Laboratory
DOI: 10.1101/2023.02.27.530211