INnovative Network for Training in ToUch InteracTIVE Interfaces

Información del proyecto

INTUITIVE

Identificador del acuerdo de subvención: 861166

DOI

10.3030/861166

Proyecto cerrado

Fecha de la firma de la CE 4 Septiembre 2019

Fecha de inicio 1 Octubre 2019

Fecha de finalización 31 Marzo 2024

Financiado con arreglo a

• EXCELLENT SCIENCE - Marie Skłodowska-Curie Actions

Coste total

€ 4 092 250,15

Aportación de la UE

€ 4 092 250,15

Coordinado por

LUNDS UNIVERSITET
Sweden

CORDIS proporciona enlaces a los documentos públicos y las publicaciones de los proyectos de los programas marco HORIZONTE.

Los enlaces a los documentos y las publicaciones de los proyectos del Séptimo Programa Marco, así como los enlaces a algunos tipos de resultados específicos, como conjuntos de datos y «software», se obtienen dinámicamente de OpenAIRE .

Resultado final

Demonstrators, pilots, prototypes (1)

Sensors with memory

Demonstrator of the properties of the sensors based on memristive device

Documents, reports (25)

Third year research schools, workshops, & tutorials

Report on the research schools, workshops, and tutorials organized the third year of the project

Brain state estimation method

A method to combine information from 1000s of isolated neurons recorded electrophysiologically in the brain in vivo to achieve high-precision brain state estimation for brain interpretation of haptic input features

Predictive coding model of haptic sensing

Abstract model of haptic sensing integrating tactile and proprioceptive information. Predictive coding modelling of tactile sensing in rodents. Human-like computational model of haptic sensing for robots.

Third year progress report

Report on the progress for the first three years

Graphene based touch sensor and benchmarking

Fabrication of graphene based touch sensors

Taxonomy of image processing algorithms in the context of categorizing tactile graphics

Systematic analysis of ‘translating and simplifying visual to tactile graphics’ by a literature review

Design principles and basic version of the intuitive tactile user interface

Software prototype for the new user interface allowing interaction between the Tactonom and computer

Low-power sensory readout and electronic interface

Architectural study of timebased sensor readout in CMOS Circuit design and layout of a lowpower timebased sensor interface in CMOS

First year research schools, workshops, & tutorials

Report on the research schools workshops and tutorials organized the first year of the project

Human-like haptic exploration and manipulation

Comparison of robotic and human manipulation and haptic exploration

Multi-scale model of synthetic materials mimicking tactile sensing in skin

Validate in-silico model with experimental data. Use the in silico model for design and development of realistic tactile sensing skin

Principles of brain state influence on neural representation of haptic input features

Controlled manipulation of brain states via basal ganglia or corticocortical manipulation. Investigation of neural representation of haptic events across brain states

First prototype of tactile transducer for use in rodents developed

Analyse closedform electrothermal scaling laws for miniaturization Realise computer aideddesign based on the analysis and perform multiphysics simulation Implement physical miniaturized system

Haptic integration of proprioception and tactile information for robots

Implementation of predictive coding based haptic exploration with a robot hand. Complex haptic exploration (using Markov chain formalism) and manipulation.

Audio-Tactile Design Pattern Repository

Repository of designed patterns for combination of audio-output with tactile output

Classification of 2D refreshable tactile user interfaces

Literature review of the user interfaces and interaction

Integration on flexible substrates - survey and limitation of existing methods

Literature survey analysing the suitability of some of planar electronics integration methods for soft electronics. Stretchable interconnections and stiff sensor/electronics integration configuration.

softMEMS based stress and slip sensors

Design and fabrication cantilever based sensors on ultra-thin chips. Characterization of sensors for stress and slip. Embedding sensors in soft materials and connecting to electronics with transparent electrodes

Next generation sensory augmentation device

Integration of tactile stimulators in a sensory augmentation device. Design and test mapping of sensory information (orientation, distance to obstacles, dynamics of approach and recess) to degrees of freedom of sensory augmentation device (frequency domain, AM-modulation, selection of simultaneously active tactors (UOS). Usability study and validation of behavioural benefits

Embedded integration of sensors/electronics at various depths in soft substrates

Integration of sensors at various depths in soft substrates – towards 3D integration of sensor distribution.

First representation of haptic input features across a population of cortical neurons

Learning the multiple, parallel in vivo whole cell patch clamp recording technique in the neocortex of the rat. Exploring the representation of haptic input features in neocortical neurons. Tuning properties of neocortical neurons with respect to the haptic input features representation of haptic input features across a population of cortical neurons.

Learning classifier system for high-dimensional sensorimotor data

Characterization of neuromimetic sensorimotor processing. Identification of tactile interaction invariants. Implement learning classifier system for high-dimensional data

Design guidelines for representing audio-tactile graphics on a two-dimensional display

Employ deep learning to categorise certain types of graphics. Development of a prototype to translate visual to tactile information. Evaluate the system with blind users on a two-dimensional tactile display. Investigate the combination of audio-output with tactile output.

Second year research schools, workshops, & tutorials

Report on the research schools, workshops, and tutorials organized the second year of the project.

Report on molecular scale mechanism of mechanoreceptors in skin

Develop molecular scale model of mechanoreceptors of the skin. Incorporate biomimetic mechanoreceptor models in synthetic material to be used for artificial skin.

Other (3)

Advertising Vacancies

Standardized advertisement for ESR recruitment

Project Website; Welcome kit

Project website and a popularized version of the overall aims and research of INTUITIVE to be provided to ESRs at the start of their training.

Supervisory board

Supervisory board appointed

Open Research Data Pilot (1)

Data Management Plan

Guidlines for Open Data Management within the project

Publicaciones

Conference proceedings (11)

Sensitivity Analysis of ZnO NWs Based Soft Capacitive Pressure Sensors Using Finite Element Modeling

Autores: Shashank Mishra; Mahdieh Shojaei Baghini; Dhayalan Shakthivel; Beena Rai; Ravinder Dahiya
Publicado en: 2022
Editor: IEEE
DOI: 10.1109/fleps53764.2022.9781566

Accessible Document Layout: An Interface for 2D Tactile Displays

Autores: Omar Moured, Sara Alzalabny, Thorsten Schwarz, Bastian Rapp, Rainer Stiefelhagen
Publicado en: 2023
Editor: Association for Computing Machinery
DOI: 10.1145/3594806.3594811

End-to-End Optimization of High-Density e-Skin Design: From Spiking Taxel Readout to Texture Classification

Autores: Jiaqi Wang; Mark Daniel Alea; Jonah Van Assche; Georges G.E. Gielen
Publicado en: 2023 Design, Automation & Test in Europe Conference & Exhibition (DATE), 2023, ISBN 979-8-3503-9624-9
Editor: IEEE
DOI: 10.23919/date56975.2023.10137077

Concurrent Haptic, Audio, and Visual Data Set During Bare Finger Interaction with Textured Surfaces

Autores: Alexis Devillard; Aruna Ramasamy; Damien Faux; Vincent Hayward; Etienne Burdet
Publicado en: 2023, ISBN 979-8-3503-9994-3
Editor: IEEE
DOI: 10.1109/whc56415.2023.10224372

Power-Efficient and Accurate Texture Sensing Using Spiking Readouts for High-Density e-Skins

Autores: Mark Daniel Alea; Ali Safa; Jonah Van Assche; Georges G. E. Gielen
Publicado en: 2022 IEEE Biomedical Circuits and Systems Conference (BioCAS), 2022, ISBN 9781665469173
Editor: IEEE
DOI: 10.1109/biocas54905.2022.9948546

Classification of 2d Refreshable Tactile User Interfaces

Autores: Ramôa, Gaspar
Publicado en: 2022, ISBN 9783950499780
Editor: Association ICCHP
DOI: 10.35011/icchp-aaate22-p1-24

Human Self-touch vs Other-Touch Resolved by Machine Learning

Autores: Aruna Ramasamy, Damien Faux, Vincent Hayward, Malika Auvray, Xavier Job & Louise Kirsch
Publicado en: Haptics: Science, Technology, Applications, 2022, ISBN 978-3-031-06248-3
Editor: Springer, Cham
DOI: 10.1007/978-3-031-06249-0_25

A Fingertip-Mimicking 12×16 200μm-Resolution e-skin Taxel Readout Chip with per-Taxel Spiking Readout and Embedded Receptive Field Processing

Autores: Mark Daniel Alea; Ali Safa; Flavio Giacomozzi; Andrea Adami; Inci Rüya Temel; Leandro Lorenzelli; Georges Gielen
Publicado en: 2023 IEEE Symposium on VLSI Technology and Circuits (VLSI Technology and Circuits), 2023
Editor: IEEE
DOI: 10.23919/vlsitechnologyandcir57934.2023.10185346

Chart4Blind: An Intelligent Interface for Chart Accessibility Conversion

Autores: Omar Moured , Morris Baumgarten-Egemole , Karin Müller , Alina Roitberg , Thorsten Schwarz , Rainer Stiefelhagen
Publicado en: 2024
Editor: Association for Computing Machinery
DOI: 10.1145/3640543.3645175

Push to Know! - Visuo-Tactile Based Active Object Parameter Inference with Dual Differentiable Filtering

Autores: Anirvan Dutta; Etienne Burdet; Mohsen Kaboli
Publicado en: 2023
Editor: IEEE
DOI: 10.1109/iros55552.2023.10341832

Line Graphics Digitization: A Step Towards Full Automation

Autores: Omar Moured, Jiaming Zhang, Alina Roitberg, Thorsten Schwarz, Rainer Stiefelhagen
Publicado en: 2023
Editor: Springer, Cham
DOI: 10.48550/arxiv.2307.02065

Peer reviewed articles (11)

Capacitive-triboelectric based hybrid sensor system for human-like tactile perception

Autores: Mishra, S. , Nair, N. M. , Khandelwal, G. , Rai, B. and Georgiev, V.
Publicado en: IEEE Sensors Letters, 2024, ISSN 2475-1472
Editor: IEEE
DOI: 10.1109/lsens.2024.3351692

Ultra-Thin Chips with ISFET Array for Continuous Monitoring of Body Fluids pH

Autores: Mahdieh Shojaei Baghini; Anastasios Vilouras; Ravinder Dahiya
Publicado en: IEEE Transactions on Biomedical Circuits and Systems, 2021, ISSN 1932-4545
Editor: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tbcas.2022.3141553

Active visuo-tactile interactive robotic perception for accurate object pose estimation in dense clutter

Autores: Prajval Kumar Murali, Anirvan Dutta, Michael Gentner, Etienne Burdet, Ravinder Dahiya, Mohsen Kaboli
Publicado en: IEEE Robotics and Automation Letters, 2022, ISSN 2377-3766
Editor: IEEE
DOI: 10.1109/lra.2022.3150045

Developing Dynamic Audio Navigation UIs to Pinpoint Elements in Tactile Graphics

Autores: Gaspar Ramôa, Vincent Schmidt and Peter König
Publicado en: Multimodal Technol. Interact., 2022, ISSN 2414-4088
Editor: MDPI
DOI: 10.3390/mti6120113

Local field potential sharp waves with diversified impact on cortical neuronal encoding of haptic input

Autores: Sofie S. Kristensen, Henrik Jörntell
Publicado en: Scientific Reports, 2024, ISSN 2045-2322
Editor: Nature Publishing Group
DOI: 10.1038/s41598-024-65200-3

Improved Spatial Knowledge Acquisition through Sensory Augmentation

Autores: Vincent Schmidt, Sabine U. König, Rabia Dilawar, Tracy Sánchez Pacheco and Peter König
Publicado en: Brain Science, Edición 13, 720, 2023, ISSN 2076-3425
Editor: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/brainsci13050720

Bioinspired Distributed Energy in Robotics and Enabling Technologies

Autores: Rudra Mukherjee, Priyanka Ganguly, Ravinder Dahiya
Publicado en: Advanced Intelligent Systems, 2021, ISSN 2640-4567
Editor: Wiley
DOI: 10.1002/aisy.202100036

Differential encoding of temporally evolving color patterns across nearby V1 neurons

Autores: Sofie Skårup Kristensen; Henrik Jörntell
Publicado en: Front. Cell. Neurosci, 2023, ISSN 1662-5102
Editor: Frontiers Research Foundation
DOI: 10.3389/fncel.2023.1249522

Neuromorphic Near-Sensor Computing: From Event-Based Sensing to Edge Learning

Autores: Ali Safa; Jonah Van Assche; Mark Daniel Alea; Francky Catthoor; Georges G.E. Gielen
Publicado en: IEEE Micro, Edición 42; 6, 2022, Página(s) 88-95, ISSN 0272-1732
Editor: Institute of Electrical and Electronics Engineers
DOI: 10.1109/mm.2022.3195634

Ultra‐High Gauge Factor Strain Sensor with Wide‐Range Stretchability

Autores: Yogeenth Kumaresan, Shashank Mishra, Oliver Ozioko, Radu Chirila, Ravinder Dahiya
Publicado en: Advanced Intelligent Systems, 2022, ISSN 2640-4567
Editor: Wiley
DOI: 10.1002/aisy.202200043

Distributed Tactile Display with Dual Array Design

Autores: Yerkebulan Massalim; Damien Faux; Vincent Hayward
Publicado en: IEEE Transactions on Haptics, 2023, ISSN 2329-4051
Editor: IEEE
DOI: 10.1109/toh.2023.3254373

Other (2)

High-dimensional cortical signals reveal rich bimodal and working memory-like representations among S1 neuron populations

Autores: Sofie S. Kristensen, Kaan Kesgin, Henrik Jörntell
Publicado en: BioRxiv, 2024
Editor: Cold Spring Harbor Laboratory
DOI: 10.1101/2024.01.26.577171

Singular superlet transform achieves markedly improved time-frequency super-resolution for separating complex neural signals

Autores: Kaan Kesgin, Henrik Jörntell
Publicado en: BioRxiv, 2023
Editor: Cold Spring Harbor Laboratory
DOI: 10.1101/2023.02.27.530211