Mixed reality ecosystem for teaching robotics in manufacturing

Informations projet

MASTER

N° de convention de subvention: 101093079

DOI

10.3030/101093079

Date de signature de la CE 21 Novembre 2022

Date de début 1 Janvier 2023

Date de fin 30 Juin 2026

Financé au titre de

• Digital, Industry and Space

Coût total

€ 8 335 379,06

Contribution de l’UE

€ 7 983 840,00

Coordonné par

PANEPISTIMIO PATRON
Greece

CORDIS fournit des liens vers les livrables publics et les publications des projets HORIZON.

Les liens vers les livrables et les publications des projets du 7e PC, ainsi que les liens vers certains types de résultats spécifiques tels que les jeux de données et les logiciels, sont récupérés dynamiquement sur OpenAIRE .

Livrables

Documents, reports (8)

Report on the technical validation of experiment results - 1st Open Call experiments

Report on the technical validation of experiment results

Open Call 2 launch documentation package

Description of the documentation package prepared for the 2nd OC

Open Call 1 winner selection report and experiments contracts

Report on the 1st open call winners and the experiments that will be executed

Definition of platform and educational use cases for each category of end-user

Describe the features that will be included in the XR platform and the didactic use cases based on the end users requirements to build a value proposition that considers their needs

Data Management Plan

Report describing the Data Management Plan that will be followed during the project

Open Call 1 launch documentation package

Description of the documentation package prepared for the 1st OC.

Open Call 2 winner selection report and experiments contracts

Report on the 2nd open call winners and the experiments that will be executed

OC1 Experiments execution and evaluation report

Report on the execution and evaluation activities that will take place with the OC1 experiments

Demonstrators, pilots, prototypes (11)

Tools for robot application programming with PbD and visual support - First version

The first version of robot programming tool will be described, including the Programming-by-Demonstration (PbD) technique and the Look-and-Move (L&M) technique

Demonstrator of active and passive gaze-based interaction in XR - First version

Description of the first development of a module for active and passive gaze-based interaction in XR settings

Demonstrator of active and passive gaze-based interaction in XR - Initial design

Description of the design of the module for active and passive gazebased interaction in XR settings

Demonstrator of active and passive gaze-based interaction in XR - Final version

Description of the final development of a module for active and passive gaze-based interaction in XR settings

Didactic material for students and teachers

Describe the design, development and validation of didactic resources to support teachers which will allow them to create and generate new learning activities on the platform.

Platform for XR content creation - Initial design

Design of the XR platform for content creation

Platform for XR content creation - First version

First version of the XR platform for content creation

MR based features for ensuring health and safety - Initial design

Initial design of MR features integrated with AI decision making tools that will ensure health and safety in a workplace

MR based features for ensuring health and safety - First version

First version of MR features integrated with AI decision making tools, that will ensure health and safety in a workplace.

Tools for robot application programming with PbD and visual support - Initial design

The design of robot programming tool will be described including the ProgrammingbyDemonstration PbD technique and the LookandMove LM technique

Didactic material for students

Describe the design, development and validation of didactic resources for training and learning of robotics, adapted to the students of training centres.

Publications

Peer reviewed articles (2)

A review of machine learning in scanpath analysis for passive gaze-based interaction

Auteurs: Abdulrahman Mohamed Selim. Michael Barz, Omair Shahzad Bhatti1, Hasan Md Tusfiqur Alam, Daniel Sonntag1
Publié dans: Front. Artif. Intell., 2024, ISSN 2624-8212
Éditeur: Frontiers
DOI: 10.3389/frai.2024.1391745

Cross-Viewpoint Semantic Mapping: Integrating Human and Robot Perspectives for Improved 3D Semantic Reconstruction

Auteurs: Kopácsi, László; Baffy, Benjamin; Baranyi, Gábor; Skaf, Joul; Sörös, Gábor; Szeier, Szilvia; Lőrincz, András; Sonntag, Daniel
Publié dans: Sensors, Vol 23, Iss 11, p 5126 (2023), 2023, ISSN 1424-8220
Éditeur: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/s23115126

Conference proceedings (2)

IMETA: An Interactive Mobile Eye Tracking Annotation Method for Semi-automatic Fixation-to-AOI mapping

Auteurs: Kopácsi, László; Barz, Michael; Bhatti, Omair Shahzad; Sonntag, Daniel
Publié dans: IUI'23 Companion, 2023, ISBN 9798400701078
Éditeur: Association for Computing Machinery
DOI: 10.1145/3581754.3584125

Interactive Fixation-to-AOI Mapping for Mobile Eye Tracking Data based on Few-Shot Image Classification

Auteurs: Barz, Michael; Bhatti, Omair Shahzad; Alam, Hasan Md Tusfiqur; Nguyen, Duy Minh Ho; Sonntag, Daniel
Publié dans: IUI'23 Companion, 2023, ISBN 9798400701078
Éditeur: Association for Computing Machinery
DOI: 10.1145/3581754.3584179