TRACEABLE ROBOTIC HANDLING OF STERILE MEDICAL PRODUCTS

Informations projet

TraceBot

N° de convention de subvention: 101017089

DOI

10.3030/101017089

Projet clôturé

Date de signature de la CE 16 Decembre 2020

Date de début 1 Janvier 2021

Date de fin 31 Mars 2025

Financé au titre de

• INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT)

Coût total

€ 6 999 905,00

Contribution de l’UE

€ 6 999 905,00

Coordonné par

BIOLAGO EV
Germany

CORDIS fournit des liens vers les livrables publics et les publications des projets HORIZON.

Les liens vers les livrables et les publications des projets du 7e PC, ainsi que les liens vers certains types de résultats spécifiques tels que les jeux de données et les logiciels, sont récupérés dynamiquement sur OpenAIRE .

Livrables

Documents, reports (33)

Verification and validation plan 1

D1.4Verification and validation plan

ROS middle-ware mock-up, demonstrating UR arms control using ROS simulated environment

D6.1 - ROS middle-ware mock-up, demonstrating UR arms control using ROS simulated environment

Impact dashboard 1

twice a yearD7.1 Impact dashboard (monthly, concise single page summary) PUBLIC

Skill-based framework description

D3.1 Skill-based framework description. Description of the modelling of robotic skills developed in the extension of classical models

Knowledge management checklist

D8.5 Knowledge management checklist and asset register - ongoing

Impact dashboard 4

Twice a year

Traceability framework for laboratory automation:

D4.1 Traceability framework for laboratory automation: fully functional first version including first verification examples in one of the modalities

Construction of mechanical framework to mount robotics arms within a laboratory hood.

D6.3 - Construction of mechanical framework to mount robotics arms within a laboratory hood. Integration of setup using new components with the robotic arm. Includes acceptance testing of ROS middle-ware to ensure services provide full control of robotic arm along with integrated components.

Design guidebook

D1.3Design guidebook

Impact dashboard 3

Twice a year

Regulatory engagement plan

D7.5 Regulatory engagement plan (M12)

Integrated Traceability framework using tactile, visual and functional task verification

D4.3 Integrated Traceability framework using tactile, visual and functional task verification: description, evaluation and open source software

Technical specifications as recommendations for the design of the multi-fingered gripper

D2.1 – Technical specifications as recommendations for the design of the multi-fingered gripper

Communication plan

D7.2 Communication plan and materials

Framework: Definition of the conceptual and reasoning framework and semantic models

D5.1 Framework: Definition of the conceptual and reasoning framework and semantic models. Fundamental simulation aspects are available in the TST.

Use Case Specification 2

D1.1Use case Specification

Report or Publication about lab process action learning by analysing human demonstrations in VR

D5.5 Report (publication) on laboratory process action learning by analysing human demonstrations in VR

Intuitive programming interface Framework

D3.3: Intuitive programming interface Framework: Description of the operation programming interface including task demonstration mechanism

Control strategies of hand mounted on a robotic arm performing unitary operations

D2.3 Control strategies of hand mounted on a robotic arm performing unitary operations

Impact dashboard 2

Twice a year

Initial tactile, visual and functional task verification

D4.2 Initial tactile, visual and functional task verification: description, evaluation and open source software

Initial setup using 2 x Robotic arms with prototypes or similar functional components attached, using ROS middle-ware mock-up

D6.2 - Initial setup using 2 x Robotic arms with prototypes or similar functional components attached, using ROS middle-ware mock-up. The integration will not be mounted within a framework at this point and will not be within a sterile environment

Project Handbook, communications infrastructure

D8.1 Project Handbook, communications infrastructure

Sensor-based control strategies

D3.2: Sensor-based control strategies. Description of the perception modalities and sensor-based robotic controllers developed to handle the main unimanual and bimanual manipulations

Software models (final)

D5.3 Software models (Final): Final definition of the software interfaces and software creating the Audit Trail. Related to Milestone 3.

Use case Specification 1

D1.1Use case Specification

Rapid set-up of laboratory automation cell

D6.5 - Rapid set-up of laboratory automation cell. Operations and Maintenance Manuals. Full release of Git repository with ROS framework and packages. Final release of mechanical and electrical schematics. Compilation of guidelines towards certification (O3)

Software models (basis)

D5.2 Software models (Basis): Software interfaces for first demonstrator defined and required simulation aspects are available. Related to Milestone 2.

Verification and validation plan 2

D1.4Verification and validation plan

Dissemination plan

D7.3 Dissemination plan and activities; outward-facing website

System integrated readily to be placed within a sterile enclosure to accommodate all of the hardware required to automate the sterile testing

D6.4 - System integrated readily to be placed within a sterile enclosure to accommodate all of the hardware required to automate the sterile testing (O6)

System Architecture

D1.2System Architecture

Report or Publication about robotic minds eye reasoning for verification in laboratory environments

D5.4 Report (publication) about robotic minds eye reasoning for verification in lab environments

Open Research Data Pilot (4)

Data Management Plan 2

Data Management Plan update

Data Management Plan 1

D8.2 Data Management Plan

Data Management Plan 4

Data Management Plan update

Data Management Plan 3

Data Management Plan update

Publications

Book chapters (2)

Robotizing the Sterility Testing Process: Scientific Challenges for Bringing Agile Robots into the Laboratory

Auteurs: Anthony Remazeilles, Irati Rasines, Asier Fernandez, Maike Neumann, Michael Beetz, Mathieu Grossard, Clive Hellingman, Carl-Helmut Coulon, Torben Cichon, Florian Gosselin, Markus Vincze
Publié dans: Lecture Notes in Networks and Systems, ROBOT2022: Fifth Iberian Robotics Conference, 2022, Page(s) 223-234
Éditeur: Springer International Publishing
DOI: 10.1007/978-3-031-21065-5_19

Challenges of Depth Estimation for Transparent Objects

Auteurs: Jean-Baptiste Weibel, Paolo Sebeto, Stefan Thalhammer, Markus Vincze
Publié dans: Lecture Notes in Computer Science, Advances in Visual Computing, 2023, Page(s) 277-288
Éditeur: Springer Nature Switzerland
DOI: 10.1007/978-3-031-47969-4_22

Conference proceedings (16)

Measuring the Sim2Real Gap in 3D Object Classification for Different 3D Data Representation

Auteurs: J. Weibel, R. Rohrböck, M. Vincze
Publié dans: Lecture Notes in Computer Science: 13th International Conference on Computer Vision Systems, 2021
Éditeur: Springer
DOI: 10.1007/978-3-030-87156-7_9

"NaivPhys4RP - towards Human-Like Robot Perception ""Physical Reasoning Based on Embodied Probabilistic Simulation"""

Auteurs: F. K. Kenfack, M. Neumann, P. Mania, T. Tan, F. A. Siddiky, R. Weller, G. Zachmann, M. Beetz
Publié dans: 2022
Éditeur: IEEE
DOI: 10.1109/humanoids53995.2022.10000153

An open and flexible robot perception framework for mobile manipulation tasks

Auteurs: P. Mania, S. Stelter, G. Kazhoyan, M. Beetz
Publié dans: 2024
Éditeur: IEEE

A Modular Framework for Knowledge-Based Servoing: Plugging Symbolic Theories into Robotic Controllers

Auteurs: M. Huerkamp, K. Dhanabalachandran, M. Pomarlan, S. Stelter, M. Beetz
Publié dans: International Conference on Agents and Artificial Intelligence (ICAART), 2025
Éditeur: SCITEPRESS

ZS6D: Zero-shot 6D Object Pose Estimation using Vision Transformers

Auteurs: Philipp Ausserlechner, David Haberger, Stefan Thalhammer, Jean-Baptiste Weibel, Markus Vincze
Publié dans: 2024 IEEE International Conference on Robotics and Automation (ICRA), 2024, Page(s) 463-469
Éditeur: IEEE
DOI: 10.1109/icra57147.2024.10611464

Towards Autonomous Verification: Integrating Cognitive AI and Semantic Digital Twins in Medical Robotics

Auteurs: P. Mania, F. K. Kenfack, M. Neumann, M. Beetz
Publié dans: IEEE ICRA 2025, 2025
Éditeur: IEEEE

Perception through Cognitive Emulation - A Second Iteration of NaivPhys4RP for Learningless and Safe Object Recognition and Pose Estimation of (Transparent) Objects from Poor Sensor Data

Auteurs: F. K. Kenfack, M. Neumann, P. Mania, M. Beetz
Publié dans: 2024
Éditeur: IEEE

Analysis of 3D shape representations in presence of corrupted data

Auteurs: R. Rohrböck, J. Weibel, M. Vincze
Publié dans: "Austrian Robotics Workshop ""ARW""", 2021
Éditeur: "Austrian Robotics Workshop ""ARW"""

SporeAgent: Reinforced Scene-level Plausibility for Object Pose Refinement

Auteurs: Dominik Bauer, Timothy Patten, Markus Vincze
Publié dans: IEEE/CVF Winter Conference on Applications of Computer Vision, WACV, 2022
Éditeur: https://openaccess.thecvf.com
DOI: 10.48550/arxiv.2201.00239

PyraPose: Feature Pyramids for Fast and Accurate Object Pose Estimation under Domain Shift

Auteurs: S. Thalhammer, M. Leitner, T. Patten, M. Vincze
Publié dans: IEEE International Conference on Robotics and Automation (ICRA), 2021
Éditeur: IEEE
DOI: 10.1109/icra48506.2021.9562108

Spectro-Temporal Recurrent Neural Network for Robotic Slip Detection with Piezoelectric Tactile Sensor

Auteurs: Théo Ayral, Saifeddine Aloui, Mathieu Grossard
Publié dans: 2023 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), 2023, Page(s) 573-578
Éditeur: IEEE
DOI: 10.1109/aim46323.2023.10196263

A Methodology for early design specifications of robotic grippers

Auteurs: Jonatan Martín Escorcia-Hernández, Mathieu Grossard, Florian Gosselin
Publié dans: 2023 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), 2023, Page(s) 616-622
Éditeur: IEEE
DOI: 10.1109/aim46323.2023.10196258

Enabling Classification of Heavily-occluded Objects through Class-agnostic Image Manipulation

Auteurs: B. Gallauner, S. Thalhammer, M. Vincze
Publié dans: OAGM Workshop 2021 Computer Vision and Pattern Analysis Across Domains, 2021
Éditeur: Verlag der Technischen Universität Graz

Object Placement in an Unknown Environment as Part of a Pick-and-Place Pipeline

Auteurs: C. Eder, T. Patten, J. Weibel, M. Vincze
Publié dans: 2021
Éditeur: Austrian Robotics Workshop

An iterative method for solving the inverse kinematic problem of three-joints robotic fingers with distal coupling.

Auteurs: Jonatan Martín Escorcia-Hernández, Mathieu Grossard, Florian Gosselin, Clémence Dubois
Publié dans: 2023 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), 2024, Page(s) 623-628
Éditeur: IEEE
DOI: 10.1109/aim46323.2023.10196182

ReAgent: Point Cloud Registration using Imitation and Reinforcement Learning

Auteurs: [1] D. Bauer, T. Patten, M. Vincze
Publié dans: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021
Éditeur: CVPR
DOI: 10.1109/cvpr46437.2021.01435

Peer reviewed articles (6)

Self-supervised Vision Transformers for 3D pose estimation of novel objects

Auteurs: Stefan Thalhammer, Jean-Baptiste Weibel, Markus Vincze, Jose Garcia-Rodriguez
Publié dans: Image and Vision Computing, Numéro 139, 2024, Page(s) 104816, ISSN 0262-8856
Éditeur: Elsevier BV
DOI: 10.1016/j.imavis.2023.104816

Challenges for Monocular 6-D Object Pose Estimation in Robotics

Auteurs: Stefan Thalhammer, Dominik Bauer, Peter Hönig, Jean-Baptiste Weibel, José García-Rodríguez, Markus Vincze
Publié dans: IEEE Transactions on Robotics, Numéro 40, 2025, Page(s) 4065-4084, ISSN 1552-3098
Éditeur: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tro.2024.3433870

ReFlow6D: Refraction-Guided Transparent Object 6D Pose Estimation via Intermediate Representation Learning

Auteurs: Hrishikesh Gupta, Stefan Thalhammer, Jean-Baptiste Weibel, Alexander Haberl, Markus Vincze
Publié dans: IEEE Robotics and Automation Letters, Numéro 9, 2024, Page(s) 9438-9445, ISSN 2377-3766
Éditeur: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/lra.2024.3455897

Robots Adapting to the Environment: A Review on the Fusion of Dynamic Movement Primitives and Artificial Potential Fields

Auteurs: Irati Rasines, Itziar Cabanes, Anthony Remazeilles, Joseph Mcintyre
Publié dans: IEEE Access, Numéro 12, 2024, Page(s) 92598-92611, ISSN 2169-3536
Éditeur: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2024.3418573

Task-Oriented Methodology Combining Human Manual Gestures and Robotic Grasp Stability Analyses: Application to the Specification of Dexterous Robotic Grippers

Auteurs: Jonatan Martin Escorcia-Hernandez, Mathieu Grossard, Florian Gosselin
Publié dans: Journal of Mechanical Design, Numéro 145, 2023, ISSN 1050-0472
Éditeur: American Society of Mechanical Engineers
DOI: 10.1115/1.4056493

Minimum Cost Averaging for Multivariate Time Series Using Constrained Dynamic Time Warping: A Case Study in Robotics

Auteurs: Irati Rasines, Anthony Remazeilles, Miguel Prada, Itziar Cabanes
Publié dans: IEEE Access, Numéro 11, 2023, Page(s) 80600-80612, ISSN 2169-3536
Éditeur: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2023.3300720