TRACEABLE ROBOTIC HANDLING OF STERILE MEDICAL PRODUCTS

Projektinformationen

TraceBot

ID Finanzhilfevereinbarung: 101017089

DOI

10.3030/101017089

Projekt abgeschlossen

EK-Unterschriftsdatum 16 Dezember 2020

Startdatum 1 Januar 2021

Enddatum 31 März 2025

Finanziert unter

• INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT)

Gesamtkosten

€ 6 999 905,00

EU-Beitrag

€ 6 999 905,00

Koordiniert durch

BIOLAGO EV
Germany

CORDIS bietet Links zu öffentlichen Ergebnissen und Veröffentlichungen von HORIZONT-Projekten.

Links zu Ergebnissen und Veröffentlichungen von RP7-Projekten sowie Links zu einigen Typen spezifischer Ergebnisse wie Datensätzen und Software werden dynamisch von OpenAIRE abgerufen.

Leistungen

Documents, reports (33)

Verification and validation plan 1

D1.4Verification and validation plan

ROS middle-ware mock-up, demonstrating UR arms control using ROS simulated environment

D6.1 - ROS middle-ware mock-up, demonstrating UR arms control using ROS simulated environment

Impact dashboard 1

twice a yearD7.1 Impact dashboard (monthly, concise single page summary) PUBLIC

Skill-based framework description

D3.1 Skill-based framework description. Description of the modelling of robotic skills developed in the extension of classical models

Knowledge management checklist

D8.5 Knowledge management checklist and asset register - ongoing

Impact dashboard 4

Twice a year

Traceability framework for laboratory automation:

D4.1 Traceability framework for laboratory automation: fully functional first version including first verification examples in one of the modalities

Construction of mechanical framework to mount robotics arms within a laboratory hood.

D6.3 - Construction of mechanical framework to mount robotics arms within a laboratory hood. Integration of setup using new components with the robotic arm. Includes acceptance testing of ROS middle-ware to ensure services provide full control of robotic arm along with integrated components.

Design guidebook

D1.3Design guidebook

Impact dashboard 3

Twice a year

Regulatory engagement plan

D7.5 Regulatory engagement plan (M12)

Integrated Traceability framework using tactile, visual and functional task verification

D4.3 Integrated Traceability framework using tactile, visual and functional task verification: description, evaluation and open source software

Technical specifications as recommendations for the design of the multi-fingered gripper

D2.1 – Technical specifications as recommendations for the design of the multi-fingered gripper

Communication plan

D7.2 Communication plan and materials

Framework: Definition of the conceptual and reasoning framework and semantic models

D5.1 Framework: Definition of the conceptual and reasoning framework and semantic models. Fundamental simulation aspects are available in the TST.

Use Case Specification 2

D1.1Use case Specification

Report or Publication about lab process action learning by analysing human demonstrations in VR

D5.5 Report (publication) on laboratory process action learning by analysing human demonstrations in VR

Intuitive programming interface Framework

D3.3: Intuitive programming interface Framework: Description of the operation programming interface including task demonstration mechanism

Control strategies of hand mounted on a robotic arm performing unitary operations

D2.3 Control strategies of hand mounted on a robotic arm performing unitary operations

Impact dashboard 2

Twice a year

Initial tactile, visual and functional task verification

D4.2 Initial tactile, visual and functional task verification: description, evaluation and open source software

Initial setup using 2 x Robotic arms with prototypes or similar functional components attached, using ROS middle-ware mock-up

D6.2 - Initial setup using 2 x Robotic arms with prototypes or similar functional components attached, using ROS middle-ware mock-up. The integration will not be mounted within a framework at this point and will not be within a sterile environment

Project Handbook, communications infrastructure

D8.1 Project Handbook, communications infrastructure

Sensor-based control strategies

D3.2: Sensor-based control strategies. Description of the perception modalities and sensor-based robotic controllers developed to handle the main unimanual and bimanual manipulations

Software models (final)

D5.3 Software models (Final): Final definition of the software interfaces and software creating the Audit Trail. Related to Milestone 3.

Use case Specification 1

D1.1Use case Specification

Rapid set-up of laboratory automation cell

D6.5 - Rapid set-up of laboratory automation cell. Operations and Maintenance Manuals. Full release of Git repository with ROS framework and packages. Final release of mechanical and electrical schematics. Compilation of guidelines towards certification (O3)

Software models (basis)

D5.2 Software models (Basis): Software interfaces for first demonstrator defined and required simulation aspects are available. Related to Milestone 2.

Verification and validation plan 2

D1.4Verification and validation plan

Dissemination plan

D7.3 Dissemination plan and activities; outward-facing website

System integrated readily to be placed within a sterile enclosure to accommodate all of the hardware required to automate the sterile testing

D6.4 - System integrated readily to be placed within a sterile enclosure to accommodate all of the hardware required to automate the sterile testing (O6)

System Architecture

D1.2System Architecture

Report or Publication about robotic minds eye reasoning for verification in laboratory environments

D5.4 Report (publication) about robotic minds eye reasoning for verification in lab environments

Open Research Data Pilot (4)

Data Management Plan 2

Data Management Plan update

Data Management Plan 1

D8.2 Data Management Plan

Data Management Plan 4

Data Management Plan update

Data Management Plan 3

Data Management Plan update

Veröffentlichungen

Book chapters (2)

Robotizing the Sterility Testing Process: Scientific Challenges for Bringing Agile Robots into the Laboratory

Autoren: Anthony Remazeilles, Irati Rasines, Asier Fernandez, Maike Neumann, Michael Beetz, Mathieu Grossard, Clive Hellingman, Carl-Helmut Coulon, Torben Cichon, Florian Gosselin, Markus Vincze
Veröffentlicht in: Lecture Notes in Networks and Systems, ROBOT2022: Fifth Iberian Robotics Conference, 2022, Seite(n) 223-234
Herausgeber: Springer International Publishing
DOI: 10.1007/978-3-031-21065-5_19

Challenges of Depth Estimation for Transparent Objects

Autoren: Jean-Baptiste Weibel, Paolo Sebeto, Stefan Thalhammer, Markus Vincze
Veröffentlicht in: Lecture Notes in Computer Science, Advances in Visual Computing, 2023, Seite(n) 277-288
Herausgeber: Springer Nature Switzerland
DOI: 10.1007/978-3-031-47969-4_22

Conference proceedings (16)

Measuring the Sim2Real Gap in 3D Object Classification for Different 3D Data Representation

Autoren: J. Weibel, R. Rohrböck, M. Vincze
Veröffentlicht in: Lecture Notes in Computer Science: 13th International Conference on Computer Vision Systems, 2021
Herausgeber: Springer
DOI: 10.1007/978-3-030-87156-7_9

"NaivPhys4RP - towards Human-Like Robot Perception ""Physical Reasoning Based on Embodied Probabilistic Simulation"""

Autoren: F. K. Kenfack, M. Neumann, P. Mania, T. Tan, F. A. Siddiky, R. Weller, G. Zachmann, M. Beetz
Veröffentlicht in: 2022
Herausgeber: IEEE
DOI: 10.1109/humanoids53995.2022.10000153

An open and flexible robot perception framework for mobile manipulation tasks

Autoren: P. Mania, S. Stelter, G. Kazhoyan, M. Beetz
Veröffentlicht in: 2024
Herausgeber: IEEE

A Modular Framework for Knowledge-Based Servoing: Plugging Symbolic Theories into Robotic Controllers

Autoren: M. Huerkamp, K. Dhanabalachandran, M. Pomarlan, S. Stelter, M. Beetz
Veröffentlicht in: International Conference on Agents and Artificial Intelligence (ICAART), 2025
Herausgeber: SCITEPRESS

ZS6D: Zero-shot 6D Object Pose Estimation using Vision Transformers

Autoren: Philipp Ausserlechner, David Haberger, Stefan Thalhammer, Jean-Baptiste Weibel, Markus Vincze
Veröffentlicht in: 2024 IEEE International Conference on Robotics and Automation (ICRA), 2024, Seite(n) 463-469
Herausgeber: IEEE
DOI: 10.1109/icra57147.2024.10611464

Towards Autonomous Verification: Integrating Cognitive AI and Semantic Digital Twins in Medical Robotics

Autoren: P. Mania, F. K. Kenfack, M. Neumann, M. Beetz
Veröffentlicht in: IEEE ICRA 2025, 2025
Herausgeber: IEEEE

Perception through Cognitive Emulation - A Second Iteration of NaivPhys4RP for Learningless and Safe Object Recognition and Pose Estimation of (Transparent) Objects from Poor Sensor Data

Autoren: F. K. Kenfack, M. Neumann, P. Mania, M. Beetz
Veröffentlicht in: 2024
Herausgeber: IEEE

Analysis of 3D shape representations in presence of corrupted data

Autoren: R. Rohrböck, J. Weibel, M. Vincze
Veröffentlicht in: "Austrian Robotics Workshop ""ARW""", 2021
Herausgeber: "Austrian Robotics Workshop ""ARW"""

SporeAgent: Reinforced Scene-level Plausibility for Object Pose Refinement

Autoren: Dominik Bauer, Timothy Patten, Markus Vincze
Veröffentlicht in: IEEE/CVF Winter Conference on Applications of Computer Vision, WACV, 2022
Herausgeber: https://openaccess.thecvf.com
DOI: 10.48550/arxiv.2201.00239

PyraPose: Feature Pyramids for Fast and Accurate Object Pose Estimation under Domain Shift

Autoren: S. Thalhammer, M. Leitner, T. Patten, M. Vincze
Veröffentlicht in: IEEE International Conference on Robotics and Automation (ICRA), 2021
Herausgeber: IEEE
DOI: 10.1109/icra48506.2021.9562108

Spectro-Temporal Recurrent Neural Network for Robotic Slip Detection with Piezoelectric Tactile Sensor

Autoren: Théo Ayral, Saifeddine Aloui, Mathieu Grossard
Veröffentlicht in: 2023 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), 2023, Seite(n) 573-578
Herausgeber: IEEE
DOI: 10.1109/aim46323.2023.10196263

A Methodology for early design specifications of robotic grippers

Autoren: Jonatan Martín Escorcia-Hernández, Mathieu Grossard, Florian Gosselin
Veröffentlicht in: 2023 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), 2023, Seite(n) 616-622
Herausgeber: IEEE
DOI: 10.1109/aim46323.2023.10196258

Enabling Classification of Heavily-occluded Objects through Class-agnostic Image Manipulation

Autoren: B. Gallauner, S. Thalhammer, M. Vincze
Veröffentlicht in: OAGM Workshop 2021 Computer Vision and Pattern Analysis Across Domains, 2021
Herausgeber: Verlag der Technischen Universität Graz

Object Placement in an Unknown Environment as Part of a Pick-and-Place Pipeline

Autoren: C. Eder, T. Patten, J. Weibel, M. Vincze
Veröffentlicht in: 2021
Herausgeber: Austrian Robotics Workshop

An iterative method for solving the inverse kinematic problem of three-joints robotic fingers with distal coupling.

Autoren: Jonatan Martín Escorcia-Hernández, Mathieu Grossard, Florian Gosselin, Clémence Dubois
Veröffentlicht in: 2023 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), 2024, Seite(n) 623-628
Herausgeber: IEEE
DOI: 10.1109/aim46323.2023.10196182

ReAgent: Point Cloud Registration using Imitation and Reinforcement Learning

Autoren: [1] D. Bauer, T. Patten, M. Vincze
Veröffentlicht in: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021
Herausgeber: CVPR
DOI: 10.1109/cvpr46437.2021.01435

Peer reviewed articles (6)

Self-supervised Vision Transformers for 3D pose estimation of novel objects

Autoren: Stefan Thalhammer, Jean-Baptiste Weibel, Markus Vincze, Jose Garcia-Rodriguez
Veröffentlicht in: Image and Vision Computing, Ausgabe 139, 2024, Seite(n) 104816, ISSN 0262-8856
Herausgeber: Elsevier BV
DOI: 10.1016/j.imavis.2023.104816

Challenges for Monocular 6-D Object Pose Estimation in Robotics

Autoren: Stefan Thalhammer, Dominik Bauer, Peter Hönig, Jean-Baptiste Weibel, José García-Rodríguez, Markus Vincze
Veröffentlicht in: IEEE Transactions on Robotics, Ausgabe 40, 2025, Seite(n) 4065-4084, ISSN 1552-3098
Herausgeber: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tro.2024.3433870

ReFlow6D: Refraction-Guided Transparent Object 6D Pose Estimation via Intermediate Representation Learning

Autoren: Hrishikesh Gupta, Stefan Thalhammer, Jean-Baptiste Weibel, Alexander Haberl, Markus Vincze
Veröffentlicht in: IEEE Robotics and Automation Letters, Ausgabe 9, 2024, Seite(n) 9438-9445, ISSN 2377-3766
Herausgeber: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/lra.2024.3455897

Robots Adapting to the Environment: A Review on the Fusion of Dynamic Movement Primitives and Artificial Potential Fields

Autoren: Irati Rasines, Itziar Cabanes, Anthony Remazeilles, Joseph Mcintyre
Veröffentlicht in: IEEE Access, Ausgabe 12, 2024, Seite(n) 92598-92611, ISSN 2169-3536
Herausgeber: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2024.3418573

Task-Oriented Methodology Combining Human Manual Gestures and Robotic Grasp Stability Analyses: Application to the Specification of Dexterous Robotic Grippers

Autoren: Jonatan Martin Escorcia-Hernandez, Mathieu Grossard, Florian Gosselin
Veröffentlicht in: Journal of Mechanical Design, Ausgabe 145, 2023, ISSN 1050-0472
Herausgeber: American Society of Mechanical Engineers
DOI: 10.1115/1.4056493

Minimum Cost Averaging for Multivariate Time Series Using Constrained Dynamic Time Warping: A Case Study in Robotics

Autoren: Irati Rasines, Anthony Remazeilles, Miguel Prada, Itziar Cabanes
Veröffentlicht in: IEEE Access, Ausgabe 11, 2023, Seite(n) 80600-80612, ISSN 2169-3536
Herausgeber: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2023.3300720