A novel integrated SYstem of Systems streNgthening tEchnical and logistical capacities to ensure better Response to emerGencies by synergIStically addrEssing FRs capability gaps

Project Information

SYNERGISE

Grant agreement ID: 101121321

DOI

10.3030/101121321

EC signature date 24 July 2023

Start date 1 September 2023

End date 28 February 2027

Funded under

• Civil Security for Society

Total cost

€ 5 597 068,90

EU contribution

€ 5 597 066,50

Coordinated by

BUNDESANSTALT TECHNISCHES HILFSWERK
Germany

Periodic Reporting for period 1 - SYNERGISE (A novel integrated SYstem of Systems streNgthening tEchnical and logistical capacities to ensure better Response to emerGencies by synergIStically addrEssing FRs capability gaps)

Reporting period: 2023-09-01 to 2024-11-30

Summary of the context and overall objectives of the project

The SYNERGISE project addresses the growing complexity of disasters by developing advanced, integrated solutions to enhance emergency response and save lives. Urbanization, climate change, and cross-border incidents place immense pressure on first responders (FR), who face challenges like limited situational awareness, resource management issues, and communication gaps. SYNERGISE aims to overcome these obstacles by creating the Novel Integrated Toolkit for Collaborative Response and Enhanced Situational Awareness (NIT-CRES).
This innovative toolkit is tailored for various emergency response agencies, including search and rescue teams, fire brigades, medical personnel, police, and civil protection organizations. NIT-CRES enhances collaboration, situational awareness, and efficiency through advanced tools and services. It enables FRs to explore disaster sites autonomously, monitor safety with real-time data on location and vitals, analyse threats, and coordinate efforts using a shared Common Operational Picture (COP). Designed with inclusiveness, privacy, and ethical considerations, the toolkit ensures compliance with operational standards and societal expectations.
The project includes extensive testing and validation activities to ensure practicality and user acceptance. By incorporating swarm robotics, localization systems, wearable health devices, augmented reality tools, and field communication systems into a unified framework, SYNERGISE provides FRs with enhanced capabilities for disaster management. A strong focus on human-machine teaming ensures seamless collaboration between responders and their tools.
SYNERGISE not only advances technological innovation but also prioritizes societal values by addressing ethical, legal, and privacy concerns. Its solutions are designed to be inclusive, sustainable, and trusted by users and stakeholders. The project’s holistic approach improves situational awareness, speeds up response times, and strengthens cross-border cooperation, contributing to a more resilient and safer society.
In summary, SYNERGISE delivers a transformative toolkit that empowers first responders to handle complex incidents effectively, enhances disaster resilience, and sets new standards for emergency management. By integrating advanced technology with societal responsibility, the project ensures a safer future for communities across Europe.

Work performed from the beginning of the project to the end of the period covered by the report and main results achieved so far

During the first reporting period, SYNERGISE made significant progress in advancing its objectives. The project established an operational framework by defining the master scenario, use cases, and analysing first responder capabilities and gaps based on the practitioners inputs, other projects, as well as the work done by IFAFRI, CERIS (Community for European Research and Innovation for Security) and ESTAG (UNDRR Scientific and Technical Advisory Group). A repository of operational requirements was created to guide the development of components, supported by a robust system architecture and user evaluation protocols. Ethical, legal, and privacy considerations were integral to these efforts.
Robotics advancements included enhancing the ANYmal robot for precise end-effector control on rough terrain and integrating cameras and sensors into the SNAKE robot for navigating in confined spaces. Improvements in robotic perception enabled bandwidth-efficient map sharing, collaborative exploration with ground and aerial robots, and intuitive interfaces for robotic arm control. Real-time communication pipelines streamlined human-machine interaction.
Wearable and localization technologies were significantly refined, incorporating advanced features such as step detection, magnetic calibration, and sensors for monitoring vitals and detecting gas. These enhancements were seamlessly integrated into first responder equipment, with data collected during training and testing exercises providing valuable insights for further development.
Testing and validation activities played a critical role in advancing SYNERGISE technologies. These efforts encompassed 10 collaborative lab tests, a technical workshop, and the first field test, where the project's communication tools and network systems were evaluated alongside wearables and localisation devices. By adopting this comprehensive and hands-on approach, SYNERGISE ensured that its technologies were rigorously assessed under realistic conditions, leading to improved performance and reliability.
In parallel, communication and dissemination activities boosted the project's visibility. Through a public website, active social media engagement, and participation in over 39 key events, SYNERGISE reached a wide audience and strengthened its network. At every stage, ethical compliance and effective project coordination ensured the technologies were developed in alignment with user needs and societal expectations.
This first reporting period has built a strong foundation for advancing SYNERGISE technologies and improving disaster response capabilities.

Progress beyond the state of the art and expected potential impact (including the socio-economic impact and the wider societal implications of the project so far)

The project has achieved significant advancements. For the first time, the whole-body control problem for the ANYmal robot on rough terrain has been successfully addressed. This was achieved by introducing rough terrain augmentation during simulation-based training. A novel virtual leash method was also developed to control ANYmal, which, when combined with a reactive path planner, enables the robot to efficiently navigate dynamic environments while avoiding humans. Additionally, ANYmal demonstrated the ability to control the full six degrees of freedom (DoF) pose of its end effector using a learning-based method, which has proven to be more robust than existing model-based solutions.
The project also integrated the first prototypes of the SNAKE robot and the UAV (RMF-OWL) with ANYmal, showcasing the potential for collaborative multi-robot systems. For OWL, key developments include a novel method for bandwidth-efficient volumetric map sharing between legged and flying robots, semantic scene graph representations to enable more efficient path planning for faster search and rescue missions, and multi-modal localization and mapping capabilities to ensure resilient navigation in GNSS-denied and perceptually degraded environments.

SYNERGISE Activities