Skip to main content
Przejdź do strony domowej Komisji Europejskiej (odnośnik otworzy się w nowym oknie)
polski polski
CORDIS - Wyniki badań wspieranych przez UE
CORDIS
Zawartość zarchiwizowana w dniu 2024-05-27

MULTImodal and multiSENSory interfaces for intEraction with muscolo-skeletal Models

Cel

Accurate knowledge of human functional anatomy, in physiological and pathological conditions, is of importance in many medical fields, as in industrial areas such as biomedical engineering. The 3D aspects of functional anatomy are particularly important but they are exceedingly difficult to present in a meaningful way. Thus, the visualisation and virtual manipulation of anatomical objects represent a challenge on which to test innovative techniques. The present proposal concerns the visualisation of, and interaction with, data related to musculo-skeletal structures by means of multi-modal and multi-sensorial interfaces. The project will create a user friendly visualisation and interaction environment, in which all the information is presented with a set of representation - interaction pairs inspired by medical imaging modalities known by biomedical professional to enable him to use his previous experience to enhanced effect.

Objectives:
The project will develop and validate a new representation & interaction paradigm for virtual medical objects using multi-modal and multi-sensorial interfaces. Instead of pursuing virtual REALISM, which would be unfamiliar to most professionals, this new representation paradigm will pursue clinical RELEVANCE. It will rely on multiple synchronised views, each one associated with specialised interaction modalities based on multi-body tracking, speech recognition and synthesis, and proprioceptive haptic interfaces. Some views will convey conventional medical imaging modalities (RX, CT, MRI, endoscopy), while others will involve unconventional representation of the organs. For each of them the multi-sensorial interaction, which is most effective in the application context, will be implemented, again considering the type of interaction the medical professional would expect in the real world.

Work description:
At the outset, a review of the relevant literature will be performed for the visualisation strategies for virtual medical objects, for haptic interfaces, for speech interfaces, and for multi-body tracking, and combined with users requirements collected by means of interviews and surveys made among medical professionals. This activity will produce the description of the demonstrators and of the specific metrics to be used to evaluate the project results. The technology experts will deploy at the test site the hardware/software technologies for multi-body tracking, speech interfaces, haptic interfaces and autosterescopic display.

Such technologies will be integrated with existing VR and HPC facilities and used to develop three demonstration applications in the area of muscolo-skeletal pathologies. Using well-defined metrics, these applications will be used to compare the proposed representation & interaction paradigm to the conventional interfaces currently available in the same clinical contexts. Once the proposed interface paradigm is quantitatively evaluated with respect to relevant clinical applications, a new group of activities will begin to evaluate the acceptability of the proposed paradigm among medical professionals. Some partners are developing an application framework aimed at the rapid development of biomedical applications. The MULTISENSE project will add another conceptual layer aimed at supporting multi-sensory interfaces. The resulting software environment will be called Multi-modal Display and Interaction (MDI) application framework. In order to reduce the interdependency of this project from other activities, the Multi-sense software library will be designed to work also independently from the visualisation environment under development.

Milestones:
M1. Identification of a general clinical problem to be considered representative;
M2. Deployment and integration at the test site of the various multi-sensorial technologies;
M3. Realisation of demonstrators to be used in the validation study;
M4. Availability of all data to demonstrate conclusively the validity of the MDI paradigm, plus all the technical detail required to design an effective application framework;
M5. Complete application release.

Dziedzina nauki (EuroSciVoc)

Klasyfikacja projektów w serwisie CORDIS opiera się na wielojęzycznej taksonomii EuroSciVoc, obejmującej wszystkie dziedziny nauki, w oparciu o półautomatyczny proces bazujący na technikach przetwarzania języka naturalnego. Więcej informacji: https://op.europa.eu/pl/web/eu-vocabularies/euroscivoc.

Aby użyć tej funkcji, musisz się zalogować lub zarejestrować

Program(-y)

Wieloletnie programy finansowania, które określają priorytety Unii Europejskiej w obszarach badań naukowych i innowacji.

Temat(-y)

Zaproszenia do składania wniosków dzielą się na tematy. Każdy temat określa wybrany obszar lub wybrane zagadnienie, których powinny dotyczyć wnioski składane przez wnioskodawców. Opis tematu obejmuje jego szczegółowy zakres i oczekiwane oddziaływanie finansowanego projektu.

Zaproszenie do składania wniosków

Procedura zapraszania wnioskodawców do składania wniosków projektowych w celu uzyskania finansowania ze środków Unii Europejskiej.

Brak dostępnych danych

System finansowania

Program finansowania (lub „rodzaj działania”) realizowany w ramach programu o wspólnych cechach. Określa zakres finansowania, stawkę zwrotu kosztów, szczegółowe kryteria oceny kwalifikowalności kosztów w celu ich finansowania oraz stosowanie uproszczonych form rozliczania kosztów, takich jak rozliczanie ryczałtowe.

CSC - Cost-sharing contracts

Koordynator

CONSORZIO INTERUNIVERSITARIO PER LA GESTIONE DEL CENTRO DI CALCOLO ELETTRONICO DELL'ITALIA NORD-ORIENTALE
Wkład UE
Brak danych
Adres
VIA MAGNANELLI 6/3
40033 CASALECCHIO DI RENO (BOLOGNA)
Włochy

Zobacz na mapie

Koszt całkowity

Ogół kosztów poniesionych przez organizację w związku z uczestnictwem w projekcie. Obejmuje koszty bezpośrednie i pośrednie. Kwota stanowi część całkowitego budżetu projektu.

Brak danych

Uczestnicy (5)

Moja broszura 0 0