Skip to main content
Go to the home page of the European Commission (opens in new window)
English English
CORDIS - EU research results
CORDIS

Research on Embodied Perception and Intelligent Interaction Methods Driven by Multimodal Large Models

Project description

Embodied artificial intelligence: Integrating sensory input intelligently in robotics

Embodied intelligence refers to the ability of ‘agents’ to respond to cues from their ‘bodies’ and environments with intelligent behaviours. It has an important role to play in improving the cognitive capabilities of robots in diverse environments including the home, medical arena and industry compared to current pre-programming of specific behaviours. With the support of the Marie Skłodowska-Curie Actions programme, the Embodied Perception project aims to leverage multimodal models (relying on integration of multiple sensory modalities) supporting embodied intelligence. Specifically, accurate 3D visual orientation, enhanced perception, language understanding, intelligent reasoning and situational awareness will augment the interactive capabilities of robots in complex environments.

Objective

With the rapid development of artificial intelligence technology, embodied intelligence has shown tremendous potential in fields such as home robotics, medical robots, and industrial design. This research focuses on open-world embodied perception and intelligent interaction methods driven by multimodal large models, aiming to develop advanced models that achieve accurate 3D visual grounding and intelligent reasoning, thereby enhancing the perceptual and interactive capabilities of robots in complex environments. The study will explore how to utilize multimodal large models to process and integrate various sensory inputs, enabling robots to accurately perceive 3D environments, understand context, and make intelligent decisions. Additionally, this research will strive to improve robots' natural interaction capabilities with humans and the environment, including language understanding and situational adaptation. This research not only holds significant academic value and profound implications for advancing artificial intelligence and robotics technologies, but also provides innovative solutions to challenges in practical applications, contributing importantly to improving production efficiency, enhancing medical services, and elevating quality of life.

Fields of science (EuroSciVoc)

CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.

You need to log in or register to use this function

Keywords

Project’s keywords as indicated by the project coordinator. Not to be confused with the EuroSciVoc taxonomy (Fields of science)

Programme(s)

Multi-annual funding programmes that define the EU’s priorities for research and innovation.

Topic(s)

Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.

Funding Scheme

Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.

HORIZON-TMA-MSCA-PF-EF - HORIZON TMA MSCA Postdoctoral Fellowships - European Fellowships

See all projects funded under this funding scheme

Call for proposal

Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.

(opens in new window) HORIZON-MSCA-2024-PF-01

See all projects funded under this call

Coordinator

UNIVERSITY COLLEGE LONDON
Net EU contribution

Net EU financial contribution. The sum of money that the participant receives, deducted by the EU contribution to its linked third party. It considers the distribution of the EU financial contribution between direct beneficiaries of the project and other types of participants, like third-party participants.

€ 260 347,92
Address
GOWER STREET
WC1E 6BT LONDON
United Kingdom

See on map

Region
London Inner London — West Camden and City of London
Activity type
Higher or Secondary Education Establishments
Links
Total cost

The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.

No data
My booklet 0 0