Project description FET - Open Show the project objective Hide the project objective Virtual environments (VEs) play an increasingly important role in our society. Currently two main sensorial channels are exploited in VEs: visual and auditory, although sound is greatly underused. The ever-increasing scene complexity of VEs means that it is currently not possible to display highly realistic scenes in real time despite the availability of modern high-performance graphics and audio processors. However, the realism and quality of a virtual image/sound needs to be as good as what the user can perceive: we only need to display what is necessary. Despite recent research, little work exists on cross-modal effects, i.e. the effects that each channel (visual and auditory) has on the other, to improve the efficiency and quality of VEs. CROSSMOD will study these effects and develop a better understanding of how perceptual issues affect auditory/visual display; this understanding will lead to the development of novel algorithms for selectively rendering VEs. The cross-modal effects studied will potentially include the effect of spatial/latency congruence on quality perception, attention-control, sound-induced changes in visual perception and foveal/peripheral audiovisual effects. These initial experiments will be guided by their applicability to the improvement of VE display and authoring. An integrated cross-modal manager will be developed, using results of the initial experiments identifying which cross-modal effects are useful for VE display. The solutions developed by CROSSMOD will enable the display of perceptually highly realistic environments in real time even for very complex scenes, as well as the use of active cross-modal effects such as attention control in the display and authoring of VEs. We will evaluate our hypotheses with further experiments in realistic, complex VEs. Further evaluation will be performed on three target applications: computer games, design/architecture and clinical psychiatry, using platforms adapted to each application. Fields of science medical and health sciencesclinical medicinepsychiatry Programme(s) FP6-IST - Information Society Technologies: thematic priority under the specific programme "Integrating and strengthening the European research area" (2002-2006). Topic(s) IST-2002-2.3.4.1 - FET - Open Call for proposal FP6-2002-IST-C See other projects for this call Funding Scheme STREP - Specific Targeted Research Project Coordinator INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET EN AUTOMATIQUE EU contribution € 387 785,00 Address 2004, route de Lucioles F-06902 Sophia-Antipolis France See on map Total cost No data Participants (6) Sort alphabetically Sort by EU Contribution Expand all Collapse all TECHNISCHE UNIVERSITAET WIEN Austria EU contribution € 231 311,00 Address KARLSPLATZ 13 1040 WIEN See on map Activity type Higher or Secondary Education Establishments Total cost No data FRIEDRICH-ALEXANDER UNIVERSITAET ERLANGEN - NUERNBERG Germany EU contribution € 178 713,00 Address SCHLOSSPLATZ 4 91054 ERLANGEN See on map Total cost No data INSTITUT DE RECHERCHE ET DE COORDINATION ACOUSTIQUE MUSIQUE - IRCAM France EU contribution € 249 250,00 Address RUE SAINT MERRI 31 75004 PARIS See on map Total cost No data CENTRE NATIONAL DE LA RECHERCHE SCIENTIFIQUE France EU contribution € 150 551,00 Address 3, RUE MICHEL-ANGE 75794 PARIS See on map Total cost No data CONSIGLIO NAZIONALE DELLE RICERCHE Italy EU contribution € 170 808,00 Address PIAZZALE ALDO MORO 7 00185 ROMA See on map Activity type Research Organisations Total cost No data UNIVERSITY OF BRISTOL Participation ended United Kingdom EU contribution € 186 582,00 Address SENATE HOUSE, TYNDALL AVENUE BS8 1TH BRISTOL See on map Total cost No data