1. Selection of hardware
Technologies for VR and AR applications were evaluated for their opportunities to use them during flight. Three devices were selected: (1) the Microsoft HoloLens as model for high-cost, untethered AR, (2) an up-to-date Android Smartphone using Samsung Gear VR as model for low-cost, untethered VR and (3) the Oculus Rift CV-1 as a model for high-cost, tethered VR. These devices are good examples for the different models of immersive technology that can be expected to be used in flight in the aircraft cabin of the near future.
2. Creation of use case
A use case was developed and analysed in a structured way using a design approach: an in-flight meal information experience using the Microsoft HoloLens. The use case was detailed, an initial software prototype was made and the associated potential human factors issues were identified. After further economical analysis, it was decided to abandon this use case. Instead, a way finding experience for transfer passengers was chosen as the use case for the project.
3. Design of Human Factors Impact Analysis methodology
A methodology was developed to identify and evaluate potential human factor issues of immersive experiences within an aircraft cabin environment in a structured and efficient way. The methodology was adapted from EASA’s flight deck “human factor certification” (CS/AMC 25.1302) and covers impact of immersive technologies on safety, service, and passenger comfort. The methodology helps to quickly focus on aspects of immersive experiences that are novel, complex from a passenger standpoint and integrated with other experiences. The methodology offers practical support by providing a checklist for identifying potential issues and an overview of tools and methodologies for assessment of passenger state.
4. Development of a concept proposal
A concept proposal was created for the transfer passenger way finding use case. It takes into account items such as required hardware and software, integration, flight safety, security, potential legal issues, aircraft system architecture and airline business case. Altogether, it provides a holistic view for the application of AR/VR in the cabin.
5. Evaluation of a concept demonstrator
A concept demonstrator of the transfer passenger use case was developed and evaluated in a motion base cabin simulator. People representative of the adult passenger population and cabin crew population were invited to participate in the structured human-in-the-loop evaluations. The test plan was created using the human factors methodology developed in the project.