Multimodal user interfaces for context-aware mobile applications

Abstract

This paper introduces a generic architecture that enables the development and execution of mobile multimodal applications proposed within the EU IST-511607 project MobiLife. MobiLife aims at exploiting the synergetic use of multimodal user interface technology and contextual information processing, with the ultimate goal that the two together can provide a beyond-the-state-of-the- art user experience. And this led to an integrated concept, components of the underlying architecture are described in detail and the interfaces towards the application back-end as well as towards context aware resources are discussed. The paper also positions the current work against existing standardisation efforts and it pinpoints technologies required to support the implementation of a device and modality function within the MobiLife architecture.