Enhancing art history education through mobile augmented reality

Abstract

This paper describes a new project which will focus on the integration of eye-tracking technology with mobile Augmented Reality (AR) systems. AR provides an enhanced vision of the physical world by integrating virtual elements, such as text and graphics, with real-world environments. The advent of affordable mobile technology has sparked a resurgence of interest in mobile AR applications. Inherent in mobile AR applications is the powerful ability to visually highlight information in the real world. We are working on new algorithms to harness this ability to direct gaze to Points of Interest (POIs). Combining mobile AR and image manipulation gives visual distinction to POIs in order to directly influence and direct gaze in real world scenes. Our initial test domain is that of Art History Education. POIs are determined based on salient regions of paintings, as identified by the visual narrative of the painting. We are developing new system that will be deployed in the Museum of Fine Art in Houston that will enhance visitor education through the use of gaze-directed mobile AR.