Beyond the Desktop and Tablet

Opportunities and Challenges of Creating Effective Augmented Reality User Experiences
As we see augmented reality (AR) applications move from research labs to commercial applications, the need for usable AR-based systems has become more and more evident. Despite the fact that AR technology fundamentally changes the way we visualize, use, and interact with computer-based information, only a modest amount of human-computer interaction (HCI) work, especially user-centered design or usability evaluations, has been done. Encouragingly, traditional HCI methods can be applied to determine what information should be presented to users. However, these approaches do not tell us, and what has to date has not been adequately explored, is how information should be presented to the user and the impacts of interface design on user performance and behavior. In this talk, I discuss the nascent design opportunities afforded by augmented and mixed reality technologies. I present a sample of recent research that illustrate the challenges associated with designing and evaluating effective AR user interfaces. I conclude with an argument that traditional HCI measures of effectiveness, such as time-on-task and errors alone, are insufficient in understanding the impact of AR on human performance.