Dissertation Defence: An Exploration of Body-Anchored User Interfaces for Augmented Reality Across Different Mobility and Social Contexts

Marium-E Jannat, supervised by Dr. Khalad Hasan, will defend their dissertation titled “An Exploration of Body-Anchored User Interfaces for Augmented Reality Across Different Mobility and Social Contexts” in partial fulfillment of the requirements for the degree of Doctor of Philosophy in Computer Science.

An abstract for Marium-E Jannat’s dissertation is included below.

Examinations are open to all members of the campus community as well as the general public. Please email khalad.hasan@ubc.ca to receive the Zoom link for this exam.

---

Abstract

Augmented Reality (AR) head-mounted displays (HMDs) are increasingly envisioned as the next generation of personal computing platforms, enabling seamless access to digital information in everyday life. However, existing AR interface paradigms often rely on fixed mid-air displays that are poorly suited to dynamic real-world environments. Such designs limit comfort, contextual acceptability, and usability, particularly in mobile and socially diverse situations. This thesis investigates how different parts of the human body — specifically the hand, arm, torso, and head — can serve as the reference frame for anchoring AR interfaces to support contextual and mobility-aware interaction. The research is organized into six major empirical studies presented over three chapters. The first explores user preferences for anchoring AR interfaces across on-body, mid-air, and physical surfaces, while the second study further examines how users transition interfaces between these spaces with varying levels of automation and user control. Findings show that users prefer body-anchored interfaces over mid-air in all usage scenarios, and semi-automatic transitions that balance autonomy and control. The third study investigates different parts of the body (e.g., palm, forearm, lap) for anchoring UI across different mobility conditions (sitting, standing, walking) and social contexts (private, semi-private, public). Results reveal that the outer forearm and palm are the most preferred locations for AR interfaces. The fourth study further shows that vertically oriented enlarged layouts of such UIs improve comfort and performance. The fifth study evaluates six on-hand reference frames while walking, identifying the Pinch Grip With Offset (PGWO) configuration as the most effective and user-preferred. Finally, the sixth study confirms that PGWO outperforms traditional head- and torso-anchored UIs in both target selection and information access tasks. Together, these studies contribute a comprehensive framework for designing body-anchored, context-aware AR interfaces. The thesis offers empirical insights into how mobility, social context, and embodiment shape AR interaction, alongside methodological contributions for evaluating adaptive interfaces. By grounding interface anchoring in mobility and contextual adaptation, this research advances the development of AR systems that are physically ergonomic, cognitively efficient, and socially appropriate for everyday use.