Document Type

Conference Proceeding

Publication Date

6-18-2023

Journal / Book Title

Mobisys 2023 Proceedings of the 21st Annual International Conference on Mobile Systems Applications and Services

Abstract

Augmented Reality (AR) devices are set apart from other mobile devices by the immersive experience they offer. While the powerful suite of sensors on modern AR devices is necessary for enabling such an immersive experience, they can create unease in bystanders (i.e., those surrounding the device during its use) due to potential bystander data leaks, which is called the bystander privacy problem. In this poster, we propose BystandAR, the first practical system that can effectively protect bystander visual (camera and depth) data in real-time with only on-device processing. BystandAR builds on a key insight that the device user's eye gaze and voice are highly effective indicators for subject/bystander detection in interpersonal interaction, and leverages novel AR capabilities such as eye gaze tracking, wearer-focused microphone, and spatial awareness to achieve a usable frame rate without offloading sensitive information. Through a 16-participant user study, we show that BystandAR correctly identifies and protects 98.14% of bystanders while allowing access to 96.27% of subjects. We accomplish this with average frame rates of 52.6 frames per second without the need to offload unprotected bystander data to another device.

Comments

This poster is made available by the publisher under a public access mandate.

DOI

10.1145/3581791.3597377

Journal ISSN / Book ISBN

85166124854 (Scopus)

Published Citation

Matthew Corbett, Brendan David-John, Jiacheng Shang, Y. Charlie Hu, and Bo Ji. 2023. Poster: BystandAR: Protecting Bystander Visual Data in Augmented Reality Systems. In Proceedings of the 21st Annual International Conference on Mobile Systems, Applications and Services (MobiSys '23). Association for Computing Machinery, New York, NY, USA, 583–584. https://doi.org/10.1145/3581791.3597377

Download
Link to Publisher

Share

COinS