Audio Augmentation of Manual Interactions to Support Mindfulness
Yujie Tao, Jingjin Li, Lijuan Ye, Andrew J. Zhang, Jeremy N. Bailenson, Sean Follmer
Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies December 2, 2025 DOI: 10.1145/3770706 (opens in new tab)
Study at a glance
AI-extracted from the abstract| Characteristics | Preregistered in-lab study Peer reviewed |
|---|---|
| Sample size | 60 |
| Population | Participants in an object exploration task |
| Topics | Meditation |
| Keywords | Curiosity Wearable computer Everyday life Focus optics Smartwatch Object grammar Wearable technology Perspective graphical Human–computer interaction Cognitive psychology Lifelog Space punctuation Meaning existential Exploratory research Applied psychology Key lock Multimedia Innovative human-technology interaction |
| Key points | Audio augmentation enhanced self-reported state mindfulness, increased interaction duration, and promoted exploratory behavior patterns. |
Abstract
Mindfulness is the state of maintaining attention to the present moment with curiosity and openness. Existing mobile technologies to support mindfulness focus on formal practices such as meditation, requiring dedicated space and time. However, everyday mindfulness—a more flexible form of practice woven into routine activities such as washing hands or cooking—remains under-supported. To address this gap, we introduce a wearable device that adopts a sensory-driven approach to foster two key components of mindfulness, attention and curiosity, in everyday contexts. Our device amplifies sounds produced by the user's hand interactions to make them more salient, such as the sounds of hands rubbing together or fingertips sliding across surfaces. By playing back the amplified sounds to the user in real time, the device leads to a fresh perspective on mundane interactions. We conducted a preregistered in-lab study with 60 participants to evaluate the device in an everyday task: object exploration. We found that audio augmentation enhanced self-reported state mindfulness, directing user attention to auditory properties of objects that would otherwise be overlooked. Behaviorally, audio augmentation caused participants to interact with objects for a longer duration than participants who did not experience audio augmentation. We also found that participants exhibited more trial-and-error exploratory behavior patterns with audio augmentation than without, suggesting increased curiosity.