More details and instructions for each session will be shared on this page soon. Detailed information will also be shared directly with corresponding authors


Time in PDT Wednesday 28/9 Thursday 29/9 Friday 30/9 Saturday 01/10
7:30am-12pm Registration
Workshops (H)

Tutorials (H)

Doctoral Consortium (H)

Locations available through respective links above
8:00am-8:30am Chairs Welcome (H)
Asia Pacific Hall
Opening Remarks (H)
Asia Pacific Hall
Opening Remarks (H)
Asia Pacific Hall
8:30am - 9:45am Opening Keynote (H)
Bongshin Lee

Asia Pacific Hall
10-Year Impact Award (H)
Asia Pacific Hall
Closing Keynote (H)
Chris Harrison

Asia Pacific Hall
9:45am-10:30am Break Break with Student Design Competition (P)
Room 320-370
Break with Posters and Demos (V)
Room 320-370
10:30am-11:45am Paper Session 1: Input and Interaction
Asia Pacific Hall
Paper Session 4: Monitoring People
Asia Pacific Hall
Panel Session (H)
Asia Pacific Hall
11:45am-2:00pm Lunch Break Town Hall (11:45am-12:30pm)
Lunch Break (12:30pm-2:00pm)
2:00pm - 3:15pm Paper Session 2: Understanding People and Robots
Asia Pacific Hall
Paper Session 5: On your bike
Asia Pacific Hall
Paper Session 7: Protecting People
Asia Pacific Hall
3:15pm - 3:45pm Break Break with Posters and Demos (P)
Room 320-370
Break with Sponsor's Presentations (H)
Room 320-370
3:45pm - 5:00pm Paper Session 3: In your Car
Asia Pacific Hall
Paper Session 6: Augmenting your Reality
Asia Pacific Hall
Paper Session 8: Assisting People with Technology
Asia Pacific Hall
5:00pm - 5:45pm Break Break with Student Design Competition (V)
Room 320-370
Closing Remarks and Awards (H)
Asia Pacific Hall
6:00pm - 8:30pm Conference Reception (P)
Steamworks Pub


Session 1 - Input and Interaction: Carman Neustaedter

Wednesday September 28, 10:30am

  • TrackballWatch: Trackball and Rotary Knob as a Non-Occluding Input Method for Smartwatches in Map Navigation Scenarios
    Dennis Stanke, Peer Schroth, and Michael Rohs
  • Understanding and Adapting Bezel-to-Bezel Interactions for Circular Smartwatches in Mobile and Encumbered Scenarios
    Bradley Rey, Kening Zhu, Simon Perrault, Sandra Bardot, Ali Neshati, and Pourang Irani
  • Interacting with Rigid and Soft Surfaces for Smart-Home Control
    Michael Chamunorwa, Mikołaj Woźniak, Sarah Vöge, Heiko Müller, and Susanne Boll
  • Conductive Fiducial Tangibles for Everyone: A Data Simulation-Based Toolkit using Deep Learning
    Benedict Steuerlein and Sven Mayer
  • Spatial model personalization in Gboard
    Gary Sivek and Michael Riley

Session 2 - Understanding People and Robots: Thomas Kosch

Wednesday September 28, 2:00pm

  • What Is Happening Behind The Wall? Towards A Better Understanding of A Hidden Robot's Intent By Multimodal Cues
    Khaled Kassem, Tobias Ungerböck, Philipp Wintersberger, and Florian Michahelles
  • Addressing Waste Separation With a Persuasive Augmented Reality App
    Philipp Schaper, Anna Riedmann, Sebastian Oberdörfer, Maileen Krähe, and Birgit Lugrin
  • Imprecise but Fun: Playful Interaction Using Electromyography
    Jakob Karolus, Simon Thanheiser, David Peterson, Nicolas Viot, Thomas Kosch, Albrecht Schmidt, and Paweł W. Woźniak
  • Troi: Towards Understanding Users Perspectives to Mobile Automatic Emotion Recognition System in Their Natural Setting
    Vipula Dissanayake, Vanessa Tang, Don Samitha Elvitigala, Elliott Wen, Michelle Wu, and Suranga Nanayakkara
  • The Reappropriation of Instant Messaging: Texting Ourselves, Message Dumping, and Revisiting Conversations
    Claire Cheng and Leila Aflatoony
  • Session 3 - In your Car: Andrii Matviienko

    Wednesday September 28, 3:45pm

    • Designing Mobile MR Workspaces: Effects of Reality Degree and Spatial Configuration during Passenger Productivity in HMDs
      Jingyi Li, Luca Woik, and Andreas Butz
    • Investigating the Effects of External Communication and Automation Behavior on Manual Drivers at Intersections
      Mark Colley, Tim Fabian, and Enrico Rukzio
    • Towards Implicit Interaction in Highly Automated Vehicles - A Systematic Literature Review
      Annika Stampf, Mark Colley, and Enrico Rukzio
    • A Systematic Evaluation of Solutions for the Final 100m Challenge of Highly Automated Vehicles
      Mark Colley, Bastian Wankmüller, and Enrico Rukzio
    • honorable AR4CAD: Creation and Exploration of a Taxonomy of Augmented Reality Visualization for Connected Automated Driving
      Tobias Müller, Mark Colley, Gülsemin Dogru, and Enrico Rukzio

    Session 4 - Monitoring People: Stefan Schneegass

    Thursday September 29, 10:30am

  • Ubiquitous Machinery Monitoring – A Field Study on Manufacturing Workers’ User Experience of Mobile and Wearable Monitoring Apps
    Sebastian Müller, Matthias Baldauf, and Arne Seeliger
  • BreatheBuddy: Tracking Real-time Breathing Exercises for Automated Bio-feedback Using Commodity Earbuds
    Md Mahbubur Rahman, Tousif Ahmed, Mohsin Ahmed, Minh Dinh, Ebrahim Nemati, Jilong Kuang, and Jun Alex Gao
  • EatingTrak: Detecting fine-grained eating moments in the wild using a wrist-mounted IMU
    Ruidong Zhang, Jihai Zhang, Nitish Gade, Peng Cao, Se Yun Kim, Junchi Yan, and Cheng Zhang
  • honorable How Does Sleep Tracking Influence Your Life? Experiences from a Longitudinal Field Study with a Wearable Ring
    Elina Kuosmanen, Aku Visuri, Saba Kheirinejad, Niels van Berkel, Heli Koskimäki, Denzil Ferreira, and Simo Hosio
  • “You have been in Close Contact with a Person Infected with COVID-19 and you may have been Infected”: Understanding Privacy Concerns, Trust and Adoption in Mobile COVID-19 Tracing Across Four Countries
    Oksana Kulyk, Elda Paja, Melanie Duckert, Lauren Britton, and Louise Barkhuus
  • Session 5 - On your bike: Mark Dunlop

    Thursday September 29, 2:00pm

    • NotiBike: Assessing Target Selection Techniques for Cyclist Notifications in Augmented Reality
      Thomas Kosch, Andrii Matviienko, Florian Müller, Jessica Bersch, Christopher Katins, Dominik Schön, and Max Mühlhäuser
    • Development and Evaluation of a Motion-based VR Bicycle Simulator
      Philipp Wintersberger, Andrii Matviienko, Andreas Schweidler, and Florian Michahelles
    • "Baby, You can Ride my Bike": Exploring Maneuver Indications of Self-Driving Bicycles using a Tandem Simulator
      Andrii Matviienko, Damir Mehmedovic, Florian Müller, and Max Mühlhäuser
    • honorable Free as a Bird, but at What Cost? The Impact of Street Networks on the User Experience of As-The-Crow-Flies Navigation for Cyclists
      Gian-Luca Savino, Ankit Kariryaa, and Johannes Schöning
    • Tailor My Zwift: How to Design for Amateur Sports in the Virtual World
      Marit Bentvelzen, Gian-Luca Savino, Jasmin Niess, Judith Masthoff, and Paweł W. Woźniak

    Session 6 - Augmenting your Reality: Géry Casiez

    Thursday September 29, 3:45pm

  • ARm Haptics: 3D-Printed Wearable Haptics for Mobile Augmented Reality
    Uwe Gruenefeld, Alexander Geilen, Jonathan Liebers, Nick Wittig, Marion Koelle, and Stefan Schneegass
  • Augmented Reality Based Video Shooting Guidance for Novice Users
    Jiefeng Li, Yingying She, Fang Liu, Chun Yu, Xiaoli Wang, and Yuxin Xu
  • AR Sightseeing: Comparing Information Placements at Outdoor Historical Heritage Sites using Augmented Reality
    Andrii Matviienko, Sebastian Günther, Sebastian Ritzenhofen, and Max Mühlhäuser
  • A Study into the Effect of Mobile Device Configurations on Co-Located Collaboration using AR
    Thomas Wells, Dominic Potts, and Steven Houben
  • OsciHead: Simulating Versatile Force Feedback on an HMD by Rendering Various Types of Oscillation
    Ching-Wen Hung, Hsin-Ruey Tsai, Chi-Chun Su, Jui-Cheng Chiu, and Bing-Yu Chen
  • Session 7 - Protecting People: Gary Sivek

    Friday September 30, 2:00pm

    • Understanding User Centered Attacks - An Investigation of Shoulder Surfing Attacks on Touch-Based Unlock Events
      Stefan Schneegass, Alia Saad, Roman Heger, Sarah Delgado Rodriguez, Romina Poguntke, and Florian Alt
    • The Influence of Transparency and Control on the Willingness of Data Sharing in Adaptive Mobile Apps
      Florian Bemmann, Maximiliane Windl, Jonas Erbe, Sven Mayer, and Heinrich Hussmann
    • The Skewed Privacy Concerns of Bystanders in Smart Environments
      Maximiliane Windl and Sven Mayer
    • Holding Your Hand on the Danger Button: Observing User Phish Detection Strategies Across Mobile and Desktop
      Matt Dixon, James Nicholson, Dawn Branley-Bell, Pamela Briggs, and Lynne Coventry
    • How to Display Vehicle Information to Support UX and Trust while Conducting Non-Driving-Related Activities during Fully Automated Driving
      Aditya Dandekar, Lesley-Ann Mathis, Melanie Berger, and Bastian Pfleging

    Session 8 - Assisting People with Technology: Dylan Gaines

    Friday September 30, 3:45pm

  • Corridor-Walker: Mobile Indoor Walking Assistance for Blind People to Avoid Obstacles and Recognize Intersections
    Masaki Kuribayashi, Seita Kayukawa, Jayakorn Vongkulbhisal, Chieko Asakawa, Daisuke Sato, Hironobu Takagi, and Shigeo Morishima
  • Evaluation of Common External Communication Concepts of Automated Vehicles for People With Intellectual Disabilities
    Mathias Haimerl, Mark Colley, and Andreas Riener
  • The cost of knowing: How obstacle alerts reduce walking speeds of augmented white cane users
    Milo Skovfoged, Alexander Rasmussen, and Hendrik Knoche
  • CheckMyFit: Ear Selfie to Assist User Insertion of Hearing Aids
    Qi Yang, Michalis Papakostas, Jack Scott, Erin O'Neill, Kirill Kondrashov, Victor Mateevitsi, Gregory Olsen, and Andrew Dittbe
  • bestpaperOneButtonPIN: A Single Button Authentication Method for Blind or Low Vision Users to Improve Accessibility and Prevent Eavesdropping
    Manisha Varma Kamarushi, Stacey Watson, Garreth Tigwell, and Roshan Peiris

  • Opening keynote

    Human-Data Interaction for All

    Bongshin Lee

    People generate and consume a significant amount of data in their daily lives. Such data holds great promise for empowering them in work, social, and personal contexts. Over the last few decades, data visualization has shown to be a powerful means to understand and communicate data. However, visualization research has traditionally focused on limited aspects of how people interact with data. The majority of the research has targeted a desktop environment, equipped with a mouse and keyboard, for a particular group of people, such as data experts or non-disabled individuals. I argue that we should design and develop for a broader scope of activities and contexts people engage in with data, as well as the audience who perform such activities. In this talk, I will present fluid, flexible, and engaging data interaction experiences I have explored in non-desktop contexts, leveraging advancements in input and interaction technologies. Synergistically combining multiple input modalities, such as pen, touch, and speech can facilitate fluid data interaction on wall-size displays and mobile devices. In addition, smartphones and smartwatches can enable data collection activities, accommodating diverse personal needs and goals. I will also suggest exciting research opportunities we can pursue in enriching data interaction experiences for a broader audience.

    Portrait of Bongshin Lee Bongshin Lee is a Senior Principal Researcher at Microsoft Research. She conducts research on data visualization, human-computer interaction, and human-data interaction, focusing on the design, development, and evaluation of novel visualization and interaction techniques. Lee strives to empower people to achieve their goals by leveraging data, visualization, and technological advancements. She explores innovative ways to help people interact with data, by supporting easy and effective data collection, data exploration & analysis, and data-driven communication. Lee is the Chair of the IEEE VGTC (Visualization and Graphics Technical Community) and a member of the IEEE Visualization Executive Committee and ACM ISS Steering Committee. She was inducted into the IEEE Visualization Academy in 2020. Lee currently serves as the Overall Papers Co-Chair for VIS 2022. She served as the General Co-Chair for ISS 2019 and IEEE PacificVis 2017, Subcommittee Co-Chair for ACM CHI 2021 \& 2022 (for the Visualization Subcommittee), Overall Papers Co-Chair for VIS 2021, as well as Papers Co-Chair for IEEE InfoVis 2015 & 2016, and IEEE PacificVis 2018. Lee received her PhD in Computer Science from the University of Maryland at College Park in 2006.

    Closing keynote

    Portrait of Chris Harrison

    Human-Computer Interaction (HCI) is very often described as a practical and applied field, tackling real problems faced by real users. And yet, our real-world orientation seems to rarely translate into real-world impact. There are surprisingly few startups coming out of the large HCI community, and very few people among us can rightly claim “that feature [or product] came from my paper!” This naturally begs the question: “Why are we doing all this research if it’s never adopted?!” In this keynote talk, I will attempt to unpick the forces at play behind this substantive issue, drawing on both historical examples and my own experiences as an academic and entrepreneur. In short, there is a constellation of factors – big and small – that contribute to a sort of innovation “fog of war”. Second, it may be that we are over-focused on being practical and applied, when we should be more impractical and decoupled from today’s reality, and instead be planting impactful seeds for the future.

    Spotting the Elusive Grandis impactus in the HCI Savannah

    Chris Harrison

    Chris Harrison is an Associate Professor of Human-Computer Interaction at Carnegie Mellon University. Dr. Harrison leads the Future Interfaces Group (, broadly investigating novel sensing and interactive technologies. Dr. Harrison has authored more than 100 peer-reviewed papers and his work appears in more than 40 books. For his innovations, Harrison has been named as a Top 35 Innovator by MIT Technology Review, a Top 30 Scientist by Forbes, and a World Economic Forum Young Scientist. Harrison has also been named a fellow by the Packard Foundation, Sloan Foundation, Google, Qualcomm and Microsoft Research. He is also co-founder and CTO of Qeexo, a CMU spinoff working at the intersection of interactive technologies and artificial intelligence. His website is (

    10 year impact award

    We are pleased to present this year’s 10-year impact award to Drs. Shiri Azenkot and Shumin Zhai for their paper at MobileHCI 2012 entitled Touch behavior with different postures on soft smartphone keyboards.

    Portrait of Shiri Azenkot

    Shiri Azenkot is an Associate Professor at the Jacobs Technion-Cornell Institute at Cornell Tech and the Technion. She is a member of the Information Science field at Cornell University. She is broadly interested in human-computer interaction and accessibility. Professor Azenkot’s research focuses on enabling people with disabilities to have equal access to information via mobile and wearable devices. She received a Ph.D. in Computer Science from the University of Washington in 2014, where she was awarded the Graduate School Medal, an NSF Graduate Research Fellowship, and an AT&T Labs Graduate Fellowship. She also holds a B.A. in Computer Science from Pomona College.

    Portrait of Shiri Azenkot

    Shumin Zhai is currently a Principal Scientist at Google where he leads and directs research, design, and production of user interface technologies such as touch gesture input, haptics, voice and text inputs, and interaction methods. His and his colleagues’ work at Google has been featured in Android and Pixel products that touch users worldwide. Shumin’s past research had made contributions to both theoretical models of HCI and practical inventions such as gesture typing (aka SHARK/ShapeWriter). From 2009 to 2015, he served as the Editor-in-Chief of ACM TOCHI. He is a Member of the CHI Academy, Fellow of the ACM, and inductee to the University of Toronto’s Engineering Alumni Hall of Distinction.

    Panel Session

    Title: Future of Work and Learning in Mobile Environments


    Technological advances combined with societal shifts have changed how and where people work and learn. The Covid-19 pandemic forced a sudden and broad shift to remote work and learning, which resulted in dramatic, sustained, and evolving change. What is the role of the MobileHCI community in facilitating work and learning in non-traditional environments such as homes, cars, public transportation and spaces? What are the pressing challenges in designing, implementing, and evaluating systems that support work and learning in mobile environments? This panel will bring together interdisciplinary perspectives to discuss these questions.


    Dr. Amanda McGowan is an Assistant Professor in the Department of Psychology at Concordia University, Montréal. Dr. McGowan completed her PhD at Michigan State University and postdoctoral training at the University of Pennsylvania. Combining ambulatory assessment, psychophysiological measures, and network science tools, her research aims to uncover relationships between lifestyle behaviours and wellness with the aim of designing scalable mobile health solutions that enhance well-being by engaging people where they spend their time--at home, school, or as they go about their daily routines in their neighbourhoods.

    Dr. Andreas Butz is a professor of Human-Computer Interaction in the CS department of LMU Munich, Germany. He is interested in physical and tangible interaction, as well as interaction in Ubiquitous Computing, and lately also with robots or VR. His work on human-centered intelligent environments was awarded the Alcatel-Lucent Research Award in 2007. In his spare time, Andreas is a trainer for the German Alpine club and a passionate hobby triathlete. He will compete in Ironman Hawaii the week after the MobileHCI conference.

    Dr Shumin Zhai is Principal Scientist at Google where he leads and directs research, design, and development of human-device input methods and haptics systems. His research career has contributed to both foundational models and understandings of human-computer interaction (HCI) and practical user interface designs, inventions, and flagship products. His publications have won the ACM UIST Lasting Impact Award and the IEEE Computer Society Best Paper Award, among others. In 2006, he was named one of ACM's inaugural class of Distinguished Scientists. In 2010 he was named a Member of the CHI Academy and Fellow of the ACM.