Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT)


Search Issue
enter search term and/or author name


Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Volume 1 Issue 3, September 2017

Cognitive Heat: Exploring the Usage of Thermal Imaging to Unobtrusively Estimate Cognitive Load
Yomna Abdelrahman, Eduardo Velloso, Tilman Dingler, Albrecht Schmidt, Frank Vetere
Article No.: 33
DOI: 10.1145/3130898

Current digital systems are largely blind to users’ cognitive states. Systems that adapt to users’ states show great potential for augmenting cognition and for creating novel user experiences. However, most approaches for sensing...

Drone Near Me: Exploring Touch-Based Human-Drone Interaction
Parastoo Abtahi, David Y. Zhao, L. E. Jane, James A. Landay
Article No.: 34
DOI: 10.1145/3130899

Personal drones are becoming more mainstream and are used for a variety of tasks, such as delivery and photography. The exposed blades in conventional drones raise serious safety concerns. To address this, commercial drones have been moving...

Camera Based Two Factor Authentication Through Mobile and Wearable Devices
Mozhgan Azimpourkivi, Umut Topkara, Bogdan Carbunar
Article No.: 35
DOI: 10.1145/3131904

We introduce Pixie, a novel, camera based two factor authentication solution for mobile and wearable devices. A quick and familiar user action of snapping a photo is sufficient for Pixie to simultaneously perform a graphical password...

Exploring How Drivers Perceive Spatial Earcons in Automated Vehicles
David Beattie, Lynne Baillie, Martin Halvey
Article No.: 36
DOI: 10.1145/3130901

Automated vehicles seek to relieve the human driver from primary driving tasks, but this substantially diminishes the connection between driver and vehicle compared to manual operation. At present, automated vehicles lack any form of continual,...

EarBit: Using Wearable Sensors to Detect Eating Episodes in Unconstrained Environments
Abdelkareem Bedri, Richard Li, Malcolm Haynes, Raj Prateek Kosaraju, Ishaan Grover, Temiloluwa Prioleau, Min Yan Beh, Mayank Goel, Thad Starner, Gregory Abowd
Article No.: 37
DOI: 10.1145/3130902

Chronic and widespread diseases such as obesity, diabetes, and hypercholesterolemia require patients to monitor their food intake, and food journaling is currently the most common method for doing so. However, food journaling is subject to...

How to Remember What to Remember: Exploring Possibilities for Digital Reminder Systems
R. N. Brewer, M. R. Morris, S. E. Lindley
Article No.: 38
DOI: 10.1145/3130903

Digital reminder systems typically use time and place as triggers to remind people to perform activities. In this paper, we investigate how digital reminder systems could better support the process of remembering in a wider range of situations. We...

Participatory Sensing or Participatory Nonsense?: Mitigating the Effect of Human Error on Data Quality in Citizen Science
Matthias Budde, Andrea Schankin, Julien Hoffmann, Marcel Danz, Till Riedel, Michael Beigl
Article No.: 39
DOI: 10.1145/3131900

Citizen Science with mobile and wearable technology holds the possibility of unprecedented observation systems. Experts and policy makers are torn between enthusiasm and scepticism regarding the value of the resulting data, as their decision...

SeismoWatch: Wearable Cuffless Blood Pressure Monitoring Using Pulse Transit Time
Andrew M. Carek, Jordan Conant, Anirudh Joshi, Hyolim Kang, Omer T. Inan
Article No.: 40
DOI: 10.1145/3130905

The current norm for measuring blood pressure (BP) at home is using an automated BP cuff based on oscillometry. Despite providing a viable and familiar method of tracking BP at home, oscillometric devices can be both cumbersome and inaccurate with...

Rapid: A Multimodal and Device-free Approach Using Noise Estimation for Robust Person Identification
Yuanying Chen, Wei Dong, Yi Gao, Xue Liu, Tao Gu
Article No.: 41
DOI: 10.1145/3130906

Device-free human sensing is a key technology to support many applications such as indoor navigation and activity recognition. By exploiting WiFi signals reflected by human body, there have been many WiFi-based device-free human sensing...

Does this App Really Need My Location?: Context-Aware Privacy Management for Smartphones
Saksham Chitkara, Nishad Gothoskar, Suhas Harish, Jason I. Hong, Yuvraj Agarwal
Article No.: 42
DOI: 10.1145/3132029

The enormous popularity of smartphones, their rich sensing capabilities, and the data they have about their users have lead to millions of apps being developed and used. However, these capabilities have also led to numerous privacy concerns....

Detecting Gaze Towards Eyes in Natural Social Interactions and Its Use in Child Assessment
Eunji Chong, Katha Chanda, Zhefan Ye, Audrey Southerland, Nataniel Ruiz, Rebecca M. Jones, Agata Rozga, James M. Rehg
Article No.: 43
DOI: 10.1145/3131902

Eye contact is a crucial element of non-verbal communication that signifies interest, attention, and participation in social interactions. As a result, measures of eye contact arise in a variety of applications such as the assessment of the social...

Devices and Data and Agents, Oh My: How Smart Home Abstractions Prime End-User Mental Models
Meghan Clark, Mark W. Newman, Prabal Dutta
Article No.: 44
DOI: 10.1145/3132031

With the advent of DIY smart homes and the Internet of Things comes the emergence of user interfaces for domestic human-building interaction. However, the design trade-offs between the different representations of a smart home’s capabilities...

Remote Control by Body Movement in Synchrony with Orbiting Widgets: an Evaluation of TraceMatch
Christopher Clarke, Alessio Bellino, Augusto Esteves, Hans Gellersen
Article No.: 45
DOI: 10.1145/3130910

In this work we consider how users can use body movement for remote control with minimal effort and maximum flexibility. TraceMatch is a novel technique where the interface displays available controls as circular widgets with orbiting targets, and...

Lessons Learned from Two Cohorts of Personal Informatics Self-Experiments
Nediyana Daskalova, Karthik Desingh, Alexandra Papoutsaki, Diane Schulze, Han Sha, Jeff Huang
Article No.: 46
DOI: 10.1145/3130911

Self-experiments allow people to investigate their own individual outcomes from behavior change, often with the aid of personal tracking devices. The challenge is to design scientifically valid self-experiments that can reach conclusive results....

Building Cognition-Aware Systems: A Mobile Toolkit for Extracting Time-of-Day Fluctuations of Cognitive Performance
Tilman Dingler, Albrecht Schmidt, Tonja Machulla
Article No.: 47
DOI: 10.1145/3132025

People’s alertness fluctuates across the day: at some times we are highly focused while at others we feel unable to concentrate. So far, extracting fluctuation patterns has been time and cost-intensive. Using an in-the-wild approach with 12...

If It’s Convenient: Leveraging Context in Peer-to-Peer Variable Service Transaction Recommendations
Afsaneh Doryab, Victoria Bellotti, Alaaeddine Yousfi, Shuobi Wu, John M. Carroll, Anind K. Dey
Article No.: 48
DOI: 10.1145/3130913

Peer-to-Peer Variable Service Transaction (P2P-VST) systems enable people to offer and receive help with a wide range of task types. However, such services are hampered by the difficulty of finding relevant and convenient opportunities for...

Modus Operandi of Crowd Workers: The Invisible Role of Microtask Work Environments
Ujwal Gadiraju, Alessandro Checco, Neha Gupta, Gianluca Demartini
Article No.: 49
DOI: 10.1145/3130914

The ubiquity of the Internet and the widespread proliferation of electronic devices has resulted in flourishing microtask crowdsourcing marketplaces, such as Amazon MTurk. An aspect that has remained largely invisible in microtask crowdsourcing is...

Low-resource Multi-task Audio Sensing for Mobile and Embedded Devices via Shared Deep Neural Network Representations
Petko Georgiev, Sourav Bhattacharya, Nicholas D. Lane, Cecilia Mascolo
Article No.: 50
DOI: 10.1145/3131895

Continuous audio analysis from embedded and mobile devices is an increasingly important application domain. More and more, appliances like the Amazon Echo, along with smartphones and watches, and even research prototypes seek to perform multiple...

CrowdPickUp: Crowdsourcing Task Pickup in the Wild
Jorge Goncalves, Simo Hosio, Niels Van Berkel, Furqan Ahmed, Vassilis Kostakos
Article No.: 51
DOI: 10.1145/3130916

We develop and evaluate a new ubiquitous crowdsourcing platform called CrowdPickUp, that combines the advantages of mobile and situated crowdsourcing to overcome their respective limitations. In a 19-day long field study with 70 participants, we...

Intelligent Interruption Management using Electro Dermal Activity based Physiological Sensor for Collaborative Sensemaking
Nitesh Goyal, Susan R. Fussell
Article No.: 52
DOI: 10.1145/3130917

Sensemaking tasks are difficult to accomplish with limited time and attentional resources because analysts are faced with a constant stream of new information. While this information is often important, the timing of the interruptions may detract...

Automated Ski Velocity and Jump Length Determination in Ski Jumping Based on Unobtrusive and Wearable Sensors
Benjamin H. Groh, Frank Warschun, Martin Deininger, Thomas Kautz, Christine Martindale, Bjoern M. Eskofier
Article No.: 53
DOI: 10.1145/3130918

Although ski jumping is a widely investigated sport, competitions and training sessions are rarely supported by state-of-the-art technology. Supporting technologies could focus on a continuous velocity determination and visualization for...

SugarMate: Non-intrusive Blood Glucose Monitoring with Smartphones
Weixi Gu, Yuxun Zhou, Zimu Zhou, Xi Liu, Han Zou, Pei Zhang, Costas J. Spanos, Lin Zhang
Article No.: 54
DOI: 10.1145/3130919

Inferring abnormal glucose events such as hyperglycemia and hypoglycemia is crucial for the health of both diabetic patients and non-diabetic people. However, regular blood glucose monitoring can be invasive and inconvenient in everyday life. We...

CrowdStory: Fine-Grained Event Storyline Generation by Fusion of Multi-Modal Crowdsourced Data
Bin Guo, Yi Ouyang, Cheng Zhang, Jiafan Zhang, Zhiwen Yu, Di Wu, Yu Wang
Article No.: 55
DOI: 10.1145/3130920

Event summarization based on crowdsourced microblog data is a promising research area, and several researchers have recently focused on this field. However, these previous works fail to characterize the fine-grained evolution of an event and the...

QuickTalk: An Association-Free Communication Method for IoT Devices in Proximity
Seongmin Ham, Jihyung Lee, Kyunghan Lee
Article No.: 56
DOI: 10.1145/3130921

IoT devices are in general considered to be straightforward to use. However, we find that there are a number of situations where the usability becomes poor. The situations include but not limited to the followings: 1) when initializing an IoT...

MindfulWatch: A Smartwatch-Based System For Real-Time Respiration Monitoring During Meditation
Tian Hao, Chongguang Bi, Guoliang Xing, Roxane Chan, Linlin Tu
Article No.: 57
DOI: 10.1145/3130922

With a wealth of scientifically proven health benefits, meditation was enjoyed by about 18 million people in the U.S. alone, as of 2012. Yet, there remains a stunning lack of convenient tools for promoting long-term and effective meditation...

Glabella: Continuously Sensing Blood Pressure Behavior using an Unobtrusive Wearable Device
Christian Holz, Edward J. Wang
Article No.: 58
DOI: 10.1145/3132024

We propose Glabella, a wearable device that continuously and unobtrusively monitors heart rates at three sites on the wearer’s head. Our glasses prototype incorporates optical sensors, processing, storage, and communication components, all...

Zero-Effort In-Home Sleep and Insomnia Monitoring using Radio Signals
Chen-Yu Hsu, Aayush Ahuja, Shichao Yue, Rumen Hristov, Zachary Kabelac, Dina Katabi
Article No.: 59
DOI: 10.1145/3130924

Insomnia is the most prevalent sleep disorder in the US. In-home insomnia monitoring is important for both diagnosis and treatment. Existing solutions, however, require the user to either maintain a sleep diary or wear a sensor while sleeping....

Smartwatch Wearing Behavior Analysis: A Longitudinal Study
Hayeon Jeong, Heepyung Kim, Rihun Kim, Uichin Lee, Yong Jeong
Article No.: 60
DOI: 10.1145/3131892

Smartwaches are the representative wearable or body-worn devices that provide convenient and easy information access. There is a growing body of research work on enabling novel interaction techniques and understanding user experiences of...

Forma Track: Tracking People based on Body Shape
Avinash Kalyanaraman, Dezhi Hong, Elahe Soltanaghaei, Kamin Whitehouse
Article No.: 61
DOI: 10.1145/3130926

Knowledge of a person’s whereabouts in the home is key to context-aware applications, but many people do not want to carry or wear a tag or mobile device in the home. Therefore, many tracking systems are now using so-called weak biometrics...

Activity Recognition for Quality Assessment of Batting Shots in Cricket using a Hierarchical Representation
Aftab Khan, James Nicholson, Thomas Plötz
Article No.: 62
DOI: 10.1145/3130927

Quality assessment in cricket is a complex task that is performed by understanding the combination of individual activities a player is able to perform and by assessing how well these activities are performed. We present a framework for...

Let’s FOCUS: Mitigating Mobile Phone Use in College Classrooms
Inyeop Kim, Gyuwon Jung, Hayoung Jung, Minsam Ko, Uichin Lee
Article No.: 63
DOI: 10.1145/3130928

With the increasingly frequent appearance of mobile phones in college classrooms, there have been growing concerns regarding their negative aspects including distractive off-task multitasking. In this work, we design and evaluate Let’s...

Technology Supported Behavior Restriction for Mitigating Self-Interruptions in Multi-device Environments
Jaejeung Kim, Chiwoo Cho, Uichin Lee
Article No.: 64
DOI: 10.1145/3130932

The interruptions people experience may be initiated from digital devices but also from oneself, an action which is termed “self-interruption.” Prior work mostly focused on understanding work-related self-interruptions and designing...

TrailSense: A Crowdsensing System for Detecting Risky Mountain Trail Segments with Walking Pattern Analysis
Keunseo Kim, Hengameh Zabihi, Heeyoung Kim, Uichin Lee
Article No.: 65
DOI: 10.1145/3131893

Trail surface information is critical in preventing from the mountain accidents such as falls and slips. In this paper, we propose a new mobile crowdsensing system that automatically infers whether trail segments are risky to climb by using sensor...

UbiSwarm: Ubiquitous Robotic Interfaces and Investigation of Abstract Motion as a Display
Lawrence H. Kim, Sean Follmer
Article No.: 66
DOI: 10.1145/3130931

As robots increasingly enter our everyday life, we envision a future in which robots are ubiquitous and interact with both ourselves and our environments. This paper introduces the concept of ubiquitous robotic interfaces (URIs), multi-robot...

OmniTrack: A Flexible Self-Tracking Approach Leveraging Semi-Automated Tracking
Young-Ho Kim, Jae Ho Jeon, Bongshin Lee, Eun Kyoung Choe, Jinwook Seo
Article No.: 67
DOI: 10.1145/3130930

We now see an increasing number of self-tracking apps and wearable devices. Despite the vast number of available tools, however, it is still challenging for self-trackers to find apps that suit their unique tracking needs, preferences, and...

Automatic Calibration of High Density Electric Muscle Stimulation
Jarrod Knibbe, Paul Strohmeier, Sebastian Boring, Kasper Hornbæk
Article No.: 68
DOI: 10.1145/3130933

Electric muscle stimulation (EMS) can enable mobile force feedback, support pedestrian navigation, or confer object affordances. To date, however, EMS is limited by two interlinked problems. (1) EMS is low resolution -- achieving only coarse...

Exploring Context-Aware User Interfaces for Smartphone-Smartwatch Cross-Device Interaction
Yuki Kubo, Ryosuke Takada, Shizuki Buntarou, Shin Takahashi
Article No.: 69
DOI: 10.1145/3130934

In this study, we explore context-aware cross-device interactions between a smartphone and smartwatch. We present 24 contexts, and then examine and prioritize suitable user interfaces (UIs) for each. In addition, we present example applications,...

Auto++: Detecting Cars Using Embedded Microphones in Real-Time
Sugang Li, Xiaoran Fan, Yanyong Zhang, Wade Trappe, Janne Lindqvist, Richard E. Howard
Article No.: 70
DOI: 10.1145/3130938

In this work, we propose a system that detects approaching cars for smartphone users. In addition to detecting the presence of a vehicle, it can also estimate the vehicle’s driving direction, as well as count the number of cars around the...

Reconstructing Hand Poses Using Visible Light
Tianxing Li, Xi Xiong, Yifei Xie, George Hito, Xing-Dong Yang, Xia Zhou
Article No.: 71
DOI: 10.1145/3130937

Free-hand gestural input is essential for emerging user interactions. We present Aili, a table lamp reconstructing a 3D hand skeleton in real time, requiring neither cameras nor on-body sensing devices. Aili consists of an LED panel in a lampshade...

IndoTrack: Device-Free Indoor Human Tracking with Commodity Wi-Fi
Xiang Li, Daqing Zhang, Qin Lv, Jie Xiong, Shengjie Li, Yue Zhang, Hong Mei
Article No.: 72
DOI: 10.1145/3130940

Indoor human tracking is fundamental to many real-world applications such as security surveillance, behavioral analysis, and elderly care. Previous solutions usually require dedicated device being carried by the human target, which is inconvenient...

Progress Estimation and Phase Detection for Sequential Processes
Xinyu Li, Yanyi Zhang, Jianyu Zhang, Moliang Zhou, Shuhong Chen, Yue Gu, Yueyang Chen, Ivan Marsic, Richard A. Farneth, Randall S. Burd
Article No.: 73
DOI: 10.1145/3130936

Process modeling and understanding are fundamental for advanced human-computer interfaces and automation systems. Most recent research has focused on activity recognition, but little has been done on sensor-based detection of process progress. We...

Gazture: Design and Implementation of a Gaze based Gesture Control System on Tablets
Yinghui Li, Zhichao Cao, Jiliang Wang
Article No.: 74
DOI: 10.1145/3130939

We present Gazture, a light-weight gaze based real-time gesture control system on commercial tablets. Unlike existing approaches that require dedicated hardware (e.g., high resolution camera), high computation overhead (powerful CPU) or specific...

Mining User Reviews for Mobile App Comparisons
Yuanchun Li, Baoxiong Jia, Yao Guo, Xiangqun Chen
Article No.: 75
DOI: 10.1145/3130935

As the number of mobile apps keeps increasing, users often need to compare many apps, in order to choose one that best fits their needs. Fortunately, as there are so many users sharing an app market, it is likely that some other users with the...

PrivacyStreams: Enabling Transparency in Personal Data Processing for Mobile Apps
Yuanchun Li, Fanglin Chen, Toby Jia-Jun Li, Yao Guo, Gang Huang, Matthew Fredrikson, Yuvraj Agarwal, Jason I. Hong
Article No.: 76
DOI: 10.1145/3130941

Smartphone app developers often access and use privacy-sensitive data to create apps with rich and meaningful interactions. However, it can be challenging for auditors and end-users to know what granularity of data is being used and how, thereby...

Supporting Social Interactions with an Expressive Heart Rate Sharing Application
Fannie Liu, Laura Dabbish, Geoff Kaufman
Article No.: 77
DOI: 10.1145/3130943

The present work explores the social dynamics of expressive biosignals: leveraging wearable technologies to introduce sensed physiological data as a means of clarifying the emotional or psychological processes underlying our subjective...

Your Search Path Tells Others Where to Park: Towards Fine-Grained Parking Availability Crowdsourcing Using Parking Decision Models
Ruilin Liu, Yu Yang, Daehan Kwak, Desheng Hang, Liviu Iftode, Badri Nath
Article No.: 78
DOI: 10.1145/3130942

A main challenge faced by the state-of-the-art parking sensing systems is to infer the state of the spots not covered by participants’ parking/unparking events (called background availability) when the system penetration rate is limited. In...

PRADO: Predicting App Adoption by Learning the Correlation between Developer-Controllable Properties and User Behaviors
Xuan Lu, Zhenpeng Chen, Xuanzhe Liu, Huoran Li, Tao Xie, Qiaozhu Mei
Article No.: 79
DOI: 10.1145/3130944

To survive and stand out from the fierce market competition nowadays, it is critical for app developers to know (desirably ahead of time) whether, how well, and why their apps would be adopted by users. Ideally, the adoption of an app could be...

TestAWARE: A Laboratory-Oriented Testing Tool for Mobile Context-Aware Applications
Chu Luo, Miikka Kuutila, Simon Klakegg, Denzil Ferreira, Huber Flores, Jorge Goncalves, Mika Mäntylä, Vassili Skostakos
Article No.: 80
DOI: 10.1145/3130945

Although mobile context instrumentation frameworks have simplified the development of mobile context-aware applications, it remains challenging to test such applications. In this paper, we present TestAWARE that enables developers to...

PupilScreen: Using Smartphones to Assess Traumatic Brain Injury
Alex Mariakakis, Jacob Baudin, Eric Whitmire, Vardhman Mehta, Megan A. Banks, Anthony Law, Lynn Mcgrath, Shwetak N. Patel
Article No.: 81
DOI: 10.1145/3131896

Before a person suffering from a traumatic brain injury reaches a medical facility, measuring their pupillary light reflex (PLR) is one of the few quantitative measures a clinician can use to predict their outcome. We propose PupilScreen, a...

Moving Beyond Market Research: Demystifying Smartphone User Behavior in India
Akhil Mathur, Lakshmi Manasa Kalanadhabhatta, Rahul Majethia, Fahim Kawsar
Article No.: 82
DOI: 10.1145/3130947

Large-scale mobile data studies can reveal valuable insights into user behavior, which in turn can assist system designers to create better user experiences. After a careful review of existing mobile data literature, we found that there have been...

MyTraces: Investigating Correlation and Causation between Users’ Emotional States and Mobile Phone Interaction
Abhinav Mehrotra, Fani Tsapeli, Robert Hendley, Mirco Musolesi
Article No.: 83
DOI: 10.1145/3130948

Most of the existing work concerning the analysis of emotional states and mobile phone interaction has been based on correlation analysis. In this paper, for the first time, we carry out a causality study to investigate the causal links between...

Understanding the Role of Places and Activities on Mobile Phone Interaction and Usage Patterns
Abhinav Mehrotra, Sandrine R. Müller, Gabriella M. Harari, Samuel D. Gosling, Cecilia Mascolo, Mirco Musolesi, Peter J. Rentfrow
Article No.: 84
DOI: 10.1145/3131901

User interaction patterns with mobile apps and notifications are generally complex due to the many factors involved. However a deep understanding of what influences them can lead to more acceptable applications that are able to deliver information...

Recognizing Eating from Body-Worn Sensors: Combining Free-living and Laboratory Data
Mark Mirtchouk, Drew Lustig, Alexandra Smith, Ivan Ching, Min Zheng, Samantha Kleinberg
Article No.: 85
DOI: 10.1145/3131894

Automated dietary monitoring solutions that can find when, what, and how much individuals consume are needed for many applications such as providing feedback to individuals with chronic disease. Advances in body-worn sensors have led to systems...

Detecting Emerging Activity-Based Working Traits through Wearable Technology
Alessandro Montanari, Cecilia Mascolo, Kerstin Sailer, Sarfraz Nawaz
Article No.: 86
DOI: 10.1145/3130951

A recent trend in corporate real-estate is Activity-Based Working (ABW). The ABW concept removes designated desks but offers different work settings designed to support typical work activities. In this context there is still a need for objective...

CovertBand: Activity Information Leakage using Music
Rajalakshmi Nandakumar, Alex Takakuwa, Tadayoshi Kohno, Shyamnath Gollakota
Article No.: 87
DOI: 10.1145/3131897

This paper contributes a novel method for low-cost, covert physical sensing and, by doing so, surfaces new privacy threats. We demonstrate how a smartphone and portable speaker playing music with embedded, inaudible signals can track multiple...

Detecting State Changes of Indoor Everyday Objects using Wi-Fi Channel State Information
Kazuya Ohara, Takuya Maekawa, Yasuyuki Matsushita
Article No.: 88
DOI: 10.1145/3131898

Detecting the events of indoor everyday objects such as door or window open/close events has been actively studied to implement such applications as intrusion detection, adaptive HVAC control, and monitoring an independently living elderly person....

FootprintID: Indoor Pedestrian Identification through Ambient Structural Vibration Sensing
Shijia Pan, Tong Yu, Mostafa Mirshekari, Jonathon Fagert, Amelie Bonde, Ole J. Mengshoel, Hae Young Noh, Pei Zhang
Article No.: 89
DOI: 10.1145/3130954

We present FootprintID, an indoor pedestrian identification system that utilizes footstep-induced structural vibration to infer pedestrian identities for enabling various smart building applications. Previous studies have explored other sensing...

Conquering the City: Understanding perceptions of Mobility and Human Territoriality in Location-based Mobile Games
Konstantinos Papangelis, Melvin Metzger, Yiyeng Sheng, Hai-Ning Liang, Alan Chamberlain, Ting Cao
Article No.: 90
DOI: 10.1145/3130955

With the increasing popularity of mobile video games, game designers and developers are starting to integrate geolocation into video games. Popular location-based games such as Ingress or Pokémon Go have millions of users, yet little is...

Beyond Interruptibility: Predicting Opportune Moments to Engage Mobile Phone Users
Martin Pielot, Bruno Cardoso, Kleomenis Katevas, Joan Serrà, Aleksandar Matic, Nuria Oliver
Article No.: 91
DOI: 10.1145/3130956

Many of today's mobile products and services engage their users proactively via push notifications. However, such notifications are not always delivered at the right moment, therefore not meeting products' and users' expectations. To address this...

Microinteraction Ecological Momentary Assessment Response Rates: Effect of Microinteractions or the Smartwatch?
Aditya Ponnada, Caitlin Haynes, Dharam Maniar, Justin Manjourides, Stephen Intille
Article No.: 92
DOI: 10.1145/3130957

Mobile-based ecological-momentary-assessment (EMA) is an in-situ measurement methodology where an electronic device prompts a person to answer questions of research interest. EMA has a key limitation: interruption burden....

Eyes-Free Art: Exploring Proxemic Audio Interfaces For Blind and Low Vision Art Engagement
Kyle Kyle, Keith Salmon, Dan Thornton, Neel Joshi, Meredith Ringel Morris
Article No.: 93
DOI: 10.1145/3130958

Engagement in the arts1 is an important component of participation in cultural activities, but remains a largely unaddressed challenge for people with sensory disabilities. Visual arts are generally inaccessible to people with visual impairments...

Label Propagation: An Unsupervised Similarity Based Method for Integrating New Sensors in Activity Recognition Systems
Vitor F. Rey, Paul Lukowicz
Article No.: 94
DOI: 10.1145/3130959

Current activity recognition systems mostly work with static, pre-trained sensor configuration. As a consequence they are not able to leverage new sensors appearing in their environment (e.g. the user buying a new wearable devices). In this work...

Inferring Mood Instability on Social Media by Leveraging Ecological Momentary Assessments
Koustuv Saha, Larry Chan, Kaya De Barbaro, Gregory D. Abowd, Munmun De Choudhury
Article No.: 95
DOI: 10.1145/3130960

Active and passive sensing technologies are providing powerful mechanisms to track, model, and understand a range of health behaviors and well-being states. Despite yielding rich, dense and high fidelity data, current sensing technologies often...

Distant Emotion Recognition
Asif Salekin, Zeya Chen, Mohsin Y. Ahmed, John Lach, Donna Metz, Kayla De La Haye, Brooke Bell, John A. Stankovic
Article No.: 96
DOI: 10.1145/3130961

Distant emotion recognition (DER) extends the application of speech emotion recognition to the very challenging situation that is determined by variable speaker to microphone distances. The performance of conventional emotion recognition systems...

HeartSense: Ubiquitous Accurate Multi-Modal Fusion-based Heart Rate Estimation Using Smartphones
Reham Mohamed, Moustafa Youssef
Article No.: 97
DOI: 10.1145/3132028

Heart rate is one of the most important vital signals for personal health tracking. A number of smartphone-based heart rate estimation systems have been proposed over the years. However, they either depend on special hardware sensors or suffer...

Sensing Cold-Induced Situational Impairments in Mobile Interaction Using Battery Temperature
Zhanna Sarsenbayeva, Niels Van Berkel, Aku Visuri, Sirkka Rissanen, Hannu Rintamaki, Vassilis Kostakos, Jorge Goncalves
Article No.: 98
DOI: 10.1145/3130963

Previous work has highlighted the detrimental effect of cold ambience on fine-motor skills during interaction with mobile devices. In this work, we develop a method to infer changes in finger temperature of smartphone users without the need for...

OpenKeychain: An Architecture for Cryptography with Smart Cards and NFC Rings on Android
Dominik Schürmann, Sergej Dechand, Lars Wolf
Article No.: 99
DOI: 10.1145/3130964

While many Android apps provide end-to-end encryption, the cryptographic keys are still stored on the device itself and can thus be stolen by exploiting vulnerabilities. External cryptographic hardware solves this issue, but is currently only used...

Passive Haptic Training to Improve Speed and Performance on a Keypad
Caitlyn Seim, Nick Doering, Yang Zhang, Wolfgang Stuerzlinger, Thad Starner
Article No.: 100
DOI: 10.1145/3132026

Learning text entry systems is challenging, yet necessary. Many layouts and keyboards exist, but they rely on laborious learning techniques. Passive haptic learning (PHL) has already demonstrated some benefit for learning the Braille text entry...

Running with Technology: Evaluating the Impact of Interacting with Wearable Devices on Running Movement
Matthias Seuter, Max Pfeiffer, Gernot Bauer, Karen Zentgraf, Christian Kray
Article No.: 101
DOI: 10.1145/3130966

The use of wearable devices during running has become commonplace. Although there is ongoing research on interaction techniques for use while running, the effects of the resulting interactions on the natural movement patterns have received little...

VRShop: A Mobile Interactive Virtual Reality Shopping Environment Combining the Benefits of On- and Offline Shopping
Marco Speicher, Sebastian Cucerca, Antonio Krüger
Article No.: 102
DOI: 10.1145/3130967

In this work, we explored the main characteristics of on- and offline shops with regard to customer shopping behavior and frequency. Thus, we designed and implemented an immersive virtual reality (VR) online shopping environment. We tried to...

Robust Indoor Localization across Smartphone Models with Ellipsoid Features from Multiple RSSIs
Masato Sugasaki, Masamichi Shimosaka
Article No.: 103
DOI: 10.1145/3130968

Localization for mobile devices has become important as the basis technology for various ubiquitous computing applications. While GPS is leveraged as the de-facto standard technology in outdoor localization, its accuracy is poor indoors. For...

SleepMonitor: Monitoring Respiratory Rate and Body Position During Sleep Using Smartwatch
Xiao Sun, Li Qiu, Yibo Wu, Yeming Tang, Guohong Cao
Article No.: 104
DOI: 10.1145/3130969

Respiratory rate and body position are two major physiological parameters in sleep study, and monitoring them during sleep can provide helpful information for health care. In this paper, we present SleepMonitor, a smartwatch based system which...

LoRa Backscatter: Enabling The Vision of Ubiquitous Connectivity
Vamsi Talla, Mehrdad Hessar, Bryce Kellogg, Ali Najafi, Joshua R. Smith, Shyamnath Gollakota
Article No.: 105
DOI: 10.1145/3130970

The vision of embedding connectivity into billions of everyday objects runs into the reality of existing communication technologies -- there is no existing wireless technology that can provide reliable and long-range communication at tens of...

InvisibleEye: Mobile Eye Tracking Using Multiple Low-Resolution Cameras and Learning-Based Gaze Estimation
Marc Tonsen, Julian Steil, Yusuke Sugano, Andreas Bulling
Article No.: 106
DOI: 10.1145/3130971

Analysis of everyday human gaze behaviour has significant potential for ubiquitous computing, as evidenced by a large body of work in gaze-based human-computer interaction, attentive user interfaces, and eye-based user modelling. However, current...

Gamification of Mobile Experience Sampling Improves Data Quality and Quantity
Niels Van Berkel, Jorge Goncalves, Simo Hosio, Vassilis Kostakos
Article No.: 107
DOI: 10.1145/3130972

The Experience Sampling Method is used to capture high-quality in situ data from study participants. This method has become popular in studies involving smartphones, where it is often adapted to motivate participation through the use of...

FiDO: A Community-based Web Browsing Agent and CDN for Challenged Network Environments
Morgan Vigil-Hayes, Elizabeth Belding, Ellen Zegura
Article No.: 108
DOI: 10.1145/3132030

Homes located on tribal lands, particularly in rural areas of the United States, continue to lack access to broadband Internet and cellular connectivity [19]. Inspired by previous observations of community content similarity in tribal networks, we...

Watching inside the Screen: Digital Activity Monitoring for Task Recognition and Proactive Information Retrieval
Tung Vuong, Giulio Jacucci, Tuukka Ruotsalo
Article No.: 109
DOI: 10.1145/3130974

We investigate to what extent it is possible to infer a user’s work tasks by digital activity monitoring and use the task models for proactive information retrieval. Ten participants volunteered for the study, in which their computer screen...

Predicting Symptom Trajectories of Schizophrenia using Mobile Sensing
Rui Wang, Weichen Wang, Min S. H. Aung, Dror Ben-Zeev, Rachel Brian, Andrew T. Campbell, Tanzeem Choudhury, Marta Hauser, John Kane, Emily A. Scherer, Megan Walsh
Article No.: 110
DOI: 10.1145/3130976

Continuously monitoring schizophrenia patients’ psychiatric symptoms is crucial for in-time intervention and treatment adjustment. The Brief Psychiatric Rating Scale (BPRS) is a survey administered by clinicians to evaluate symptom severity...

XRec: Behavior-Based User Recognition Across Mobile Devices
Xiao Wang, Tong Yu, Ming Zeng, Patrick Tague
Article No.: 111
DOI: 10.1145/3130975

As smartphones and tablets become increasingly prevalent, more customers have multiple devices. The multi-user, multi-device interactions inspire many problems worthy of investigation, among which recognizing users across devices has significant...

SuperpowerGlass: A Wearable Aid for the At-Home Therapy of Children with Autism
Peter Washington, Catalin Voss, Aaron Kline, Nick Haber, Jena Daniels, Azar Fazel, Titas De, Carl Feinstein, Terry Winograd, Dennis Wall
Article No.: 112
DOI: 10.1145/3130977

We have developed a system for automatic facial expression recognition running on Google Glass, delivering real-time social cues to children with Autism Spectrum Disorder (ASD). The system includes multiple mechanisms to engage children and their...

DigiTouch: Reconfigurable Thumb-to-Finger Input and Text Entry on Head-mounted Displays
Eric Whitmire, Mohit Jain, Divye Jain, Greg Nelson, Ravi Karkar, Shwetak Patel, Mayank Goel
Article No.: 113
DOI: 10.1145/3130978

Input is a significant problem for wearable systems, particularly for head mounted virtual and augmented reality displays. Existing input techniques either lack expressive power or may not be socially acceptable. As an alternative, thumb-to-finger...

From Intermittent to Ubiquitous: Enhancing Mobile Access to Online Social Networks with Opportunistic Optimization
Di Wu, Dmitri I. Arkhipov, Thomas Przepiorka, Yong Li, Bin Guo, Qiang Liu
Article No.: 114
DOI: 10.1145/3130979

Accessing online social networks in situations with intermittent Internet connectivity is a challenge. We have designed a context-aware mobile system to enable efficient offline access to online social media by prefetching, caching and...

CLSTERS: A General System for Reducing Errors of Trajectories Under Challenging Localization Situations
Hao Wu, Weiwei Sun, Baihua Zheng, Li Yang, Wei Zhou
Article No.: 115
DOI: 10.1145/3130981

Trajectory data generated by outdoor activities have great potential for location based services. However, depending on the localization technique used, certain trajectory data could contain large errors. For example, the error of trajectories...

Cost-Sensitive Semi-Supervised Personalized Semantic Place Label Recognition Using Multi-Context Data
Xiaojie Wu, Ling Chen, Mingqi Lv, Mingrui Han, Gencai Chen
Article No.: 116
DOI: 10.1145/3131903

Personalized semantic place label recognition is a promising research issue in ubiquitous computing. However, there are some problems existed in the current methods: 1) They use trajectory data to learn recognition model and ignore other context...

CityFlowFragility: Measuring the Fragility of People Flow in Cities to Disasters using GPS Data Collected from Smartphones
Takahiro Yabe, Kota Tsubouchi, Yoshihide Sekimoto
Article No.: 117
DOI: 10.1145/3130982

Economic loss caused by natural disasters is increasing in many cities around the world. There is an increasing demand for a method that effectively measures the fragility of people flow to appropriately plan the future investment into...

EM-Comm: Touch-based Communication via Modulated Electromagnetic Emissions
Chouchang Jack Yang, Alanson P. Sample
Article No.: 118
DOI: 10.1145/3130984

Touch-based communication offers a direct and intuitive way for users to initiate and control data transfer when using tangible and ubiquitous interfaces. However, this requires that each interactive device be instrumented with a dedicated radio...

Predicting Commercial Activeness over Urban Big Data
Su Yang, Minjie Wang, Wenshan Wang, Yi Sun, Jun Gao, Weishan Zhang, Jiulong Zhang
Article No.: 119
DOI: 10.1145/3130983

This study aims at revealing how commercial hotness of urban commercial districts (UCDs) is shaped by social contexts of surrounding areas so as to render predictive business planning. We define social contexts for a given region as the number of...

FingerSound: Recognizing unistroke thumb gestures using a ring
Cheng Zhang, Anandghan Waghmare, Pranav Kundra, Yiming Pu, Scott Gilliland, Thomas Ploetz, Thad E. Starner, Omer T. Inan, Gregory D. Abowd
Article No.: 120
DOI: 10.1145/3130985

We introduce FingerSound, an input technology to recognize unistroke thumb gestures, which are easy to learn and can be performed through eyes-free interaction. The gestures are performed using a thumb-mounted ring comprising a contact microphone...

TouchPower: Interaction-based Power Transfer for Power-as-needed Devices
Tengxiang Zhang, Xin Yi, Chun Yu, Yuntao Wang, Nicholas Becker, Yuanchun Shi
Article No.: 121
DOI: 10.1145/3130986

The trend toward ubiquitous deployment of electronic devices demands novel low maintenance power schemes to decrease the burden of maintaining such a large number of devices. In this paper, we propose Interaction-based Power Transfer (IPT): a...

VibeBin: A Vibration-Based Waste Bin Level Detection System
Yiran Zhao, Shuochao Yao, Shen Li, Shaohan Hu, Huajie Shao, Tarek F. Abdelzaher
Article No.: 122
DOI: 10.1145/3132027

This paper presents the design and implementation of VibeBin, a low-cost, non-intrusive and easy-to-install waste bin level detection system. Recent popularity of Internet-of-Things (IoT) sensors has brought us unprecedented opportunities to...