Mobile Human Contributions: Opportunities and Challenges

This UbiComp 2018 workshop aims to share insights, ideas, and discoveries on the quality of mobile human contributions. We explore methods, tools, and novel approaches towards increasing the reliability of human data submissions with mobile devices. The workshop organisers hope to foster collaboration and share ideas to inform the next steps forward on this increasingly relevant but underexplored research agenda.

UbiComp/HCI researchers are increasingly using smartphones and other mobile devices to collect human- labelled data ‘in the wild’. While this allows for collecting a wide range of interesting data in authentic settings and surroundings, humans are notoriously inconsistent in the quality of their contributions. Despite the fact that research findings rely on the underlying quality of the participants’ contributions, the accuracy of human labelled submission through mobile data collection remains a surprisingly underexplored area. In this workshop, we raise the question: “How to increase data accuracy in mobile studies?” This could be either prior, during, or following data collection. MHC’18 aims to contribute to a better understanding of human accuracy in mobile data collection, and thus provides not only a set of real-world examples how data quality can be improved but also a useful methodological contribution to the field of ubiquitous computing.

icon-paper

Max. 6 pages in SIGCHI Extended Abstract. PDF format, non-anonymised.

 icon-calendar

Submissions: 31st July, ’18
Notifications: 3rd August, ’18
Cam-ready: 24th August, ’18

 icon-hearth

Join us!
8th October, ’18
Register here.

Workshop schedule

The workshop on ‘Mobile Human Contributions: Opportunities and Challenges’ will take place on the 8th of October at the Suntec Convention Center – Singapore. Coffee and lunch breaks will be provided by the UbiComp conference organisers. The schedule of the workshop can be found below.

09:00–09:45 – Introduction

  • Improving Accuracy in Mobile Human Contributions: An Overview

09:45–10:30 – Session 1

  • Challenges and Lessons from Working with Data Collected by Crowdfunding in the Wild
  • LBSLab: A User Data Collection System in Mobile Environments
  • mQoL: Mobile Quality of Life Lab: From Behavior Change to QoL

10:30–11:00 – Coffee break
11:00–11:30 – Session 1 (continued)

  • Labelling affective states “in the wild”: Practical guidelines and lessons learned
  • Discussion

11:30–12:45 – Session 2

  • Peer-vasive Computing: Leveraging Peers to Enhance the Accuracy of Self-Reports in Mobile Human Studies
  • Experience Sampling as Information Transmission: Perspective and Implications
  • You’re Using This App For What‽ A mQoL Living Lab Study
  • CampusTracker – Assessing Mobile Workers’ Momentary Willingness to Work on Paid Crowdsourcing Tasks
  • Discussion

12:45–13:45 – Lunch
13:45–14:30 – Session 3

  • The Quality Control in Crowdsensing based on Twice Consensuses of Blockchain
  • Leveraging Multi-modal User-labeled Data for Improved Accuracy in Interpretation of ECG Recordings
  • Discussion

14:30–15:00 – Concluding remarks
15:00–15:30 – Coffee break

Please note that you have to register in advance to attend the workshop.

Accepted Papers

We are happy to announce that the following papers have been accepted at MHC’18 (alphabetical order):

 

Call for Participation

MHC’18 invites papers for the International Workshop on Mobile Human Contributions: Opportunities and Challenges, co-located with the 2018 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp 2018). The day-long workshop will be held on October 8. We welcome contributions and discussions focused on the methods, tools, and frameworks for collection, analysis, and interpretation of human labelled data enabled by mobile devices.

Quick Info

Topics of interest

The topics of interest include, but are not limited, to the following:
  • Methodologies: methods and methodologies used for gathering and evaluating the accuracy of human data contributions in lieu of ground truth data.
  • Quality and Motivation: understanding incentives and the effect on the quality of human contributions.
  • Viewpoints: discussion on potential and pitfalls of human-labelled data collection.
  • Behaviours: understanding human behaviour in these contexts and applications.

Submissions

We invite the submission of high-quality papers reporting original research, studies, critical-evaluation, or novel methodologies in accordance with the workshop theme. The workshop papers must be in the SIGCHI Extended Abstract archival format, up to 6 pages in length. Submissions are not required to be anonymised prior to submission.

All submissions should be emailed in .pdf format to mobilehumancontributions@gmail.com with the subject line “MHC’18 Workshop Submission”. The papers will be peer-reviewed accordingly for their significance, originality, clarity, overall quality, and relevance to the overall workshop theme by the technical program committee of the workshop. Accepted workshop papers will be added to the ACM Digital Library and the supplemental proceedings.

Important dates

  • Deadline for submissions: July 31, 2018
  • Notifications: August 3, 2018
  • Camera-ready workshop papers deadline: August 24, 2018
  • MHC’18 workshop: October 8, 2018

UPDATE: Special Issue IJHCS

We are excited to announce a Special Issue on Human Accuracy in Mobile Data Collection at the International Journal of Human-Computer Studies. Please see the CfP on the journal website for more information. We are looking for high-quality, high-impact, and original research results. Submitted manuscripts must be original, but significant revisions of papers presented at this workshops will be considered (at least 50% new material).