Spring semester 2022

Because of COVID isolation rules, the introductory lecture of Thursday March 3 will be held online

use this link to attend

Human-Computer Interaction Seminar

This is the main seminar of the HCI group of the Human-IST Institute. The topics will change each semester and will be proposed by Human-IST members. Each participant will be supervised by one Human-IST member.

With the advent of autonomous cars, mobile devices and conversational agents, the question of the interaction with digital devices in everyday life is becoming more and more relevant. The aim of the HCI seminar is to look at this question over several specific contexts and expose students to state-of-the art research in Human-Computer Interaction.

Through a set of topics for the participants to choose from, the different research fields studied within the Human-IST institute will be reviewed and discussed. Again, each specific topic is proposed by a member of the Human-IST team who will be available, each time needed, during the semester to follow the work of the student selecting it.

Prof. Denis Lalanne

Dr Julien Nembrini (contact person)

The introductory lecture will be on Thursday Thursday March 3 2022 10h45 online in presence PER21 A420. Please contact Dr Julien Nembrini julien.nembrini@unifr.ch, with copy to Prof. Denis Lalanne denis.lalanne@unifr.ch, if you wish to attend.

Semester topics

Reinforcement learning methods for visual comfort management

The coronavirus pandemic led to an unprecedented number of people working from home, which also led to an increasing number of online meetings. Several surveys in Switzerland and around the globe have shown that the home-office option will persist after the pandemic. While it has been advised to follow the 20-20-20 rule to limit eye constraint from computer use, in reality this is hardly achieved (our survey indicated that 65.85% of the participants only take a break after more than 60 minutes of computer usage). Sensing technologies which could capture human visual fatigue could assist users to manage their visual comfort; however, when and how to notify them is still an open question. The motivation of this review is to understand the acceptable and effective ways to learn from the user routine and notify users on possible actions towards better visual comfort management during remote working condition, specifically using reinforcement learning methods.

References:

Park, J., Dougherty, T., Fritz, H., Nagy, Z. (2018). LightLearn: An adaptive and occupant centered controller for lighting based on reinforcement learning. Building and Environment Ho, B.

J., Balaji, B., Koseoglu, M., & Srivastava, M. (2018, October). Nurture: notifying users at the right time using reinforcement learning. In Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers (pp. 1194-1201).

Reference person:

  • Sailin Zhong

Technology probes for gig food delivery drivers

Ridesharing and delivery companies represent one of the major industries in the gig economy. A common claim of the gig-economy – e.g. from Uber – is that workers may work "whenever they want", "wherever they want", and that they can "be their own boss". This claim, at least in the case of Uber, is not always supported by Uber and its platform. This is primarily due to the various barriers that drivers face to their agency in terms of information/power asymmetries, algorithmic management, and emotional labor [1]. Food delivery (car) drivers face the absence of companionship and safety risks [3, 4]. This review aims to discover one specific angle the gig drivers struggled (e.g., safety, communication with the customer), and discuss alternatives compared to existing gig driver platforms (e.g., using AR, new ways of visualization). Such alternatives can be presented as but not limited to technological probes [5].

References:

[1] Ma, N. F., Yuan, C. W., Ghafurian, M., & Hanrahan, B. V. (2018, April). Using stakeholder theory to examine drivers' Stake in Uber. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (pp. 1-12)

[2] Glöss, M., McGregor, M., & Brown, B. (2016, May). Designing for labour: uber and the on-demand mobile workforce. In Proceedings of the 2016 CHI conference on human factors in computing systems (pp. 1632-1643).

[3] Seetharaman, B., Pal, J., & Hui, J. (2021). Delivery Work and the Experience of Social Isolation. Proceedings of the ACM on Human-Computer Interaction, 5(CSCW1), 1-17.

[4] Yao, Z., Weden, S., Emerlyn, L., Zhu, H., & Kraut, R. E. (2021). Together But Alone: Atomization and Peer Support among Gig Workers. Proceedings of the ACM on Human-Computer Interaction, 5(CSCW2), 1-29.

[5] Hutchinson, H., Mackay, W., Westerlund, B., Bederson, B. B., Druin, A., Plaisant, C., ... & Eiderbäck, B. (2003, April). Technology probes: inspiring design for and with families. In Proceedings of the SIGCHI conference on Human factors in computing systems (pp. 17-24).

Reference person:

  • Sailin Zhong

Augmented Reality Based Serious Games for Low Vision Rehabilitation

In this work, we want to investigate the potential of augmented reality based serious games on wearable devices for people with visual impairments. The student will precise the notion of visual impairment (low vision), review existing serious games for visually impaired in the literature and try to come up with a novel idea that could be ported on an wearable augmented reality device. Finally he should imagine an experiment to evaluate his proposed solution. The proposed serious game should aim at facilitating rehabilitation of low vision individuals.

References:

G. Regal, E. Mattheiss, D. Sellitsch and M. Tscheligi, “Mobile location-based games to support orientation & mobility training for visually impaired students,” In Proc. of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '18), pp. 1–12, doi: 10.1145/3229434.3229472

A. Dragos Bogdan Moldoveanu et al., "Virtual environments for training visually impaired for a sensory substitution device," 2017 Zooming Innovation in Consumer Electronics International Conference (ZINC), 2017, pp. 26-29, doi: 10.1109/ZINC.2017.7968654.

M. I. Torres-Carazo, M. J. Rodríguez-Fórtiz and M. V. Hurtado, "Analysis and review of apps and serious games on mobile devices intended for people with visual impairment," 2016 IEEE International Conference on Serious Games and Applications for Health (SeGAH), pp. 1-8, 2016, doi: 10.1109/SeGAH.2016.7586263

Reference person :

  • Yong-Joon Thoo
  • Dr Simon Ruffieux

How to foster acceptance of AR/VR technologies in the industrial context?

The industry 4.0 is profoundly affecting the manufacturing sector because of its vision of automation. New technologies like collaborative robotics (cobots) bring new opportunities for this revolution, but the communication gap between the human and the machine is a bottleneck slowing down the collaboration of the two entities.

At the Berner Fachhochschule (BFH), we are developing a robotic cell that tries to bring a solution to this problem, using the help of no-code programming, AR/VR tools and cobots. The use of these different tools provides a maximum of information about the state of the system, helpful for the user to better understand, and therefore control the system.

The goal of this project is to do a short state of the art of AR/VR technologies acceptance and extract what could prevent the acceptance of this technology. In a second part, we want to emit a hypothesis on how to improve this acceptance in the industrial context, and propose an experiment to validate our theory.

References:

Human–robot interaction in industrial collaborative robotics: a literature review of the decade 2008–2017 (Hentout et al., 2019)

An investigation of acceptance and e-readiness for the application of virtual reality and augmented reality technologies to maintenance training in the manufacturing industry (Scott et al., 2020)

20 years of research on virtual reality and augmented reality in tourism context: A text-mining approach (Loureiro, 2020)

Reference person :

  • Charly Blanc

Improving the AI-driven aids for Air Traffic Control

As air traffic complexity keeps growing, the tasks performed by the Air Traffic Controller (ATCO) is becoming more and more difficult. New methods, purely visual or based on Machine Learning, are being developed to help the ATCO in conflict resolution tasks. However, the ATCO often has difficulty understanding the behaviour of such AI-driven aids, and the benefits they offer are balanced by a poor User Experience (UX). This seminar paper will constitute a literature review of the methods aimed to improve the collaboration between the human agent and the Artificial-Intelligence (AI)-driven aids.

References

Kistan, T.; Gardi, A.; Sabatini, R. Machine Learning and Cognitive Ergonomics in Air Traffic Management: Recent Developments and Considerations for Certification. Aerospace 2018, 5, 103. https://www.mdpi.com/2226-4310/5/4/103#cite

Reference person :

  • Raphael Tuor

Companion interfaces to record individual energy behaviour

In face of the need for climate change mitigation, individual behaviour change has probably the most potential [1,3]. However, convincing users to change requires providing them meaningful and operative pathways towards lower carbon behaviour, not leading to rebound effects [2]. Offering change proposals tailored to specific lifestyles is likely to increase impact. These lifestyles could be based on observations, but also be constructed through data-centric sensing [5]. The review will concentrate on what kind of technological support hardware and/or software [4] would help in detecting different lifestyle groups regarding carbon-intensive dimensions such as nutrition, mobility or comfort.

References

[1] Coskun, A., Zimmerman, J., & Erbug, C. (2015). Promoting sustainability through behavior change: A review. Design Studies, 41, Part B, 183–204. https://doi.org/10.1016/j.destud.2015.08.008

[2] Elf, P., Gatersleben, B., & Christie, I. (2019). Facilitating Positive Spillover Effects: New Insights From a Mixed-Methods Approach Exploring Factors Enabling People to Live More Sustainable Lifestyles. Frontiers in Psychology, 9. https://www.frontiersin.org/article/10.3389/fpsyg.2018.02699

[3] Habib, R., White, K., Hardisty, D. J., & Zhao, J. (2021). Shifting consumer behavior to address climate change. Current Opinion in Psychology, 42, 108–113. https://doi.org/10.1016/j.copsyc.2021.04.007

[4] Wang, W., Harari, G. M., Wang, R., Müller, S. R., Mirjafari, S., Masaba, K., & Campbell, A. T. (2018). Sensing Behavioral Change over Time: Using Within-Person Variability Features from Mobile Sensing to Predict Personality Traits. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2(3), 141:1-141:21. https://doi.org/10.1145/3264951

[5] Zhao, S., Li, S., Ramos, J., Luo, Z., Jiang, Z., Dey, A. K., & Pan, G. (2019). User profiling from their use of smartphone applications: A survey. Pervasive and Mobile Computing, 59, 101052. https://doi.org/10.1016/j.pmcj.2019.101052

Reference person :

  • Dr Julien Nembrini

Work to be done

Students will be asked to :

  • Conduct an in-depth review of the state-of-the-art of their chosen topic
  • Discuss their findings with their respective tutor
  • Write a 4-pages article summarizing their review work
  • Present their article to the seminar participants

Interested computer science students are invited to participate by expressing their interest on two specific topics (preferred and secondary choices) among the ones presented on the topics page.

link to the topics

Learning Outcomes

At the end of the seminar, students will know how to do a bibliographic research and be exercised in writing a scientific article. Further, they will build a general knowledge on the field of HCI and its current techniques and trends, as well as an in-depth understanding on their chosen topic.

Registration

Express your interest about both your chosen topics with a short text (3-5 sentences) to Dr Julien Nembrini, mentioning (1) your preferred topic, (2) your second-preferred topic. Each reference person will then contact you if you are chosen for participating to the seminar. Others will receive a notification email.

link to the topics

email : julien.nembrini@unifr.ch

Registration Process

  1. Participate to the first introductory session on Thursday March 3 2022 10h45 online in presence PER21 A420.
  2. Express your interest for a specific topic as mentioned above.
  3. Wait for confirmation of your participation.

Seminar Process

In addition to the first session, there will only be three plenary sessions during the semester, which consist in participants presenting their work. These sessions will be in presence and will happen on Thursdays at 10h45. Reference persons will organize additional bilateral meetings during the semester.

Calendar (may be subject to changes)

  • March 3: initial seminar presentation
  • April 7: 1st presentation (state of the art)
  • April 28: 1st draft due
  • May 5: first draft presentation
  • May 25: 2nd draft due
  • June 2: final presentations
  • June 16: final draft due

The seminar process is as follows:

  1. Select state-of-the-art references relevant to the chosen thematic, synthesize these references to structure the research field, discuss and refine your approach with your topic reference person.
  2. Present the structure developed to the other participants of the seminar for the intermediate presentation.
  3. Synthesize the selected bibliographic references in a written 4 pages article, authored in LaTeX following ACM SIGCHI format.
  4. Discuss and refine your article with your topic reference person.
  5. Present your article in one of the final presentation sessions (end of semester)

Evaluation

The evaluation will be conducted by the topic reference person and the person responsible for the seminar.

The evaluation will be based on the quality of :

  • Your written article: readability, argumentation, English
  • Your review work: reference selection and field structure
  • Your final presentation
  • Your initial draft
  • Your review of a colleague's first draft

If each step described below is not formally marked, each contribute towards producing a good final paper (75% of the grade)

Guidelines

First presentation

  • Introduce your theme
  • Your selection of 3 papers (the most relevant among all your readings according to your theme). Don't forget to give author names, journal and date!
  • Present for each paper:
    • Theme: How does the paper fit in the larger picture of your theme?
    • Main contribution: how does the paper contribute to the field?
    • Strengths and weaknesses of the proposed approach
    • Outlook: what research opportunities it opens?
  • Presentation time 10'.

First draft

  • your draft should :
    • present a research field with relevant publications
    • state a research question and an hypothesis
    • propose an experiment to test the hypothesis, and discuss its expected results
  • provide an (almost) complete draft. Enough content will allow reviewers to give meaningful feedback
  • polish your English grammar and orthography
  • you MUST use the latex template https://www.overleaf.com/latex/templates/association-for-computing-machinery-acm-sigchi- proceedings-template/nhjwrrczcyys
  • maximum 4 pages excluding references (do not hesitate to concentrate on some sections and leaving others in bullet point style)

Review

  • rephrase the content in 1 short paragraph
  • list the positive points
  • list the negative points, provide examples
  • propose improvements
  • do not insist on orthograph/grammar unless it is especially disturbing

Provide your review either as comments in the pdf or as a separate document.

Second presentation

  • your presentation should include:
    • Introduction to the topic
    • Research questions/hypotheses
    • General structure of your research field (literature review outcome)
    • User experiment proposal
  • include details (example papers, shared methods/approaches, experiments conducted by others, etc)
  • include full references (preferably not at the end)
  • present your review of fellow student's first draft (see guidelines above)
  • experiment with your presentation style
  • Presentation time 8 + 2 (review)

Second draft

  • combine feedback from your supervisor and from your fellow student

Final presentation

  • your presentation should include:
    • Introduction to the topic
    • Research questions/hypotheses
    • General structure of your research field (literature review outcome)
    • User experiment proposal
  • include details (example papers, shared methods/approaches, experiments conducted by others, etc)
  • include full references (preferably not at the end)
  • timing 10'

Final draft

  • integrate all feedback received and finalize your paper. this final version will be published on the website (habe a look here for final examples)

Date: Spring 2022