SOCIAL SIGNAL PROCESSING (SSP SEMINAR 2012)

Teachers: Denis Lalanne Fabien Ringeval

The Topic:

Social signal processing (SSP) aims at studing the multimodal signals involved in human human communication and interactions. The core idea of SSP is that non verbal behavior is the machine detectable evidence of social signals, the relational attitudes exchanged between individuals. Social signals include (dis)agreement, empathy, hostility, and any other attitude towards others. Thus, non verbal analysis is used as a key to automatic understanding of social interactions.

Description:

The goal of this seminar is to overview the domain of Social Signal Processing (SSP). Another objective of this seminar is to develop skills in reading, writing and reviewing academic papers. In this context, students will be asked to write and present a state of the art of a sub-domain of SSP research field.

Each student will be asked to choose a theme within the domain, select state-of-the-art references relevant to the chosen thematic, synthesize these references and present them orally in a presentation, done during one of the final seminar sessions in a written report, of 4 pages, authored in LaTeX following ACM Strict format.

Learning outcomes:

At the end of the seminar, students will know how to do a bibliographic research, how to judge the quality of a scientific paper, and how to write a scientific article. Further, they will know what is SSP and the current techniques and trends, and will deepen their knowledge on a particular subtopic.

Participants:

If you are willing to participate to this seminar, please contact the organizers. Max. 6 students will be accepted.

Semester:

Autumn 2012

Language: Français, Anglais

Time: 5 sessions, Friday morning in the meeting room B 420 (Perolles II).

Slide of the talk 10/04/12

Themes

  • Gestures and postures in SSP

    A. Vinciarelli, M. Pantic and H. Bourlard, "Social Signal Processing: Survey of an Emerging Domain", in Image and Vision Computing, Vol. 27, No. 12, pp. 1743-1759, Nov. 2009.

    H. Gunes, M. Piccardi and M. Pantic, "From the Lab to the real world: affect recognition using multiple cues and modalities", in Affective computing: focus on emotion expression, synthesis, and recognition, pp. 185-218, 2008.

  • Face and eye behavior in SSP

    Vinciarelli, M. Pantic and H. Bourlard, "Social Signal Processing: Survey of an Emerging Domain", in Image and Vision Computing, Vol. 27, No. 12, pp. 1743-1759, Nov. 2009.

    R. Vertegaal, R. Slagter, G. van der Veer, and A. Nijholt, "Eye gaze patterns in conversations: there is more to conversational agents than meets the eyes", in Proceedings of the SIGCHI conference on Human Factors in computing systems, pp 301–308, 2001.

  • Vocal behavior in SSP

    A. Vinciarelli, M. Pantic and H. Bourlard, "Social Signal Processing: Survey of an Emerging Domain", in Image and Vision Computing, Vol. 27, No. 12, pp. 1743-1759, Nov. 2009.

    G. Mohammadi, M. Mortillaro, and A. Vinciarelli, "The Voice of Personality: Mapping Nonverbal Vocal Behavior into Trait Attributions," in Proceedings of the International Workshop on Social Signal Processing, 2010, pp. 17-20.

  • Space and environment in SSP

    A. Vinciarelli, M. Pantic and H. Bourlard, "Social Signal Processing: Survey of an Emerging Domain", in Image and Vision Computing, Vol. 27, No. 12, pp. 1743-1759, Nov. 2009.

    M. Cristani, G. Paggetti, A. Vinciarelli, L. Bazzani, G. Menegaz, and V. Murino, "Towards Computational Proxemics: Inferring Social Relations from Interpersonal Distances," in Proceedings of IEEE International Conference on Social Computing, 2011, pp. 290-297.

  • Paralinguistic (age, gender, physical appearance, ...) in SSP

    A. Vinciarelli and G. Mohammadi, "Towards a Technology of Nonverbal Communication: Vocal Behavior in Social and Affective Phenomena", in Affective Computing and Interaction: Psychogical, Cognitive and Neuroscientific Perspectives, IGI, pp. 133-156, 2011, DOI: 10.4018/978-1-61692-892-6.ch007.

    B.W. Schuller, "The Computational Paralinguistics Challenge [Social Sciences]", in IEEE Signal Processing Magazine, Vol. 29(4), pp. 97-101, Jul. 2012.

  • Synchrony and mimicry in SSP

    X. Sun, A. Nijholt, K.P. Truong and M. Pantic, "Automatic Understanding of Affective and Social Signals by Multimodal Mimicry Recognition", in S. D'Mello et al. (Eds.), Springer-Verlag Berlin Heidelberg, ACII 2011, Part II, LNCS 6975, pp. 289–296, 2011.

    C. De Looze, C. Oertel, S. Rauzy and N. Campbell, "Measuring Dynamics of Mimicry by Means of Prosodic Cues in Conversational Speech", in Proceedings of ICPhS XVII, Hong-Kong, Hong-Kong, 17-21 August 2011, pp. 1294-1297.

  • Context understanding in SSP

    A. Vinciarelli, M. Pantic, D. Heylen, C. Pelachaud, I. Poggi, F. D’Errico and M. Schroder, "Bridging the Gap Between Social Animal and Unsocial Machine: A Survey of Social Signal Processing", in IEEE Transactions on Affective Computing, Vol. 3(1), p. 69-87, Jan.-Mar. 2012.

    D.B. Jayagopi, T. Kim, A.(S.) Pentland and D. Gatica-Perez, "Recognizing conversational context in group interaction using privacy-sensitive mobile sensors", in Proceedings of International Conference on Mobile and Ubiquitous Multimedia, Limassol, Cyprus, Dec. 2010.

  • SSP in its core: modelling interaction dynamic

    A.Vinciarelli, H.Salamin and M.Pantic, "Social Signal Processing: Understanding Social Interactions through Nonverbal Behavior Analysis", in Proceedings of Computer Vision and Pattern Recognition Workshops, 20-25 June 2009, pp. 42-49.

    L.-P. Morency, "Modeling Human Communication Dynamics [Social Sciences]", in IEEE Signal Processing Magazine, Vol. 27(5), pp. 112-116, Sep. 2010.

Date: 2012, Fall