Analysis of Social Scenes from Multimodal Data

SALSAAutomated analysis of interactions in social scenes is critical for a number of applications such as surveillance, robotics and social signal processing. In this project we focus on the analysis of conversational groups and we address different tasks (e.g. human tracking, head and body pose estimation, F-formation detection) processing multimodal data gathered from camera networks and wearable sensors.

Relevant Publications:

X. Alameda-Pineda, J. Staiano, R. Subramanian, L. M. Batrinca, E. Ricci, B. Lepri, O. Lanz, N. Sebe. “SALSA: A Novel Dataset for Multimodal Group Behavior Analysis”. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2016. DATASET LINK

X. Alameda-Pineda, Y. Yan, E. Ricci, O. Lanz, N. Sebe, “Analyzing Free-standing Conversational Groups: a Multimodal Approach”, In ACM Multimedia, 2015  DEMO

E. Ricci, J. Varadarajan, R. Subramanian, S. Rota Bulò, N. Ahuja, O. Lanz, “Uncovering Interactions and Interactors: Joint Estimation of Head, Body Orientation and F-formations from Surveillance Videos”, International Conference on Computer Vision (ICCV), 2015.