Automated analysis of interactions in social scenes is critical for a number of applications such as surveillance, robotics and social signal processing. In this project we focus on the analysis of conversational groups and we address different tasks (e.g. human tracking, head and body pose estimation, F-formation detection) processing multimodal data gathered from camera networks and wearable sensors.

Relevant Publications

• J. Varadarajan, R. Subramanian, S. Rota Bulò, N. Ahuja, O. Lanz, E. Ricci: Joint Estimation of Human Pose and Conversational Groups from Social Scenes. International Journal of Computer Vision 126(2-4):410-429, 2018.
• X. Alameda-Pineda, J. Staiano, R. Subramanian, L. M. Batrinca, E. Ricci, B. Lepri, O. Lanz, N. Sebe. SALSA: A Novel Dataset for Multimodal Group Behavior Analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2016. DATASET LINK
• X. Alameda-Pineda, Y. Yan, E. Ricci, O. Lanz, N. Sebe, Analyzing Free-standing Conversational Groups: a Multimodal Approach, In ACM Multimedia, 2015  DEMO 
• E. Ricci, J. Varadarajan, R. Subramanian, S. Rota Bulò, N. Ahuja, O. Lanz, ncovering Interactions and Interactors: Joint Estimation of Head, Body Orientation and F-formations from Surveillance Videos”, International Conference on Computer Vision (ICCV), 2015.