Social Intelligence in Humans and Robots

Workshop RSS 2023 - July 9, US Eastern Time / July 10, Korean time

In-person location: 322B

Video recordings are available on our YouTube channel: link


About
Social intelligence is at the core of both human and artificial intelligence. From a young age, humans can understand, interact, collaborate, and communicate with each other. Most of what we learn is taught by others, or learned in a social context. Thus, a truly intelligent AI agent should be able to understand and work with humans as well as other AI agents.

This workshop focuses on the challenges and developments in building AI systems equipped with social intelligence, and leverages theories and insights from studies of human social intelligence for achieving such goals. In particular, the workshop will explore what it would take for machines to:

  1. Understand the behaviors and mental states of humans
  2. Engage in rich and complex interactions with humans
The workshop will bring together experts from cognitive science and developmental psychology to better understand the principles and origins of human social intelligence, and experts from AI and Robotics, to discuss how to engineer socially intelligent artificial agents, and how these paradigms can be deployed in both virtual and real scenarios.


Speakers

Mark Ho

New York University

Henny Admoni

Carnegie Mellon University

Yukie Nagai

wUniversity of Tokyo

Scott Niekum

UMass Amherst

Yang Wu

University of Toronto Scarborough


Schedule

Time (US Eastern Time, GMT-4) Time (Korean time, GMT+9)
07:50 pm - 08:00 pm, July 9 08:50 am - 09:00 am , July 10 Organizers
Introductory Remarks
08:00 pm - 08:35 pm, July 9 09:00 am - 09:35 am, July 10 Mark Ho
Cognitive Science as a Source of Design Principles for Interactive Machine Learning
08:35 pm - 09:10 pm, July 9 09:35 am - 10:10 am, July 10 Scott Niekum
Models of Human Preference for AI Alignment
09:10 pm - 09:45 pm, July 9 10:10 am - 10:45 am, July 10 Yang Wu
Emotion as Information
09:45 pm - 10:00 pm, July 9 10:45 am - 11:00 am, July 10 Coffee Break
10:00 pm - 10:35 pm, July 9 11:00 am - 11:35 am, July 10 Henny Admoni
Eye Gaze as Indicator of Mental States for Human-Robot Collaboration
10:35 pm, July 9 - 12:30 am, July 10 11:35 am - 01:30 pm, July 10 Lunch Break
12:30 am - 01:05 am, July 10 01:30 pm - 02:05 pm, July 10 Yukie Nagai
Predictive Coding Theory for Social Intelligence
01:05 am - 02:00 am, July 10 02:05 pm - 03:00 pm, July 10 Contributed Talks
  • Learning with Language-Guided State Abstractions
  • Emotional Theory of Mind: Assessing Vision and Language Models' Capabilities and Limitations
  • Concept Alignment as a Prerequisite for Value Alignment
  • The Neuro-Symbolic Inverse Planning Engine
  • Multimodal Interactive Fusion for Action Anticipation
  • Singing the Body Electric: The Impact of Robot Embodiment on User Expectations
  • Neuro-Symbolic Models of Human Moral Judgment: LLMs as Automatic Feature Extractors
  • Personalized Re-Engagement Feedback for Adaptive Socially Assistive Robot Interventions
  • Inferring the Future by Imagining the Past
02:00 am - 02:05 am, July 10 03:00 pm - 03:05 pm, July 10 Organizers
Concluding Remarks
02:05 am - 02:30 am, July 10 03:05 pm - 03:30 pm, July 10 Coffee Break & Poster Session
02:30 am - 03:00 am, July 10 03:30 pm - 04:00 pm, July 10 Poster Session
Gather.Town virtual poster room: Link

Papers
  • Poster #1 - Learning with Language-Guided State Abstractions [link]
    Andi Peng (MIT); Ilia Sucholutsky (Princeton University); Belinda Li (MIT); Theodore Sumers (Princeton); Tom Griffiths (UC Berkeley); Jacob Andreas (MIT); Julie A. Shah
  • Poster #2 - Emotional Theory of Mind: Assessing Vision and Language Models' Capabilities and Limitations Yasaman Etesam (Simon Fraser University); Ozge Nilay Yalcin (Simon Fraser University); Chuxuan Zhang (Simon Fraser University); Angelica Lim (Simon Fraser University)
  • Poster #3 - Concept Alignment as a Prerequisite for Value Alignment [link]
    Sunayana Rane (Princeton University); Mark K Ho (Princeton University); Ilia Sucholutsky (Princeton University); Tom Griffiths (UC Berkeley)
  • Poster #4 - The Neuro-Symbolic Inverse Planning Engine (NIPE): Modeling Probabilistic Social Inferences from Linguistic Inputs [link]
    Lance Ying (Harvard University); Katherine M Collins (University of Cambridge); Megan Wei (Massachusetts Institute of Technology); Cedegao Zhang (Massachusetts Institute of Technology); Tan Zhi-Xuan (Massachusetts Institute of Technology); Adrian Weller (University of Cambridge); Joshua Tenenbaum (MIT); Catherine Wong (Massachusetts Institute of Technology)
  • Poster #5 - Multimodal Interactive Fusion for Action Anticipation [link]
    Zongnan Ma (Yanan University); Zhixiong Nan (Chongqing University); Fuchun Zhang (Yanan University)
  • Poster #6 - Singing the Body Electric: The Impact of Robot Embodiment on User Expectations [link]
    Nathaniel S Dennler (University of Southern California); Stefanos Nikolaidis (USC); Maja Mataric ((University of Southern California, US))
  • Poster #7 - Neuro-Symbolic Models of Human Moral Judgment: LLMs as Automatic Feature Extractors [link]
    Joseph Kwon (MIT); Sydney Levine (Allen Institute for AI); Joshua Tenenbaum (MIT)
  • Poster #8 - Personalized Re-Engagement Feedback for Adaptive Socially Assistive Robot Interventions [link]
    Zhonghao Shi (University of Southern California); Allison O’Connell (University of Southern California); Maja Mataric ((University of Southern California, US))
  • Poster #9 - Inferring the Future by Imagining the Past [link]
    Kartik Chandra (MIT); Tony Chen (MIT); Tzu-Mao Li (University of California, San Diego); Jonathan Ragan-Kelley (MIT); Joshua Tenenbaum (MIT)


Reviewers
We thank the following people for their assistance in reviewing submitted papers.

  • Aishni Parab
  • Andi Peng
  • Aviv Netanyahu
  • Emma Hughson
  • Joe Kwon
  • Kaiwen Jiang
  • Kartik Chandra
  • Lance Ying
  • Lifeng Fan
  • Marta Kryven
  • Micol Spitale
  • Minglu Zhao
  • Sooyeon Jeong
  • Tan Zhi-Xuan
  • Xiaofeng Gao
  • Yen-Ling Kuo
  • Zhitian Zhang

Organizers

Tianmin Shu

Massachusetts Institute of Technology

Xavier Puig

Meta AI

Shuang Li

Massachusetts Institute of Technology

Pratyusha Sharma

Massachusetts Institute of Technology

Paige Tuttösí

Simon Fraser University

Angelica Lim

Simon Fraser University

Antonio Torralba

Massachusetts Institute of Technology



Contact
Reach out to socialintelligenceworkshop@gmail.com for any questions.
-->