|
|
My work
centers on the study and development of computational models for
physically
situated spoken language interaction and collaboration. The long term question that shapes my research agenda is how can we enable interactive systems to reason more
deeply about their surroundings and seamlessly participate in open-world, multiparty
dialog and collaboration with people?
Physically situated interaction hinges critically on the ability to reason about
and model processes like conversational engagement,
turn-taking, grounding, interaction planning and action coordination. Creating robust
solutions that operate in the real-world brings to the fore broader AI challenges.
Example questions include issues of representation (e.g.
what are useful formalisms for creating actionable, robust models for multiparty
interaction), machine learning methods for multimodal inference from streaming sensory
data, predictive modeling, decision making and planning under uncertainty and temporal
constraints, etc.
|
|
|
|
Dec'16:
|
|
With Sean Andrist,
Bilge Multu and
David Schlangen,
I co-edited a special
issue of AI Magazine on turn-taking and coordination in human-computer interaction, following up on the AAAI spring symposium on the same theme.
|
|
|
May'16:
|
|
I gave a talk on opportunities and challenges with developing integrative-AI systems at the MSR Latin American Faculty Summit in Rio, Brazil.
|
|
|
May'16:
|
|
I gave an invited talk at the CHI'2016 Workshop on Designing Speech and Multimodal Interactions for Mobile, Wireless and Pervasive applications.
|
|
|
Apr'15:
|
|
I am serving as Program Chair for ICMI'2015 to be held later this year, in November in Seattle. Paper submission deadline is May 15th.
|
|
|
Mar'15:
|
|
I co-organized and attended the AAAI Spring Symposium on Turn-taking and Coordination in Human-Machine Interaction at Stanford University.
|
|
|
Nov'14:
|
|
I attended ICMI'2014, and gave an invited keynote presentation at the co-located The 7th Workshop on Eye Gaze in Intelligent Human Machine Interaction.
|
|
|
Sep'14:
|
|
Zhou Yu started as an intern with Eric Horvitz and myself. Looking forward to a fun and productive fall!
|
|
|
Aug'14:
|
|
With Sean Andrist,
Bilge Multu,
David Schlangen and
Eric Horvitz, I am organizing a AAAI Spring Symposium on
Turn-Taking and Coordination in Human-Computer Interaction.
|
|
|
Aug'14:
|
|
Two papers,
one on generating hesitations based
on forecasting models and one on communicating about uncertainty
in embodied agents were recently accepted for presentation at ICMI'2014.
|
|
|
Aug'14:
|
|
We have deployed a 3rd Directions Robot, on the 4th floor in Building 99. Full coverage!
|
|
|
May'14:
|
|
I am co-organizing the ICMI'14 workshop on Understanding and Modeling Multiparty, Multimodal Interactions.
|
|
|
Apr'14:
|
|
A piece on our research featured on Engadget.
|
|
|
|
|
|
|
