CLIP Talk - Nikhil Krishnaswamy

CLIP Talk - Nikhil Krishnaswamy
Slow Down to Speed Up: Toward Deliberative AI Systems for Human Collaboration
Abstract: Large language models (LLMs) are being rapidly integrated into personal, educational, business, and even governmental workflows, where they are increasingly being treated as "collaborators" with humans. While generative AI has been sold as an opportunity to increase speed and efficiency, this is predicated on an assumption that moving faster always results in better outcomes. In this talk, I will discuss how the insertion of appropriate "friction" into human-AI interaction can in fact lead to slower, more deliberate interactions that intentionally sacrifice short-term speed for long-term task performance gain. Specifically, I will discuss how we develop AI systems that manage and mediate the common ground that emerges in a multi-party collaborative interaction, use these inferred belief states to expose unspoken assumptions and misalignment within the group, and develop a novel "LLM-agent" alignment framework to prompt the group to slow down, deliberate, and resolve misapprehensions before making decisions. Our results show how, in multiple collaborative tasks, the insertion of positive friction correlates with faster convergence to common ground and more correct task solutions. Finally, I will also show how similar mechanisms can be used to discriminate helpful from unhelpful AI interventions, showing a potential path toward the mitigation of deceptive or "rogue" AI behavior.
Bio: Nikhil Krishnaswamy is an Assistant Professor of Computer Science at Colorado State University, and director of the Situated Grounding and Natural Language (SIGNAL) Lab. His research focuses on diverse forms of natural language and multimodal understanding in human-AI collaboration, and on the mathematical and logical properties of AI models. He is the author of over 90 peer-reviewed publications across the fields of NLP, AI/machine learning, human-computer/human-agent interaction, and cognitive science, and has received multiple best paper or outstanding paper awards for research on interactive systems, human-AI teaming, HCI, and NLP in education. His research has been funded by NSF, DARPA, ARPA-H, and ARO, and he has been featured in national outlets such as NPR and the Wall Street Journal.