Event
Lockheed Martin Robotics Seminar: Dieter Fox, "Grounding Natural Language in Robot Control"
Thursday, May 16, 2013
11:00 a.m.
2460 AV Williams
Anagha Kohojkar
301 405 1009
akohojka@isr.umd.edu
Lockheed Martin Robotics Seminar Series
"Grounding natural language in robot control and perception systems"
The Computer Vision Laboratory and the Maryland Robotics Center are co-hosting; the seminar is co-sponsored by the Computer Vision Lab and Lockheed Martin.
Dieter Fox
Associate Professor, Department of Computer Science & Engineering
Director, UW Robotics and State Estimation Lab
University of Washington
Host
Yiannis Aloimonos
Abstract
Robots are becoming more and more capable at reasoning about people, objects, and activities in their environments. The ability to extract high-level semantic information from sensor data provides new opportunities for human robot interaction. One such opportunity is to explore interacting with robots via natural language. In this talk I will present our recent work toward enabling robots to interpret, or ground, natural language commands in robot control systems. We build on techniques developed by the semantic natural language processing community on learning combinatory categorical grammars (CCGs) that parse natural language input to logic-based semantic meaning. I will demonstrate results in two application domains: First, learning to follow natural language directions through indoor environments; and, second, learning to ground object attributes via weakly supervised training. Its a joint work with Luke Zettlemoyer, Cynthia Matuszek, Nicolas Fitzgerald, Yuyin Sun, and Liefeng Bo and the support is provided by Intel ISTC-PC, NSF, and ARL, and ONR.
Biography
Dr. Dieter Fox is an Associate Professor in the Department of Computer Science & Engineering at the University of Washington, where he heads the UW Robotics and State Estimation Lab. From 2009 to 2011, he was also Director of the Intel Research Labs Seattle. He currently serves as the academic PI of the Intel Science and Technology Center for Pervasive Computing hosted at UW. Dr. Fox obtained his Ph.D. from the University of Bonn, Germany. Before going to UW, he spent two years as a postdoctoral researcher at the CMU Robot Learning Lab. Dr. Fox's research is in artificial intelligence, with a focus on state estimation applied to robotics and activity recognition. He has published over 150 technical papers and is co-author of the text book "Probabilistic Robotics". He is a fellow of the AAAI and received several best paper awards at major robotics and AI conferences. He is also an editor of the IEEE Transactions on Robotics and was program co-chair of the 2008 AAAI Conference on Artificial Intelligence. Dr. Fox currently serves as the program chair of the 2013 Robotics: Science and Systems conference.
