Event
MRC Seminar: Learning Coordinated Performant Flight with 20 Neurons
Friday, November 22, 2024
2:00 p.m.
JMP 2116
Learning Coordinated Performant Flight with 20 Neurons
Gaurav Sukhatme, Ph.D.
Professor of Computer Science and Electrical Engineering
Donald M. Aldstadt Chair in Advanced Computing
Director, USC School of Advanced Computing
University of Southern California
Abstract
We have recently demonstrated the possibility of learning controllers that are zero-shot transferable to groups of real quadrotors via large-scale, multi-agent, end-to-end reinforcement learning. We train policies parameterized by neural networks that can control individual drones in a group in a fully decentralized manner. Our policies, trained in simulated environments with realistic quadrotor physics, demonstrate advanced flocking behaviors, perform aggressive maneuvers in tight formations while avoiding collisions with each other, break and re-establish formations to avoid collisions with moving obstacles, and efficiently coordinate in pursuit-evasion tasks. The model learned in simulation transfers to highly resource-constrained physical quadrotors. Motivated by these results and the observation that neural control of memory-constrained, agile robots requires small yet highly performant models, the talk will conclude with some thoughts on coaxing learned models onto devices with modest computational capabilities.
Biography
Gaurav S. Sukhatme is Professor of Computer Science and Electrical and Computer Engineering at the University of Southern California (USC) and an Amazon Scholar. He is the Director of the USC School of Advanced Computing and the Executive Vice Dean of the USC Viterbi School of Engineering. He holds the Donald M. Aldstadt Chair in Advanced Computing and was the Chairman of the USC Computer Science Department from 2012-17. He received his undergraduate education in computer science and engineering at IIT Bombay and his M.S. and Ph.D. degrees in computer science from USC. Sukhatme is the co-director of the USC Robotics Research Laboratory and the USC Robotic Embedded Systems Laboratory director. His research interests are in networked robots, learning robots, and field robotics. He has published extensively in these and related areas. He is a Fellow of the AAAI, AAAS, and the IEEE, a recipient of the NSF CAREER award, the Okawa Foundation research award, and an Amazon research award. He is one of the founders of the Robotics: Science and Systems conference and was the program chair of the 2008 ICRA and 2011 IROS. He is the Editor-in-Chief of Autonomous Robots (Springer Nature).
Host: Ryan Sochol
