CREO Seminar Talk: Chen Wang - Neuro-Symbolic AI For Unified Robot Autonomy

Abstract

Robot autonomy spans perception, planning, and control, yet these components are often developed in isolation. Is there a principled paradigm that unifies them within a single learning and reasoning framework? In this talk, Dr. Wang addresses this question by introducing Imperative Learning, a self-supervised neuro-symbolic framework for robot autonomy. Imperative Learning is formulated as a specialized bilevel optimization framework that integrates three tightly coupled components: a neural module, a symbolic reasoning engine, and a structured memory system. This design enables reciprocal learning across modules, combining the representational power of neural networks with the structure, consistency, and interpretability of symbolic reasoning. Dr. Wang will show how this unified framework supports a broad spectrum of autonomy tasks, including localization and mapping, control and motion planning, high-level task planning, vision-language navigation, etc. Extensive empirical results across diverse robotic platforms show that Imperative Learning significantly strengthens robustness, generalization, and data efficiency, offering a coherent foundation for the next generation of autonomous systems.