bet365 login games title: Markov Chain-Based Stochastic Strategies for Robotic Surveillance
Reporter: Duan Xiaoming Ph.D., Assistant Professor, Shanghai Jiao Tong bet365 login games
bet365 login games location: Room 409, Shenghua Back Building, Central South University Headquarters
bet365 login games time: July 14, 2022 10:30--
Host: Zhang Yongmin Distinguished Professor of School of Computer Science
bet365 login games summary:In this talk, we discuss the design of stochastic strategies for robotic surveillance tasks where a mobile robot moves on a graph to prevent potential intrusions. We will focus on two different approaches, i.e., an entropy maximization approach and a Stackelberg game-based approach. In the first approach, we study the novel problem of maximizing the return time entropy of a Markov chain, subject to a graph topology with travel times and stationary distribution. The return time entropy is the weighted average, over all graph nodes, of the entropy of the first return times of the Markov chain. The approach features theoretical and computational contributions. In the second approach, we consider the case where a potential intruder strategically attacks a location on the graph. The intruder is assumed to be omniscient: it knows the current location of the mobile agent and can learn the surveillance strategy. The goal for the mobile robot is to find a stochastic strategy so as to maximize the probability of capturing the intruder. We model the strategic interactions between the surveillance robot and the intruder as a Stackelberg game, and optimal and suboptimal surveillance strategies in star, complete and line graphs are studied.
Speaker profile: Xiaoming Duan is an assistant professor in the Department of Automation at Shanghai Jiao Tong bet365 login games (SJTU). Before joining SJTU, he was a postdoctoral fellow in the Oden Institute for Computational Engineering and Sciences at the bet365 login games of Texas, Austin. He obtained his PhD degree in Mechanical Engineering from UC Santa Barbara in 2020, his Master's degree in Control Science and Engineering from Zhejiang bet365 login games in 2016, and his Bachelor's degree in Automation from the Beijing Institute of Technology in 2013, respectively. His current research focuses on autonomous systems, multi-agent systems and robotics. He is a peer reviewer for IEEE TAC, Automatica, IEEE TCNS, etc.