Learning to Play Pursuit-Evasion with Visibility Constraints

Kazim Selim Engin, Qingyuan Jiang, Volkan Isler

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

We study the problem of pursuit-evasion for a single pursuer and an evader in polygonal environments where the players have visibility constraints. The pursuer is tasked with catching the evader as quickly as possible while the evader tries to avoid being captured. We formalize this problem as a zero-sum game where the players have private observations and conflicting objectives.One of the challenging aspects of this game is due to limited visibility. When a player, for example, the pursuer does not see the evader, it needs to reason about all possible locations of the evader. This causes an exponential increase in the size of the state space as compared to the arena size. To overcome the challenges associated with large state spaces, we introduce a new learning-based method that compresses the game state and uses it to plan actions for the players. The results indicate that our method outperforms the existing reinforcement learning methods, and performs competitively against the current state-of-the-art randomized strategy in complex environments.

Original languageEnglish (US)
Title of host publicationIEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages3858-3863
Number of pages6
ISBN (Electronic)9781665417143
DOIs
StatePublished - 2021
Event2021 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2021 - Prague, Czech Republic
Duration: Sep 27 2021Oct 1 2021

Publication series

NameIEEE International Conference on Intelligent Robots and Systems
ISSN (Print)2153-0858
ISSN (Electronic)2153-0866

Conference

Conference2021 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2021
Country/TerritoryCzech Republic
CityPrague
Period9/27/2110/1/21

Bibliographical note

Funding Information:
This work was supported in part by NSF grants #1617718 and #2022894. All authors are with the University of Minnesota. {engin003, jian0345, isler}@umn.edu.

Publisher Copyright:
© 2021 IEEE.

Fingerprint

Dive into the research topics of 'Learning to Play Pursuit-Evasion with Visibility Constraints'. Together they form a unique fingerprint.

Cite this