J. Edward Swan II

A Robotic Augmented Reality Virtual Window for Law Enforcement Operations

Nate Phillips, Brady Kruse, Farzana Alma Khan, J. Edward Swan II, and Cindy L. Bethel. A Robotic Augmented Reality Virtual Window for Law Enforcement Operations. In Virtual, Augmented and Mixed Reality: Design and Interaction, Lecture Notes in Computer Science, HCI International 2020, pp. 591–610, volume 12190, Springer, Cham, Jul 2020. DOI: 10.1007/978-3-030-49695-1_40.

Download

[PDF] 

Abstract

In room-clearing tasks, SWAT team members suffer from a lack of initialenvironmental information: knowledge about what is in a room and what relevance or threat level it represents for mission parameters. Normally this gap in situation awareness is rectified only upon room entry, forcing SWAT team members to rely on quick responses and near-instinctual reactions. This can lead to dangerously escalating situations or important missed information which, in turn, can increase the likelihood of injury and even mortality. Thus, we present an x-ray vision system for the dynamic scanning and display of room content, using a robotic platform to mitigate operator risk. This system maps a room using a robot-equipped stereo depth camera and, using an augmented reality (AR) system, presents the resulting geographic information according to the perspective of each officer. This intervention has the potential to notably lower risk and increase officer situation awareness, all while team members are in the relative safety of cover. With these potential stakes, it is important to test the viability of this system natively and in an operational SWAT team context.

BibTeX

@InProceedings{HCII20, 
  author =      {Nate Phillips and Brady Kruse and Farzana Alma Khan and
                 J. Edward {Swan~II} and Cindy L. Bethel},
  title =       {A Robotic Augmented Reality Virtual Window for Law
                 Enforcement Operations},
  booktitle =   {Virtual, Augmented and Mixed Reality: Design and 
                 Interaction, Lecture Notes in Computer Science, 
                 HCI International 2020},
  volume =      {volume 12190},
  publisher =   {Springer, Cham},
  location =    {Copenhagen, Denmark}, 
  date =        {July 19--24}, 
  month =       {Jul},
  year =        2020,
  pages =       {591--610},
  note =        {DOI: <a target="_blank"
                  href="https://doi.org/10.1007/978-3-030-49695-1_40">10.1007/978-3-030-49695-1_40</a>.},
  abstract = {
In room-clearing tasks, SWAT team members suffer from a lack of initial
environmental information: knowledge about what is in a room and what relevance 
or threat level it represents for mission parameters. Normally this gap in 
situation awareness is rectified only upon room entry, forcing SWAT team members 
to rely on quick responses and near-instinctual reactions. This can lead to 
dangerously escalating situations or important missed information which, in 
turn, can increase the likelihood of injury and even mortality. Thus, we present 
an x-ray vision system for the dynamic scanning and display of room content, 
using a robotic platform to mitigate operator risk. This system maps a room 
using a robot-equipped stereo depth camera and, using an augmented reality (AR) 
system, presents the resulting geographic information according to the 
perspective of each officer. This intervention has the potential to notably 
lower risk and increase officer situation awareness, all while team members are 
in the relative safety of cover. With these potential stakes, it is important to 
test the viability of this system natively and in an operational SWAT team 
context. 
}, 
}