Augmented Reality as a Means of Improving Efficiency and Immersion of Human-Swarm Interaction

Sullivan, Daniel J.; Arthur, Eric T.; Gardias, Przemyslaw M.

Student Work

Augmented Reality as a Means of Improving Efficiency and Immersion of Human-Swarm Interaction Public

Researchers are studying new ways to be able to control robot swarms efficiently and intuitively. A recent approach that has been taken is to control the swarm through an augmented reality (AR) application on a tablet. However, the use of a tablet is not only fatiguing, but also adds a layer of abstraction, separating the user from directly interacting with the swarm. The user is not fully immersed, as the movement of the tablet restricts the visualization to a subset of the user’s field of view. Therefore, we developed the first AR application using the Magic Leap headset to allow a user to directly interact with and control the swarm. By combining gestures with haptic and visual feedback, we create a more immersive and intuitive method of interacting with swarms.

Creator

Publisher