IndexPen: Two-Finger Text Input with Millimeter-Wave Radar
PúblicoRecent work has shown that the mmWave radar sensors can track object motion in 3-dimensional space with high resolution, providing a new approach for humans to interact with electronic devices. Specifically, this emerging technology enables the close distance gesture motion detection and classification with high resolution, which has the potential to become a text input device that does not require physical contact from users. We develop an in-air real-time writing system via a deep learning approach with its high resolution and touch-free properties. In this project, we introduce IndexPen, a novel interaction technique for text input through two-finger in-air micro-gestures, enabling touch-free, effortless, tracking-based interaction, designed to mirror real-world writing. Our system is based on millimeter-wave radar sensing and does not require instrumentation on the user. IndexPen can successfully identify 30 distinct gestures, representing the letters A-Z, as well as Space, Backspace, Enter, and a special Activation gesture to prevent unintentional input. Additionally, we include a noise class to differentiate gesture and non-gesture noise. We present our system design, including the radio frequency (RF) processing pipeline, classification model, and real-time detection algorithms.
- This report represents the work of one or more WPI undergraduate students submitted to the faculty as evidence of completion of a degree requirement. WPI routinely publishes these reports on its website without editorial or peer review.
- Creator
- Subject
- Publisher
- Identifier
- E-project-111721-144850
- 41536
- Palabra Clave
- Advisor
- Year
- 2021
- Sponsor
- UN Sustainable Development Goals
- Date created
- 2021-11-17
- Resource type
- Major
- Rights statement
Las relaciones
- En Collection:
Elementos
Permanent link to this page: https://digital.wpi.edu/show/j3860b242