REFEREED CONFERENCE PUBLICATIONS
![]() |
Investigating Remote Tactile Feedback for Mid-Air Text-Entry in Virtual Reality Aakar Gupta, Majed Samad, Kenrick Kin, Per Ola Kristensson, and Hrvoje Benko
We investigate the utility of remote tactile feedback for freehand text-entry on a mid-air Qwerty keyboard in VR. We report on a multi-session text-entry study with 24 participants where we investigated four vibrotactile feedback conditions: on-fingers, on-wrist spatialized, on-wrist non-spatialized, and audio-visual only. Participants overwhelmingly prefer the tactile feedback conditions.
|
![]() |
Acustico: Surface Tap Detection and Localization using Wrist-based Acoustic TDOA Sensing Jun Gong, Aakar Gupta, and Hrvoje Benko
Acustico is a passive acoustic sensing approach that enables tap detection and 2D tap localization on uninstrumented surfaces using a wristworn device. Our technique uses a novel application of acoustic time differences of arrival (TDOA) analysis. We adopt a sensor fusion approach by taking both “surface waves” (i.e., vibrations through surface) and “sound waves” (i.e., vibrations through air) to improve sensing resolution.
|
![]() |
Extend, Push, Pull: Smartphone Mediated Interaction in Spatial Augmented Reality via Intuitive Mode Switching Jeremy Hartmann, Aakar Gupta, and Daniel Vogel
This work proposes an interaction technique that enables pushing smartphone content out into spatial augmented reality (SAR), pulling content from SAR back into the phone, transformations, and content-specific manipulation. The technique relies on an implicit mode switching arm extension gesture. A random-forest classifier achieves 96% accuracy on detecting the gesture.
|
![]() |
Replicate and Reuse: Tangible Interaction Design for Digitally-Augmented Physical Media Objects Aakar Gupta, Borui Lin, Siyi Ji, Arjav Patel, and Daniel Vogel
Today's digital media experiences lack the physicality of paging through an album, reading a newspaper, or meandering in a bookshelf. Overlaying physical objects with digital content via augmented reality holds promise towards bridging this gap. This work proposes a novel interaction framework, 'Replicate and Reuse' for incorporating tangbility and multimodality into such AR-overlaid physical objects.
|
![]() |
PneuSleeve: In-fabric Multimodal Actuation and Sensing in a Soft, Compact, and Expressive Haptic Sleeve Mengjia Zhu, Amirhossein H. Memar, Aakar Gupta, Majed Samad, Priyanshu Agarwal, Sean Keller, and Nick Colonnese
Integration of soft haptic devices into garments can improve
their usability and wearability for daily computing interactions. This work introduces PneuSleeve, a soft, compact, and expressive fabric forearm sleeve capable of rendering a range of haptic stimuli including compression,
skin stretch, and vibration via pneumatic pressure control inside embroidered stretchable tubes.
|
![]() |
RotoSwype:Word-Gesture Typing using a Ring Aakar Gupta, Cheng Ji, Hui-Shyong Yeo, Aaron Quigley, Daniel Vogel
RotoSwype is a technique for word-gesture typing
by rotating a ring worn on the index finger. RotoSwype enables fast, accurate, single-handed text-input without encumbering
the hand with a device, a desirable quality in many scenarios,
including virtual or augmented reality.
|
![]() |
TabletInVR: Exploring the Design Space for Using a Multi-Touch Tablet in Virtual Reality Hemant Bhaskar Surale, Aakar Gupta, Mark Hancock, Daniel Vogel
TableInVR investigates how a table inside VR can support 3D modeling interaction tasks. It demonstrates how a tablet's precise touch input capability and passieve haptic feedback can be combined with barehand mid-air input to support creation, selection, rotate-translate-scale, and editing of 3D models inside VR.
|
![]() |
WRIST: Watch-Ring Interaction and Sensing Technique for Wrist Gestures and Macro-Micro Pointing Hui-Shyong Yeo, Juyoung Lee, Hyung-il Kim, Aakar Gupta, Andrea Bianchi, Daniel Vogel, Hideki Koike, Woontack Woo, Aaron Quigley
WRIST fuses the IMU sensor data from a smartwatch and a smartring to enable 6-DOF tracking of wrist+finger. This enables a new form of pointing, called macro-micro pointing for immersive scenarios. It further enables a class of wrist+finger gestures.
|
![]() |
Asterisk and Obelisk: Motion Codes for Passive Tagging Aakar Gupta, Jiushan Yang, Ravin Balakrishnan
We propose Motion Codes, a passive tagging mechanism that is based on the kinesthetic motion of the user's hand. To scan a motion tag the user simply traces their finger over the pattern and the motion is decoded into the encoded information by an inertial motion ring.
|
![]() |
HapticClench: Investigating Squeeze Sensations using Memory Alloys Aakar Gupta, Antony Albert Raj Irudayaraj, Ravin Balakrishnan
Squeezing is one of the most intimate forms of human contact. HapticClench generates squeezing sensations on the wrist using shape memory springs. We show that HapticClench can generate up to 4 distinguishable loads, works well in distracted scenarios, has high spatial acuity and can communicate gradual progression information.
|
![]() |
Summon and Select: Rapid Interaction with Interface Controls in Mid-air Aakar Gupta, Thomas Pietrzak, Cleon Yau, Nicolas Roussel, Ravin Balakrishnan
Current freehand interactions rely on point & select wherein the constant hand movement in air for pointer navigation leads to hand fatigue quickly. We introduce summon & select, a new model for freehand interaction where, instead of navigating to the control, the user summons it into focus and then manipulates it.
|
![]() |
Porous Interfaces for Small Screen Multitasking using Finger Identification Aakar Gupta, Muhammed Anwar, Ravin Balakrishnan
The lack of a dedicated multitasking interface in smartphones results in frequent app switching which has obvious temporal, physical, and cognitive costs. Porous interfaces enable fast and efficient smartphone multitasking using translucent windows and finger identification. |
![]() |
Haptic Learning of Freehand Semaphoric Gestures Aakar Gupta, Antony Irudayaraj, Vimal Chandran, Goutham Palaniappan, Khai N. Truong, Ravin Balakrishnan
Semaphoric gestures that act as shortcuts for mid-air commands require dedicated learning. We show that haptic gestural learning enables learning without visual engagement thus allowing users to learn in mobile scenarios.
|
![]() |
DualKey: Miniature Screen Text Entry via Finger Identification Aakar Gupta, Ravin Balakrishnan
Fast and accurate access to letter keys for miniature screens remains an open question. We propose DualKey, a text entry technique that uses finger identification. In a 10-day study, DualKey outperforms existing techniques and achieves up to 25 words-per-min.
|
![]() |
Direct Manipulation in Tactile Displays Aakar Gupta, Thomas Pietrzak, Nicolas Roussel, Ravin Balakrishnan
Wearables remain in persistent skin contact which demands the exploration of tactile interactions as rich as visual displays. We introduce the concept of a Direct Manipulation-enabled Tactile display that consists of a tactile pointing interface with a tactile screen, tactile pointer, and tactile targets.
|
![]() |
mClerk: Enabling Mobile Crowdsourcing in Developing Regions Aakar Gupta, William Thies, Edward Cutrell, Ravin Balakrishnan
mClerk enables crowdsourced distribution of local-language digitization tasks to low-end mobile phones by leveraging a little-known protocol to send small images via ordinary SMS. mClerk spread virally from 10 users to 239 users during a 5-week deployment in semi-urban India and digitized over 25,000 words.
|
![]() |
Biometric Monitoring as a Persuasive Technology: Ensuring Patients Visit Health Centers in India's Slums Nupur Bhatnagar, Abhishek Sinha, Navkar Samdaria, Aakar Gupta, Shelly Batra, Manish Bhardwaj, William Thies
Tuberculosis patients in rural India are required to visit a center over 40 times over 6 months. We explore the role of a biometric attendance terminal, which enrolled over 2,300 patients across 25 centers, in persuading patients to complete health visits in slum communities of New Delhi, India.
|
![]() |
Collage: A Presentation Tool for the K-12 Classroom Saurabh Panjwani, Aakar Gupta, Navkar Samdaria, Edward Cutrell, Kentaro Toyama
Collage is a software presentation tool created exclusively for supporting instruction in a K-12 classroom in the developing world. The tool enables teachers to display digital scans of textbook pages along with digital multimedia in an interactive fashion.
|
![]() |
Five years of IndiaHCI: A Scientometric Analysis Aakar Gupta
After five consecutive years of IndiaHCI (2010-2014), we analyze the demographics, citations and themes of its proceedings to reflect upon the way forward for the conference and the HCI community in India.
|
CASE STUDIES, WORKSHOPS, PATENTS
![]() |
EduPal: Smarter Education Aakar Gupta, Malolan Chetlur, Bikram Sengupta, Ashay U. Tamhane
Researched auto-alignments of lecture videos and the accompanying content, slides, comments and recommendations for smart learning videos. Also conducted a field survey of state of the art education technologies and their 'openness'.
|
![]() |
DISHA: Multiple Mice in Narrative Content-based Computer Aided Learning for Children Aakar Gupta, Praveen Shekhar, Navkar Samdaria, Mohit Jain, Joyojeet Pal
The MultiPoint technology enables multiple students, each with their own mouse, to simultaneously engage on a single PC. In collaboration with NCERT, India, we developed a unique design methodology that allows teachers to be the primary designers for collaborative learning games that supplement classroom teaching. |
![]() |
Teachers as Game Designers: Lessons from a Collaborative Learning ExerciseNavkar Samdaria, Praveen Shekhar, Aakar GuptaDavid Hutchful
DISHA (Disease and Health Awareness) is a narrative-interactive MultiPoint application for spreading public health information among children in low-income regions. The project won the MultiPoint Education Award at the World Finals of Microsoft Imagine Cup 2009. [Video]
|