FingerPing is a novel sensing technique that can recognize various ﬁne-grained hand poses by analyzing acoustic resonance features. A surface-transducer mounted on a thumb ring injects acoustic chirps (20Hz to 6,000Hz) to the body. Four receivers distributed on the wrist and thumb collect the chirps. Different hand poses of the hand create distinct paths for the acoustic chirps to travel, creating unique frequency responses at the four receivers.
We demonstrate how FingerPing can dif- ferentiate up to 22 hand poses, including the thumb touching each of the 12 phalanges on the hand as well as 10 American sign language poses. A user study with 16 participants showed that our system can recognize these two sets of poses with an accuracy of 93.77% and 95.64%, respectively. We discuss the opportunities and remaining challenges for the widespread use of this input technique.
Paper: FingerPing: Recognizing fine-grained hand poses using active acoustic on-body sensing, ACM CHI 2018
Team: Cheng Zhang, Qiuyue Xue, Anandghan Waghmare, Ruicheng Meng, Sumeet Jain, Yizeng Han, Xinyu Li
Advisor: Kenneth Cunefare, Thomas Ploetz, Thad Starner, Omer Inan, Gregory Abowd