Skip to main content

Low-cost smart ring shows the future of sign language input on phones

Person wearing SpellRing on their thumb.
Louis DiPietro/Cornell University
Promotional image for Tech For Change. Person standing on solar panel looking at sunset.
This story is part of Tech for Change: an ongoing series in which we shine a spotlight on positive uses of technology, and showcase how they're helping to make the world a better place.

The smart ring segment has matured significantly over the past couple of years. We have entered the era of miniaturised sensors that are ready for ultrasound-based blood pressure monitoring. The likes of Circular are taking a different dual-sensor approach to measuring blood pressure levels, and are even eyeing glucose trend analysis by next year.

Health sensing, however, has remained the predominant application area for smart rings. Now, experts at Cornell University have developed a smart ring platform that can continuously track American Sign Language in real time, and send it as input to computers and smartphones.

Recommended Videos

Dubbed the SpellRing, it can recognize the full 26-letter range of the English alphabet pool. Worn on the thumb, this ring comes equipped with a speaker and mic array. Together, they allow the back-and-forth transfer of audio waves generated by hand motion, while a gyroscope measures the angular data.

Please enable Javascript to view this content

Accessibility for all

SpellRing showing input on a phone.
Louis DiPietro/Cornell University

While the idea already sounds like a major accessibility victory, the cost could further boost its adoption. The prototype kit developed by the team comes in at around $30, but they expect it to dip further when it enters mass manufacturing phase.

The 3D-printed ring, which is roughly the size of a quarter coin, relies on a custom deep-learning algorithm to understand the sonar image created by the onboard sensors. During their analysis, volunteers were able to spell out approximately 20,000 words in the English lexicon.

SpellRing recognizing English letters.
Louis DiPietro/Cornell University

When tested among folks in the early stages of learning ASL, as well as experienced testers, the SpellRing delivered an accuracy of up to 92% at turning the hand signs into text. “ASL is a very complicated, complex visual language,” says Hyunchul Lim, lead author of the paper detailing the SpellRing, adding that they are now focused on tuning the algorithms to understand words and phrases.

Potential that needs time to mature

As per the research paper, this is the first wearable-based device that integrates an inertial sensing system with acoustics to provide real-time ASL fingerspelling convenience. During their tests, the team showcased how it can be used to perform web search on a phone, handle map navigation, and type text in notes.

Person showing off the SpellRing.
Louis DiPietro/Cornell University

The team behind SpellRing is not pushing it as a universal solution, at least not in its current shape. Instead, they are promoting the idea of a fast and accessible text entry tool with its own set of benefits.

“Specifically, ASL fingerspelling can be significantly faster than typing on a smartphone’s virtual keyboard,” notes the research paper, which is going to be presented at the Association of Computing Machinery’s conference on Human Factors in Computing Systems conference in Japan next month.

Hardware schematic for SpellRing.
Louis DiPietro/Cornell University

The team is hoping to further build on their work by adding support for gestures and the ability to recognize words as well as phrases. On the hardware side, they are hoping to fit all the key components, including the intertial sensor (which currently is mounted on a separate connected board) on a single unified board.

Subsequently, a curved battery can be fitted into the kit and eventually turn the prototype into something that looks like an off-the-shelf smart ring, similar to those offered by Oura or Samsung. The team also envisions side-by-side development and integration with AR glasses, so that hand gestures can be tracked alongside vision-based interpretation for even more seamless conversations.

Nadeem Sarwar
Nadeem is a tech and science journalist who started reading about cool smartphone tech out of curiosity and soon started…
Are we about to see ‘the iPhone of artificial intelligence’?
The ChatGPT name next to an OpenAI logo on a black and white background.

Apple’s former design guru Jony Ive is reported to be in talks with prominent AI startup OpenAI to create what’s being dubbed “the iPhone of artificial intelligence.” And if you think that sounds like pie in the sky, then take note: The project could be bankrolled to the tune of $1 billion by Japanese tech giant SoftBank.

OpenAI, the startup behind the trailblazing ChatGPT chatbot, is in advanced talks with Ive and SoftBank chief Masayoshi Son about the potential project, according to a Financial Times report on Thursday.

Read more
Samsung’s new upcycling program turns your old phone into a SmartThings device
samsung galaxy upcycling at home ces 2021 smartthings

The smartphone business isn't exactly the most eco-friendly. Companies have been working to correct that in recent years, like through programs that disassemble and reuse the metals inside of our phones, but there's still a long way to go. Samsung has announced an alternative solution to the problem, though -- the new Galaxy Upcycling at Home initiative that envisions your old Galaxy phones as smart home devices.

Galaxy Upcycling at Home works with Samsung's SmartThings smart home system and allows users to designate their old phones as a number of different things.

Read more
You can now press fast-forward on Instagram Reels
The Instagram mobile app.

Instagram now has another way of making the platform look more like TikTok each passing day. The Meta-owned social media site has added the ability for user to play Instagram Reels at 2x speed.

Meta announced in an email on Thursday that Instagram users can now watch Reels at twice the rate they normally would, especially if the videos are long. The company said that the 2x speed feature is a highly requested feature, so now they can play their videos just as fast as they would on TikTok.

Read more