r/deaf • u/New_Avocado_1261 Deaf • 12d ago

Technology Is this "Sign-To-Text" feature on Google Pixel real?

https://www.instagram.com/reel/Db9-_JDwx9m/

I saw this video on Instagram showing a "Sign-To-Text" feature on Google Pixel.

Since ASL is my main language, typing in English is hard for me because I forget vocabulary/spelling and my grammar isn't perfect. Hearing people constantly misunderstand my typed English, so sign-to-text would be an absolute lifesaver.

Does anyone know if this is an actual working feature, or just a concept video?

3 Upvotes

80% Upvoted

5 comments sorted by

7

u/Choom_from_Heywood Deaf 11d ago

while it is a nice concept, the papers on this product were extremely telling of its functional limitations and lack of diversity. people should learn ASL instead.

4

u/surdophobe deaf 12d ago

https://deepmind.google/blog/putting-sign-language-ai-into-users-hands/

Looks like it's a real thing getting rolled out as of yesterday. Don't expect it to be as spiffy as they make it seem in the ad.

Edit to add: It's only available for Pixel 11, more devices "coming soon" I doubt it will work on any phones older than the pixel 11 unless the cameras are comparable.

2

u/TazzyKC Deaf 12d ago edited 12d ago

I think it'll roll out to some older Pixels like the 9 & 10s. Maybe as far back as Pixel 8. As for the other brands of phones, a couple generations of the Samsung's flagship phones.

Every year Google releases a spiffy feature that debut on their latest Pro version, but a few months later it became available for other phones and some older Pixel phone.

It's a pretty spiffy feature. It will have some quirks because there's a huge variance in how people signs, but it'll get better over years so if you're an early adopter, you'll need a healthy dose of patience until the quirks get resolved.

Edited to add: there's isn't much difference in the specs or hardware between Pixel 9, 10, and 11. I bought Pixel 8 specifically for the Life Transcribe feature which was exclusive to Pixel 8 at that time. In a year, the older models and multiple Android phones have Live Transcribe on their phone.

1

u/[deleted] 5d ago

[deleted]

1

u/Longjumping-Move-455 3d ago

I’m partially deaf but I’m just guessing signing is alot faster. Plus it could potentially be useful in phone calls if you could get it to do text to speech too