With the launch of the Google Pixel 11 smartphone series yesterday, Google also showed off several interesting software features that have been updated for the device series, including the Live Transcribe feature. Previously, the Live Transcribe feature was seen to be able to convert spoken diction to text as an efficient way to record information.
Most recently, with the offering of the latest Sign Language to Text (SL2T) language model developed by Google Deepmind, the Live Transcribe feature on the Google Pixel 11 device series can now quickly translate American Sign Language sign language to text.
The front-facing camera of this device series is used to record hand movements which can then be translated to text as a way to record thoughts or to allow people to understand speech in sign language.
Google Deepmind says that the SL2T model was trained using 100,000 hours of American Sign Language sign language data. For now, this translation function can only translate ASL to English, but Google has confirmed that it will support more sign language options and will be able to translate to more languages in the future.
For now, this SL2T language model has been introduced in the Live Transcribe feature on the Google Pixel 11 series of devices and also in the GBoard keyboard app.
