January 31, 2023

A “Tower of Babel” device that gives the illusion of being bilingual is being developed by US scientists.
Users simply have to silently mouth a word in their own language for it to be translated and read out in another.
The researchers said the effect was like watching a television programme that had been dubbed.
The system, detailed in New Scientist, is not yet fully accurate, but experts said it showed the technology was “within reach”.
The idea is that you can mouth words in English and they will come out in Chinese or another language.
The translation systems that are currently in use work by using voice recognition software.
But this requires people to speak out loud and then wait for the translation to be read out, making conversations difficult.
But the new device, being created by researchers at Carnegie Mellon University, Pittsburgh, is different.
Electrodes are attached to the neck and face to detect the movements that occur as the person silently mouths words and phrases.
Using this data, a computer can work out the sounds being formed and then build these sounds up into words.
The system is then able to translate the words into another language which is read out by a synthetic voice.

%d bloggers like this: