Neuroscience
It has now been shown, for the first time that is possible to reconstruct basic speech units like words, and complete sentences directly from brain waves and to generate the corresponding text. The research could be the first step in systems that can read your mind. |
Speech is mainly produced in the human cerebral cortex. For many years, brain waves associated with speech processes can be directly recorded with electrodes located on the surface of the cortex.
It has now been shown, for the first time that is possible to reconstruct basic speech units like words, and complete sentences of continuous speech from these brain waves and to generate the corresponding text.
Researchers at KIT and the Wadsworth Center, have published their research in the scientific journal Frontiers in Neuroscience.
"It has long been speculated whether humans may communicate with machines via brain activity alone,” says Tanja Schultz, who conducted the present study with her team at the Cognitive Systems Lab of KIT. "As a major step in this direction, our recent results indicate that both single units in terms of speech sounds as well as continuously spoken sentences can be recognized from brain activity."
Related articles |
The present work is the first that decodes continuously spoken speech and transforms it into a textual representation. For this purpose, cortical information is combined with linguistic knowledge and machine learning algorithms to extract the most likely word sequence. Currently, Brain-to-Text is based on audible speech. However, the results are an important first step for recognizing speech from thought alone.
"Our recent results indicate that both single units in terms of speech sounds as well as continuously spoken sentences can be recognized from brain activity." |
While the patients read aloud sample texts, the ECoG signals were recorded with high resolution in time and space. Later on, the researchers in Karlsruhe analyzed the data to develop Brain-to-Text. In addition to basic science and a better understanding of the highly complex speech processes in the brain, Brain-to-Text might be a building block to develop a means of speech communication for locked-in patients in the future.
SOURCE Karlsruhe Institute of Technology
By 33rd Square | Embed |
0 comments:
Post a Comment