Brain Implants with AI Turns Brain Activity into Intelligible Speech

A research team at Columbia University has managed to reconstruct speech from the human brain’s auditory cortex using a combination of brain implants and deep learning methods. Previously, reconstructing speech from thoughts coming from the human brain via speech neural prosthetics (sensory implants) have been achieved, but the level of output quality was judged to be too low for practical usage. In order to get around this problem, the team placed electrodes in the brains of five volunteers scheduled to have brain surgery for epilepsy, and they were asked to listen to a closed-set of sentences and numbers with the resultant brain activity used to train deep-learning speech recognition software. This experiment yielded a 75% intelligibility score (not accuracy, but how comprehensive the speech was). This outcome provides some hope for developing a technology that would allow people with speech paralysis to communicate. This would require giant amounts of data sets to train the AI. However, the principles could be used to develop speech reproduction from human thought.