天美传媒

Skip to content
Science & Technology

Brain signal indicates when you understand what you鈥檝e been told

天美传媒 professor Edmund Lalor, along with colleagues at Trinity College in Dublin, Ireland, has developed a new method for using relatively inexpensive EEG scalp readings to assess how well people understand what they are hearing. In one experiment, researchers used just the electrical activity on the scalp's surface to compare brain signals while subjects listened to Hemingway's Old Man and the Sea played forwards and then backwards. (天美传媒 photo / courtesy Edmund Lalor)

During everyday interactions, people routinely speak at rates of 120 to 200 words per minute. For a listener to understand speech at these rates 鈥� and not lose track of the conversation 鈥� the brain must comprehend the meaning of each of these words very rapidly.

鈥淭hat we can do this so easily is an amazing feat of the human brain 鈥� especially given that the meaning of words can vary greatly depending on the context,鈥� says , associate professor of and neuroscience at the 天美传媒 and Trinity College Dublin. 鈥淔or example, 鈥業 saw a bat flying overhead last night鈥� versus 鈥榯he baseball player hit a home run with his favorite 产补迟.鈥欌赌�

Now, researchers in Lalor鈥檚 lab have identified a brain signal that indicates whether a person is indeed comprehending what others are saying 鈥� and have shown they can track the signal using relatively inexpensive EEG (electroencephalography) readings taken on a person鈥檚 scalp.

This could have a number of 鈥減otentially significant鈥� applications, Lalor says. They include:

  • testing language development in infants;
  • determining the level of brain function in patients who are in a reduced state of consciousness, such as a coma;
  • confirming that a person in a particularly critical job has understood the instructions they have received (e.g., an air traffic controller or a soldier);
  • testing for the onset of dementia in older people based on their ability to follow a conversation.

The research, , applied machine learning to audio books that human subjects listened to. 鈥淥ne can train a computer by giving it a lot of examples and by asking it to recognize which pairs of words appear together a lot and which don鈥檛,鈥� Lalor explains. 鈥淏y doing this, the computer begins to 鈥榰nderstand鈥� that words that appear together regularly, like 鈥榗ake鈥� and 鈥檖ie,鈥� must mean something similar. And, in fact, the computer ends up with a set of numerical measures capturing how similar any word is to any other.鈥�

The researchers then correlated the numerical measures with brainwave signals that were recorded as participants listened to the corresponding sections of the audio books. They were able to identify a brain response that reflected how similar or different a given word was from the words that preceded it in the story.

This was verified in one experiment, for example, when subjects listened to Hemingway鈥檚 Old Man and the Sea. 鈥淲e could see brain signals telling us that people could understand what they were hearing,鈥� Lalor said. 鈥淲hen we had the same people come back and hear the same audio book played backwards, the signal disappears entirely.鈥�

In another experiment, participants listened to a speech by Barack Obama that was 鈥渂uried in a fair amount of background noise, so you can make out only a couple words here and there,鈥� Lalor said. When participants then watched a video of the speech, and could use facial cues to better understand what Obama was saying, the signal 鈥渋ntensifies dramatically.鈥�

In the paper, Lalor鈥檚 team notes that there is more work to be done to fully understand the full range of computations that our brains perform when we understand speech. They have begun searching for other ways that brains might compute meaning, how those computations differ from what computers do, and how best to apply this new approach.

Lalor joined the 天美传媒 in 2016, after serving five years as an assistant professor at Trinity College in Dublin, Ireland. He is still affiliated with Trinity, and three of his graduate students there 鈥� lead author Michael Broderick, Giovanni Di Liberto, and Michael Crosse, now a postdoc at Albert Einstein College of Medicine 鈥� contributed to this study. So did Andrew Anderson, a postdoctoral fellow in Lalor鈥檚 lab in Rochester.