Featured Research

from universities, journals, and other organizations

Computer can read letters directly from the brain

Date:
August 19, 2013
Source:
Radboud University Nijmegen
Summary:
By analysing MRI images of the brain with an elegant mathematical model, it is possible to reconstruct thoughts more accurately than ever before. In this way, researchers have succeeded in determining which letter a test subject was looking at.

By analysing MRI images of the brain with an elegant mathematical model, it is possible to reconstruct thoughts more accurately than ever before. In this way, researchers from Radboud University Nijmegen have succeeded in determining which letter a test subject was looking at.
Credit: Image courtesy of Radboud University Nijmegen

By analysing MRI images of the brain with an elegant mathematical model, it is possible to reconstruct thoughts more accurately than ever before. In this way, researchers from Radboud University Nijmegen have succeeded in determining which letter a test subject was looking at.

Related Articles


The journal Neuroimage has accepted the article, which will be published soon.

Functional MRI scanners have been used in cognition research primarily to determine which brain areas are active while test subjects perform a specific task. The question is simple: is a particular brain region on or off? A research group at the Donders Institute for Brain, Cognition and Behaviour at Radboud University has gone a step further: they have used data from the scanner to determine what a test subject is looking at.

The researchers 'taught' a model how small volumes of 2x2x2 mm from the brain scans -- known as voxels -- respond to individual pixels. By combining all the information about the pixels from the voxels, it became possible to reconstruct the image viewed by the subject. The result was not a clear image, but a somewhat fuzzy speckle pattern. In this study, the researchers used hand-written letters.

Prior knowledge improves model performance

'After this we did something new', says lead researcher Marcel van Gerven. 'We gave the model prior knowledge: we taught it what letters look like. This improved the recognition of the letters enormously. The model compares the letters to determine which one corresponds most exactly with the speckle image, and then pushes the results of the image towards that letter. The result was the actual letter, a true reconstruction.'

'Our approach is similar to how we believe the brain itself combines prior knowledge with sensory information. For example, you can recognise the lines and curves in this article as letters only after you have learned to read. And this is exactly what we are looking for: models that show what is happening in the brain in a realistic fashion. We hope to improve the models to such an extent that we can also apply them to the working memory or to subjective experiences such as dreams or visualisations. Reconstructions indicate whether the model you have created approaches reality.'

Improved resolution; more possibilities

'In our further research we will be working with a more powerful MRI scanner,' explains Sanne Schoenmakers, who is working on a thesis about decoding thoughts. 'Due to the higher resolution of the scanner, we hope to be able to link the model to more detailed images. We are currently linking images of letters to 1200 voxels in the brain; with the more powerful scanner we will link images of faces to 15,000 voxels.'


Story Source:

The above story is based on materials provided by Radboud University Nijmegen. Note: Materials may be edited for content and length.


Journal Reference:

  1. Sanne Schoenmakers, Markus Barth, Tom Heskes, Marcel van Gerven. Linear reconstruction of perceived images from human brain activity. NeuroImage, 2013; DOI: 10.1016/j.neuroimage.2013.07.043

Cite This Page:

Radboud University Nijmegen. "Computer can read letters directly from the brain." ScienceDaily. ScienceDaily, 19 August 2013. <www.sciencedaily.com/releases/2013/08/130819141641.htm>.
Radboud University Nijmegen. (2013, August 19). Computer can read letters directly from the brain. ScienceDaily. Retrieved March 2, 2015 from www.sciencedaily.com/releases/2013/08/130819141641.htm
Radboud University Nijmegen. "Computer can read letters directly from the brain." ScienceDaily. www.sciencedaily.com/releases/2013/08/130819141641.htm (accessed March 2, 2015).

Share This


More From ScienceDaily



More Computers & Math News

Monday, March 2, 2015

Featured Research

from universities, journals, and other organizations


Featured Videos

from AP, Reuters, AFP, and other news services

HP to Buy Aruba Networks in $3B Deal

HP to Buy Aruba Networks in $3B Deal

Reuters - Business Video Online (Mar. 2, 2015) — Hewlett-Packard is boosting its mobile computing business... buying California-based Aruba Networks- a wi-fi network gear maker for $24.67 per share. Leah Duncan reports. Video provided by Reuters
Powered by NewsLook.com
Can Curved Screen Give Samsung the Edge?

Can Curved Screen Give Samsung the Edge?

Reuters - Business Video Online (Mar. 2, 2015) — South Korea&apos;s Samsung Electronics Co Ltd unveiled its latest Galaxy S smartphones, featuring a slim body made from aircraft-grade metal, in a bid to reclaim the throne of undisputed global smartphone leader from Apple Inc. Hayley Platt reports. Video provided by Reuters
Powered by NewsLook.com
Can Samsung Pay Make Mobile Payments Catch On?

Can Samsung Pay Make Mobile Payments Catch On?

Newsy (Mar. 1, 2015) — Samsung unveiled a mobile payment system that could have a wider reach than Apple Pay thanks to technology that mimics a credit card&apos;s magnetic strip. Video provided by Newsy
Powered by NewsLook.com
HTC And Valve Team Up For Virtual Reality Headset

HTC And Valve Team Up For Virtual Reality Headset

Newsy (Mar. 1, 2015) — HTC unveiled Vive, its new virtual reality headset, Sunday. The device is supported by gaming company Valve, which has made a push into the market. Video provided by Newsy
Powered by NewsLook.com

Search ScienceDaily

Number of stories in archives: 140,361

Find with keyword(s):
 
Enter a keyword or phrase to search ScienceDaily for related topics and research stories.

Save/Print:
Share:  

Breaking News:

Strange & Offbeat Stories

 

Space & Time

Matter & Energy

Computers & Math

In Other News

... from NewsDaily.com

Science News

Health News

Environment News

Technology News



Save/Print:
Share:  

Free Subscriptions


Get the latest science news with ScienceDaily's free email newsletters, updated daily and weekly. Or view hourly updated newsfeeds in your RSS reader:

Get Social & Mobile


Keep up to date with the latest news from ScienceDaily via social networks and mobile apps:

Have Feedback?


Tell us what you think of ScienceDaily -- we welcome both positive and negative comments. Have any problems using the site? Questions?
Mobile iPhone Android Web
Follow Facebook Twitter Google+
Subscribe RSS Feeds Email Newsletters
Latest Headlines Health & Medicine Mind & Brain Space & Time Matter & Energy Computers & Math Plants & Animals Earth & Climate Fossils & Ruins