Australia science tugs heart-strings

2012-08-27 08:40
An Australian neuroscience project aiming to translate emotional impulses directly into music is hoping to find out whether human emotion can be tracked in the lab.

An Australian neuroscience project aiming to translate emotional impulses directly into music is hoping to find out whether human emotion can be tracked in the lab. (Shutterstock)

Multimedia   ·   User Galleries   ·   News in Pictures Send us your pictures  ·  Send us your stories

Sydney - Do humans really wear their hearts on their sleeve? An ambitious Australian neuroscience project aiming to translate emotional impulses directly into music is hoping to find out.

Canadian artist Erin Gee describes it as "human voices in electronic bodies", and there is a definite futuristic feel to her collaboration with the University of Western Sydney's medical school.

A fingerprint scan is required to gain entry to the labs where her first subject, Ben Schultz, 27, is strapped to a bed, connected via a complex maze of wires to monitors not unlike those seen in a hospital.

Neurophysiologist Vaughan Macefield plays with a needle attached to a wire feeding directly into Schultz's leg, listening carefully for changes in the white noise crackling from a speaker in the corner.

"That's the sound that's being picked up from the nerve," Gee said. "That's the translation of what's happening electrically."


Schultz said the needle was uncomfortable when it was moved but was not painful.

Tapping into a very precise part of the nerve will allow Macefield to eavesdrop directly on the brain's signals to the body as Schultz is shown a series of images designed to elicit emotion, such as mutilation and erotica.

And that is where the music begins.

"While we cannot read Ben's mind and tell you why he's feeling emotions, the technology exists today that we can actually definitively tell you that he is feeling emotions, and we can tell you exactly how much emotion he's feeling," Gee said.

"I can bottle Ben's emotions and save them for later."

Along with the nerve reading, Schultz's blood pressure, breathing speed, skin sweat and heart activity are being recorded and fed into Gee's computer, where custom-made software converts them into a chorus of chimes and bells.

The experiment will be repeated with several other subjects so Gee and Macefield can fine-tune their methods and sounds for a live "emotional symphony" performance that promises to be unlike any other attempted before.


Two actors attached to the various monitors will perform an "emotional score" - Gee is not quite sure what it will look like yet, but it will require them to summon a series of emotions.

The music their feelings produce - "what happiness sounds like" for instance - will be performed by small robotic pianos that will also flash lights as different moods are detected.

The team has chosen actors as subjects because they routinely need to manifest emotion on demand.

"It will be like seeing someone expertly playing their emotions as they would play a cello," said Gee, whose first show is scheduled for Montreal in 2013.

Macefield said the research would feed into the field of "affective computing", which deals with machines that can understand and respond to human inputs.

Computers that can connect directly to the brain, allowing users to search for information simply by thinking about it, are currently in development and Macefield said he was interested in how machines could help people.

Many mental illnesses and disorders are associated with heightened or blunted emotional responses and Macefield said technology could have therapeutic benefits.

Children with autism disorders, for example, struggled to understand the emotions of others or to express themselves, and Macefield said Gee's robotic technology could be used to teach them how to identify feelings by externalising and exaggerating them into forms like music.

"It may well be that by amplifying people's emotions they can read them better; it may be that by amplifying their own emotions that people can read them better," he said.

Read more on:    health  |  research

Read News24’s Comments Policy publishes all comments posted on articles provided that they adhere to our Comments Policy. Should you wish to report a comment for editorial review, please do so by clicking the 'Report Comment' button to the right of each comment.

Comment on this story
Add your comment
Comment 0 characters remaining

Inside News24


ANCYL: Not voting would be blasphemy

Not voting in the forthcoming elections would be blasphemy, the ANCYL says in a statement commemorating the 50th anniversary of struggle icon Nelson Mandela's Rivonia trial speech.


Latest elections multimedia

Why Jack Parow wants you to vote on 7 May
The ad the SABC doesn't want to air
Elections 2014 in one cartoon
This year's election posters
  • Thursday Sir Lowry's Pass - 05:35 AM
    Road name: Old Sir Lowrys Pass Road
    TRAFFIC LIGHTS not working at Bezweni Road
  • Thursday Cape Town - 05:35 AM
    Road name: Buitengracht Street
    TRAFFIC LIGHTS not working at Waterkant Street
More traffic reports...

Jobs in Cape Town [change area]

Property [change area]

Travel - Look, Book, Go!

Escape winter, head to Mauritius

Escape winter by spending 7 nights in Mauritius' tropical bliss from R13 215 per person sharing. Includes return flights, airport transfers and accommodation. Book now! - shop online today

Get many eggs in one basket!

Gaming bundles: 2 Super Hits games for R99, 3 Disney games for R99 and more + exclusive accessory bundles only available on While stocks last. Shop now!

25% off bestselling books!

The Real Meal Revolution by Tim Noakes, Jeffrey Archer’s Be Careful What You Wish for, Man’s Search for Meaning by Victor E. Frank and many more titles. Shop now!

Up to 25% off electronics

Buy top electronics and save up to 25%. Such as’s 1# selling product the gobii eReader, Patriot X Porter flash drive, Asus Nexus 7” 3G tablet, Samsung Galaxy SIII, Lenovo G580 Notebook and many more. Shop now!

DStv HD PVR Decoder now R949

The DStv HD PVR Decoder has further revolutionised the television experience with lifelike viewing, sharper images, more vibrant colours and precision picture quality. Now R949, save R550. Offer valid while stocks last. Shop now!

Up to 30% off appliances & homeware

Save up to 30% on appliances and homeware this Easter! Offer valid while stocks last. Shop now.

OLX Free Classifieds [change area]

Samsung Galaxy s4

Mobile, Cell Phones in South Africa, Western Cape, Cape Town. Date October 24

Best bargain in big bay

Real Estate, Houses - Apartments for Sale in South Africa, Western Cape, Cape Town. Date October 25

VW Golf 6, 1.6 Trendline (Excellent condition)

Vehicles, Cars in South Africa, Western Cape, Cape Town. Date October 25

BlackBerry Curve 8520

Wi-Fi enabled With the BlackBerry Curve 8520 connect to your home...

From R1100.00

I'm shopping for:


There may be a break through, either through quiet contemplative time to connect to your deep side or forced on you more

There are new stories on the homepage. Click here to see them.


Create Profile

Creating your profile will enable you to submit photos and stories to get published on News24.

Please provide a username for your profile page:

This username must be unique, cannot be edited and will be used in the URL to your profile page across the entire network.


Location Settings

News24 allows you to edit the display of certain components based on a location. If you wish to personalise the page based on your preferences, please select a location for each component and click "Submit" in order for the changes to take affect.

Facebook Sign-In

Hi News addict,

Join the News24 Community to be involved in breaking the news.

Log in with Facebook to comment and personalise news, weather and listings.