New learning tool on the horizon, teaching hand position through electronic stimulus

This one sounds like something out of science fiction, but it is not.

WANT to learn a musical instrument, but can't find the time to practise? A device now under development can take control of your hand and teach you how to play a tune. No spirits of dead musicians are involved.

PossessedHand, being developed jointly by the University of Tokyo, Japan, and Sony Computer Science Laboratories, also in Tokyo, electrically stimulates the muscles in the forearm that move your fingers. A belt worn around that part of the subject's arm contains 28 electrode pads, which flex the joints between the three bones of each finger and the two bones of the thumb, and provide two wrist movements. Users were able to sense the movement of their hands that this produced, even with their eyes closed. "The user's fingers are controlled without the user's mind," explains Emi Tamaki of the University of Tokyo, who led the research.

Devices that stimulate people's fingers have been made before, but they used electrodes embedded in the skin, which are invasive, or glove-like devices that make it hard to manipulate an object. Tamaki claims that her device is far more comfortable. "The electric stimulations are similar to low-frequency massage stimulations that are commonly used," she says.

Having successfully hijacked a hand, the researchers tried to teach it how to play the koto, a traditional Japanese stringed instrument. Koto players wear different picks on three fingers, but pluck the strings with all five fingertips, so each finger produces a distinctive sound. A koto score tells players which fingers should be moved and when, and from this Tamaki and her team were able to generate instructions telling their device how and when to stimulate the wearer's muscles.

PossessedHand does not generate enough force to pluck the koto strings, but it could help novice players by teaching them the correct finger movements. Tamaki and her team found that two beginner players made a total of four timing errors when using PossessedHand, compared with 13 when playing unassisted. After prompting from the device, the players also made one less mistake about which finger to use.

Read the article at New Sceintist
Hand-hacking lets you pluck strings like a musical pro - tech - 23 June 2011 - New Scientist