Raja - A Multidisciplinary Artistic Performance

The performance set up of Raja gives a possibility to use two complementary tracking systems and two alternative choices formotion sensors in real-time audio-visual synthesis. Raja is a part of Human Emotional Interaction project funded by the Finnish Funding Agency for Technology and Innovation TEKES and steered by Nokia Research Center.

2010 / multimodal interaction

The choreography

The novelty in the Raja performance compared to other systems is the simultaneous use of two different tracking systems: motion and position. Also, there is a possibility to use both accelerometer and gyro for motion tracking.

One of the future directions to improve Raja is to enhance the sound-action strategies. By recognising different types of movements and mapping that to a sound synthesis engine with a richer set of timbral and temporal parameters a more intriguing experience for both performers and audience can be created.

The choreography of the Raja dance performance for three dancers was sketched by a professional choreographer in an iterative process..


The technical configuration of the system includes three laptop computers, networked together via an Ethernet switch. The indoor positioning, motion sensing and sound synthesis systems were each using their own laptop. In theory, everything could run in a single computer. However, to be able to monitor and control the different technologies at the same time, it was more convenient that each team had their own laptop

Raja Performance @ Nokia Foundation Awards Ceremony 2010