Skip to main content

Sonifying IR spectroscopy data - 'chords'

Finding the .resamp1 method in SuperCollider gave me an idea for reducing this rather large set of data into something perhaps more musically useful. Could I make something more like a tonal chord, with pitches repeated in every octave?

I first drastically resampled my data into just twelve points:

f = ((f.flop[1] * -1) + 1).resamp1(12);

These would then be the probabilities of those twelve pitch classes appearing across a range of eight and a half octaves:

f = (f++f++f++f++f++f++f++f++f[..7]); // 104 notes

Then what I did was to multiply this chordal structure by the original data, so that my final sound is the 'glycine chord' amplitude modulated (sort of) by the absorbtion data.

Here's the final code:


( ~name = "glycine"; ~path = Document.current.dir.asString++"/"++ ~name ++".csv"; f = CSVFileReader.readInterpret(~path);
g = f;

f = ((f.flop[1] * -1) + 1).resamp1(12);
f = (f++f++f++f++f++f++f++f++f[..7]);
// 104 notes g = ((g.flop[1] * -1) + 1).resamp1(104);
// 104 samples of orig graph ~amps = f.cubed * g;
// combining two approaches ~amps = ~amps.normalize;
~amps.plot(~name, Rect(840,0,600,450));
~freqs = (25..128).midicps;

{ Splay.ar(Klank.ar(`[~freqs, ~amps, nil], PinkNoise.ar(0.01))) }.play; )

I used this approach to make the sound below, which crossfades from glycine to tyrosine to water, then back to glycine again.

Sonifying IR spectroscopy data

I'm in the very early stages of a collaborative project with Dr Steven Ford, Senior Research Fellow and QC Manager at the Cancer Research UK Formulation Unit of Strathclyde University. Steve came to me with an idea about sonifying IR spectroscopy data, with a view to perhaps drawing some creative parallels between vibrations at the atomic scale and musical sound.

Steve sent me some IR data relating to three compounds, water, glycine and tyrosine, and I've been trying some things out in SuperCollider. Here's a plot of the data which Steve sent me:

Thinking in terms of sound, my immediate thought was to try to scale those resonances into the audio region. Here's one of my first attempts:

( ~name = "water"; ~path = Document.current.dir.asString++"/"++ ~name ++".csv";
f = CSVFileReader.readInterpret(~path);

~amps = f.flop\[1\]; // array of amplitudes ~amps.plot(~name, Rect(840,0,600,450));

~freqs = Array.series(f.size, 40, 100); // size, start, step

{ Klank.ar(`[~freqs, ~amps, nil], PinkNoise.ar(0.01)) }.play; )

water01.mp3

There are 784 points of data here, and I've just mapped those arbitrarily to a bank of 784 resonators, spaced 100 Hz apart, starting at 40Hz. It sounds pretty nasty. Then it occured to me that Steve's data is for transmittance, not absorbance: the points of interest are the troughs, not the peaks, the graph is upside down for what I wanted to do. So:

( ~name = "tyrosine"; ~path = Document.current.dir.asString++"/"++ ~name ++".csv";

f = CSVFileReader.readInterpret(~path);

~amps = ((f.flop\[1\] \* -1) + 1).cubed; // invert, massage ~amps.plot(~name, Rect(840,0,600,450));

~freqs = (64..128).resamp1(f.size).midicps;

{ Klank.ar(`[~freqs, ~amps, nil], PinkNoise.ar(0.01)) }.play; )

Here I was also starting to think about how to bring out the peaks in the data, hence the .cubed. This does make the data 'pointier', but at the expense of the smaller peaks. A slightly different strategy with the frequencies here also, 784 microtonal pitches between midi notes 64 and 128. It still sounds really pretty nasty:

tyrosine01.mp3

Gathering of the Gamelans, Saturday, Wayang Lokananta

At last, we get to the piece we have all been working towards for so many months:

Kanda Buwana is the company name of dhalang Matthew Isaac Cohen. I have known Matthew for a number of years, most notably during the period when he was at Glasgow University. Matthew was responsible for bringing dhalang Ki Joko Susilo to Scotland, and Mas Joko, as we called him, was in turn reponsible for a transformation in the approach of Gamelan Naga Mas. He brought to us a great chunk of highly distinctive repertoire, most of it derived from the wayang, which we still play today: a talu, unusual srepeg and sampak, and Joko's arrangements of such pieces as Caping Gunung, Gambang Suling and Wong Donya. Our musical director Signy Jakobsdottir soaked up a year's worth of wayang drumming from Joko: Matthew was always around, playing peking devising wayang in English with Joko, with his then young daughter Hannah climbing all over him in rehearsal. Happy days.

To commemorate 30th anniversary of York's Gamelan Sekar Petak, Matthew created 'Lokananta, or the Playerless Gamelan', interweaving a number of different oral and literary sources with music which John Pawson had garnered from gamelan groups across the UK. Each section of the wayang was accompanied by a different group: in order, Cardiff Gamelan, Gamelan Midwest (comprising Cheltenham and Oxford), Gamelan Scotland (Aberdeen University, Gado-gado and Naga Mas), Gamelan Sekar Petak (York), Gamelan South East (Cambridge, Siswa Sukra, Southbank Gamelan Players), Gamelan South West (Bath Spa, Bristol), and Gamelan North (Chopwell, Dwi Gambira Sari, Durham.)

A full DVD of the show is in preparation, and I'm not going to attempt to describe the whole thing. The high point of the show for me was John Pawson's arrangement of Subakastawa Nyamat. Arrangement is too small a word for it: this was a unique artistic creation, bringing together all of the tunings, players and gamelans in a melding of Kodok Ngorek and Subakastawa. A great wave of building emotion as the first gamelan descended from the heavens, and all the musicians spread around the room gradually joined in singing 'Mideringrat…':

A moment I will never forget.

Though I say so myself, Gamelan Scotland acquitted themselves extremely well: 'blown away' was the response we seemed to get from everyone, not least for the dramatic entrance of our piper Hazen Metro on Margaret Smith's piece Iron Pipes. Another emotional moment for me as Mags sang her arrangement of Ca' the Yowes, and a scary moment for me when I had to lead the entire audience in a brief kecak! I also played Gamelunk, of course, which came off pretty well.

As to the wayang itself: the amplifiation of Matthew's voice was not entirely satisfactory on the musician's side of the screen, and there was much I could not follow. Matthew has a wicked sense of humour, and can be very good at the interplay and in-jokes between the musicians and the puppeteer: again, some of this seemed to get lost. I was impressed with Matthew's puppet technique, including a great trick of catching the limbs of one puppet between another and the screen, used to great effect in some of the fight scenes.

Gathering of the Gamelans, Saturday sessions

Today's conference activities were somewhat disrupted by a revised schedule of wayang rehersals, which also caused our Scottish group a certain amount of last minute phone calls to try to get everyone there in time. I was fortunately able to make Helen Loth's paper session '"Why gamelan, couldn't we just use steel-pans?": The use of gamelan with special needs groups and populations'. Helen is engaged on doctoral research in this area, and presented an illuminating account of her findings so far. Her application of the term 'special needs groups' is very broad: in effect she is surveying pretty much the a full range of what I would might have called 'community music' with gamelan in the UK. After a literature review, she presented a series of tables full of interesting nuggets of information: for instance, the most common timescale for this kind of work seems to be the (often criticised) one-off workshop, followed by the 1-2 week residency. I was particularly interested in a diagram which laid out people's perceived feelings about the different tunings one could potentialy use, slendro, pelog, Sundanese and two Balinese tunings. I was also fascinated by some of the negative perceptions of gamelan music which she had identified in her study. With the rescheduled day there was little time for discussion: this would have been an interesting area to probe further.

I've now been to two really excellent workshops by Jonathan Roberts. A number of years ago I participated in an illuminating session on wayang puppets and puppetry, and this morning he gave us a great section on gerongan, the unison (mostly male) singing which accompanies Javanese gamelan. In a brave but completely correct move, I think, Jonathan had us do hardly any singing, but spent the majority of the time on Javanese pronunciation. There are a number of sounds in the language which are not found in English, which we worked through in some detail: at times the session almost turned into – bilabial fricative?! – a lecture on phonetics. I still struggle to hear the difference between those d and t sounds, but I think I have clearer idea how to make them.

After the pronunciation, Jonathan took us through some techniques in Javanese vocal production. He started off by busting the myth that it is 'nasal'. Instead, we were to try yawning, to start to feel the action of the pharynx and how that could be brought into action to produce a kind of vocal resonance which he called 'twang'. I can't do it yet, but at least I'm going to stop singing through my nose!

Gathering of the Gamelans, Saturday rehearsals

Substantial chunks of the day were taken up by a series of rehearsals for the wayang. The venue was a modern dining hall, with a kind of semicircular shape. Spacially this allowed for a very good arrangement, with room for audience all around, and a separate staging area off to one side for dance and video. The ceiling was perhaps a little low, and the sound less resonant than might have been ideal.

There were seven amalgamated gamelan groups from over the UK who needed to rehearse: around 170 musicians in total! Coordinating all of this was musical director John Pawson, and by and large we got to do what we needed to do, albeit not without a certain amount of last minute stress. A day of hurry up and wait, mostly, with the Scottish group almost missing out on our final fifteen minute run-through.

Now, an interesting aside, but I want to tread carefully, as this concerns an overheard remark. One of the groups was about to rehearse a piece which incorporated clarinet, and someone from one of the other groups was apparently heard to say 'Here comes the sacrilege'. Maybe this was a joke: probably it was a joke. I entirely respect the conservative impulse in traditional musics, but 'sacrilege' seems a very strong word. Of course we were all thinking, 'Wait till he hears the bagpipes!'.

An excellent Indonesian meal was provided for the participants: I had the rendang, always a favourite!

Gathering of the Gamelans - Day 2, afternoon

After lunch today we had a joint session, with three people presenting their experience of teaching gamelan in schools and universities. I am presently engaged on a project to attempt to establish a gamelan at Stevenson College Edinburgh (soon to be Edinburgh College), so this area is of particular interest to me.

Ruth Andrews runs a gamelan programme for 12-17 year olds at the International School of Amsterdam, which sounds like it would be a model to aim for. The gamelan is permanently installed in a large room, and all the students have gamelan activity in every year of their studies. Links are made between the cultural and historical perspectives offered by the gamelan and other areas of the curriculum. The gamelan seems to have become a central, shared experience for everyone at the school: a musical ensemble where everyone takes part on an equal level, with no soloists or stars.

Andy Gleadhill is a music officer in Bristol, where gamelan is firmly established as a whole-class music activity within the primary curriculum. There are 66 (!) specially designed sets of gamelan instruments in their schools. Andy presented some material from a particular project which combined Digital Audio Workstation technology – loops and recording in GarageBand – with gamelan, the students working to put together a hybrid version of a Black Eyed Peas song.

Maria Mendonça outlined a degung programme which she runs at Kenyon College in the States. I don't fully understand the American system, but this seems to be one-semester class which can be taken by either music students or students on other degrees. She works largely by ear rather than using notation, and spoke very positively about the level playing field which can be established between trained and untrained musicians. She described a teaching model where the students have a two-hour class, followed by an hour to work as a group on their own. She seems to use peer teaching extensively, on the very simple model of having students swap around and teach each other the parts: a practice I have also employed.

This was an informative and inspirational setting. Particularly impressive was the roster of visiting artists which Maria had managed to get, which included, wait for it, Euis Komariah, Nano S and Balawan! (Ok, perhaps these names may not mean much to non-gamelan specialists… I was about as impressed as I would have been if she said she had got Ella Fitzgerald, Duke Ellington, and Charlie Christian :)

Later in the afternoon, Charlotte Pugh and John Jacobs gathered a large group of us together for a session billed as a gamelan 'improvisation' workshop, although it seems to me it was more like a session on group devising. Charlotte played to us the outline of a medium length phrase in slendro, which we kind of copied back as a group, or in small teams, in an approximate fashion. John then gave us a similar phrase on the pelog instruments which we also worked on in small teams, and then both pieces of material were combined. A very chaotic sound resulted, but with some definite sense of shape. A short discussion ensued as to what we might then do if this was the first week of an eight-week project. Would the work crystalise into a composition, or would one seek to open up the process to a much more free and unpredictable form of improvisation?

An interesting point of practice which I will file away for future use: they had a couple of mics up, and a dedicated engineer who was able to play back to us instantly the short chunk we had just put together. This instant feedback was a great way for the group to be aware of the whole picture, not just what each subgroup was doing.

Gathering of the Gamelans - Day 2, morning

Our first session today was the fascinating tale of the Dutch group 'Babar Layar', as researched by Maria Mendonça. It's a story worthy of Hollywood: a group of Dutch teenagers who decided to construct their own gamelan under the Nazi occupation, going on to become a key influence on gamelan in Europe and the States. There's a clip of them playing at an Eistedfodd in Wales in 1953 (about 1'50 into that clip).

After Maria's session I took a break, and missed what seems to have been one of the best workshops of the conference 'The Song of the Gong: teaching Javanese gamelan to the early-years with reference to Kodály, Dalcroze & Alexander' by Nikhil Dally. I gather this was a very grounded, embodied, vocal approach to teaching basic gamelan cycles.

Over lunch we had 'a concert of contemporary music for chamber gamelan ensembles, with electronics flute, banjo and vibraphone'. The standout piece was undoubtably Robert Campion's 'Gendèr Study 3'. The idea of making a 'study' for this complex and hard to master instrument makes perfect sense: a tightly structured, sparky piece, performed with great focus and intensity by the composer himself.

Jon Hughes, John Jacobs and Charlotte Pugh had collaborated on a piece which seemed to comprise a layer of devised loops and fragments, recorded and diffused over an ambisonic rig, combined with live ?improvised rebab from Charlotte and planned ostinato material from John on gender paneruus and Sundanse drums. This worked well for me, particularly the rhythmic energy of the piece.

Aris Daryono's piece for two sarons wrung a large number of different ideas from the basic idea of imbal: perhaps too many ideas? Ellen Jordan had devised a collision between the traditional American tune Wayfaring Stranger and Wilujeng, with voice, rebab and banjo. A good idea, with perhaps an over-fiddly execution.

Daniel March's 'Pieces of Five and Three' and Symon Clarke's 'Three Exits' were attractive and carefully written, but perhaps a little abstract for my taste.

Gathering of the Gamelans - Day 1

Day 1 of the Gathering of the Gamelans here at York was very exciting and engaging. A great chance to catch up with old friends from the gamelan world, put faces to names, and meet new people.

I left Glasgow purposely very early in order to get down in time to catch Charles Matthews' presentation 'Searching for an approach to gamelan and electronic music'. I've been following Charles on twitter on his recent trip to Indonesia where he was exploring some of these approaches in their native setting, and I was very curious to see what he has been up to. The session started with a performance devised in collaboration with Charlotte Pugh, for gender and laptop. On screen we were able to watch Charles' Max patch in action, as he created what one might term 'electroacoustic cengkok' to compliment Charlotte's gender on 'Sri Katon'. One of the most interesting aspects was his use of a fader on a control surface to manipulate time, 'scratching' his way through each gotra: a unique approach, as far as I am aware.

More pieces followed, showing a variety of improvisatory approaches, some manipulating Charlotte's live sound. Overall the music was mostly slow and evolving: I would be interested to see whether these approaches would work in a more lively style.

We then had an excellent presentation by Sarah Kekus, Ali McCaw, and Chris Stones, 'Exploring sound worlds – creative exploration of traditional cultures from Northern England and Central Java'. A great three-way act, with Chris starting off by getting a few people down from the audience, myself included, to work up a texture for lithophone and gamelan. One this was established, Ali gave us a performance with some wayang golek, including an appearance from a puppet of Peter Crosthwaite, a C19th figure who both travelled in the Far East and established a tradition of Cumbrian lithophony. Sarah Kekus outlined her experiences of gamelan in Cumbria, beginning with an iron Suhirdjan gamelan which she obtained for her school. An excellent presentation of a (perhaps distinctively British?) strand of community/education work with gamelan.

Neil Sorrell lead a session entitled 'Composing for Western instruments and gamelan' by referring to something he calls the 'three Ts': timidity, timbre and tuning. By 'timidity' he seemed to mean a dimension of fear versus daring, when writing for gamelan, which he instanced by playing the opening snatch of Harjito's bagpipe piece 'Sekaten'. His point being, I think, that Indonesian composers are not timid when it comes to innovation!

Guest musician Pak A.L. Suwardi then gave an inspiring talk about his approach to composition, showed some slides of the Gamelan Gentha, a set of self-constructed experimental instruments, and played an extract of another recent project including his own instruments, called I think 'Planet Harmonic'. Many of his comments resonated very strongly with me, particularly in reference to composing for a particular context.

Aris Daryono's presentation of his work was slightly hampered by a laptop disaster which meant he could not bring recordings for us to hear. However, he did present a page from a fully notated score for a piece for flute and gender. He talked about his efforts to have the music which he writes for Western instruments and gamelan presented in straight concert settings, rather than being automatically programmed into some sort of ethnomusicological ghetto. Having recently managed to get a laptop piece performed as part of a regular concert programme, and not automatically placed into the 'electroacoustic' concert, I have a sort of sideways sympathy for the point he makes.

Clive Wilkinson then talked a little about some of his experiences composing for gamelan, including playing us a snatch of his 'Spindrift' from Manchester. I wrote about this piece at the time, and have in fact been invited by Clive to take part in a performance on Sunday, which will be an interesting experience.

A great first day: a refreshingly non-academic atmosphere overall. No-one has so far presented a 'paper' at all, which I miss only a very little bit.

Gathering of the Gamelans

From Thursday of this week to Monday of next I'm going to be at the Gathering of the Gamelans in York. This event is part academic conference, and partly a performative celebration of gamelan in the UK, most particularly the 30 years that Gamelan Sekar Petak has been at the University of York.

For the last couple of months, gamelan groups all over the UK have been rehearsing both separately and collaboratively towards 'Lokananta, Gamelan of the Gods'. This will be a wayang kulit, an all-night shadow puppet play in the Central Javanese style, under the direction of dhalang Matthew Isaac Cohen. To translate dhalang as 'puppeteer' is about as misleading as translating wayang as 'shadow puppet play': both descriptions are accurate, but neither captures the breadth and depth of the form. Over the course of approximately seven hours, the dhalang has the responsibility for creating, leading and performing a multi-modal piece using puppetry, song, dance, and the voice, encompassing everything from high philosophy to low humour, from archaic texts in high Javanese to the most contemporary of references.

This concert in York represents a very rare opportunity to see a complete wayang performed in English. I attended a number of performances in Java, which were fascinating but impossible to follow in detail without a knowledge of the language. (One exception to this was a performance by Ki Purbo Asmoro's with live translation into English by Kitsie Emerson: a two-hour video of one of these is available here, with at least some of the translation visible).

The musical direction for this project has been undertaken by one of the UK's most pre-eminent gamelan musicians, John Pawson, himself a York graduate. Both Matthew and John are keen to keep some surprises up their sleeves, so I'd better not reveal too much! Suffice to say that the Scottish Gamelan (made up of members of Naga Mas and Gado-Gado from Glasgow, and a group from Aberdeen University) will have something very culturally distinctive to offer during our segment of the show. And it ain't shortbread. (Or whiskey. Or tartan. Or golf.)

Performances at Plug

I'm having two new pieces performed at the Plug festival at the Royal Conservatoire of Scotland next week. The first is called Dr Mueller? Dr Mueller!? Oh, boy :( and is a postlude  to Spiricom, the third piece in Gordon McPherson’s 2007 trilogy Ghosts. The ‘spiricom’ was a psuedoscientific electronic device built by a couple of cranks in the 1980s, who convinced themselves that with it they could hear and talk to dead people including, supposedly, a certain ‘Dr Mueller’.

The piece is for clarinet and acoustic laptop: by which I mean a laptop with no additional amplification, transforming the sounds of the clarinet, to be played by Fraser Langton. This one is in Plug 1, the Monday lunchtime concert.

The second piece is on Wednesday evening: The Black Rain again involves laptop and live instruments, this time five players from the Scottish Ensemble through a SuperCollider patch, more on that one below.