The possibilities are endless..... shame it will only work with a fully licensed version (im not even sure how much it costs iv seen numbers between $2,000 per year and $750,000 for a lifetime) and not the free UDK... :(
Welcome one and all to my blog.... Du-dah.
Thanks to everybody for viewing, Hopefully there will be something of interest for you on this page... and if not then tough.
What is this blog about?
Mainly this blog is a place for me to show off some of the research that i am currently undertaking [partly for my self and partly for my masters degree in sound and music for video games], and hopefully to instigate thought and conversations about the given subject area.
I will be posting links, videos, "proper" articles and also general ramblings in response to my research. This blog will mainly focus around a few key areas, namely Video game audio, Procedural audio and Generative audio systems. Don't worry if you are not 100% clear on what these areas constitute (and there is a lot of overlap within these areas) then you are not alone| For I am no expert, I am a student and throughout the next 6 months (and onwards|) I will be documenting my learning process, hopefully providing myself and any readers of this blog with a greater understanding of (what I have badly dubbed) "Clever" audio systems, what they are, how they work and how can they be applied to real life situation.
But what do I mean by "Clever" audio systems?
This is a tough question, and one that will not be fully answered in this first blog post, but hopefully and understanding will take place over time. Initially, lets discus regular linear music, such as you might find on any radio station across the world. In linear music there is a beginning, a middle and an end and each time you hear that piece of music it will sound exactly the same. What happens when creating a piece of music in this fashion is that the composer (or composers) create and specify every single note, rhythm, instrument etc. etc. The composer has almost total control over what is heard on the recording (a small amount of control being handed over to the performers and producers and all the other people who are involved with the making of a record or performing a piece). This is a perfectly fine way of making music, and has been accepted within society for hundreds if not thousands of years, so nothing mind blowing there.
Now in comparison lets look at John Cage, one of the most influential american composers of the 20th century. In 1951 John Cage began to incorporate chance into his composed pieces, he used the "I Ching" a Chinese text which describes a symbol system to identify order in chance events. Cage would use the I Ching to make compositional decisions for him, this would in turn dramatically diminish Cage's control over what the piece actually sounds like. Other ways in which Cage gave up control was by using input that was specific to the "then and there". For example "Imaginary Landscape No. 4" for 12 radios, composed in 1951, uses radios to pick up frequencies that are being played over the airwaves at the time of the concert, therefor every time this piece was played different audio content will be heard. This piece also uses chance, as the radio content is dependant on a vast number of variables, such as, location, time of day, time of year.... the list goes on and on. Using chance in this way can be seen by some as reducing the importance of the composer, but i disagree. The role of the composer is shifted, no longer focusing on the minute details of every single note, but now allowing composers to focus on larger aesthetic concepts, such as, what variables to leave to chance, what are the range of outcomes, what type of chance systems to incorporate? This allows the composer to point the music in a direction, but gives it a certain "free will" of its own. What Cage is doing is imposing rules on pure chance, and it is in the making of these rules that his true compositional skill is shown.
So seriously what do i mean by "Clever" audio system?
Rules. Rules. Rules.
So i shall give you an example of a musical rule, when a G4 is played then a F4 will follow, but if a GSharp4 happens then a B4 will follow. This is a very simple rule and is in fact too specific to be of any great use in an audio system. Where as a more useful rule could be, if the last two notes have each been of a higher pitch than the note before then the next note will be lower in pitch than the note before.
If n1(pitch) > n0(pitch) and n2(pitch) > n1(pitch) then n3(pitch) must be < n2(pitch)
These types of rules or processes can be embedded within music (alongside elements of chance, user interaction or a pieces initial state) to form large scale pieces of work from a few basic rules. These rules could be used in an analogue sense of actually writing notes on a score (like Cage) or they could be embedded into a musical system which is created using computers. It is worth taking note that this type of generated systems can also be used within the visual worlds of art and graphics.
I suggest taking a look at the youtube video below to give you a greater idea of the types of systems that I am talking about. The video is taken from a larger video in which Brian Eno (one of the most respected contemporary composers and a great advocate of generated music systems) and Will Write (Respected games designer having worked on games such as Spore, and the Sims, which both involve highly elaborate rule based systems) discuss generative-rule based systems within games, music and graphics.
Within this video Brian Eno coins my favourite phrase too describe generative music systems "We are making seeds not forests" and this truly describes what it is like to create generative music system, and gives an indication to what I truly mean my "Clever" audio systems. My definition of a "Clever" audio system is, a system (computer based or analogue based) that can take an input that is either randomly generated or user defined and it will then make decisions (based around rules set out by the composer) about that input and create some sort of output, this output can then be fed back into the system and the whole process can begin again. Systems can take on an almost indefinite amount of forms, and the decisions can be vast and ranging. It is the composers task to fit the system with rules and results that he/she finds aesthetically pleasing even though the order and the manner in which they are used is mostly left up to the system. This means that the composer can sit back and listen to his work and still be surprised and intrigued by what he/she hears, as the system is able "explore" the vast amount of musical content that the composer has made achievable using a relatively small number of rules.
A moment for Procedural audio...
Most of the above is focusing on the area of generative systems for the sole purpose of music. But "Clever" audio systems can also be implemented within video games (as well as any other number of interactive applications). Procedural audio is very similar to generative music, it involves "live" synthesis/generation of audio and music within an interactive application or game, and also involves a lot of rules and takes into account user interaction. "Procedural audiois non-linear, often synthetic sound, created in real time according to a set of programmatic rules and live input." - Andy Farnell, An introduction to procedural audio and its application in computer games, 2007. Within video games procedural audio can use the real world rules of physics to create more realistic and authentic audio fields, with the aim of creating a more immersive game environment. For example the reverb of a virtual room could be worked out in real time taking into account the room, size, shape, wall texture, player position to the walls etc. etc. Procedural audio technique could be used in place of using a pre-set reverb of a similar real world room, which normally is not very effective and wont change depending on player position to the walls.
One very exciting combination of Procedural Audio and Generative systems is DJRJ - and application for the iPhone. It uses a mic feed from the world around you and generates music based on what it heard. DJRJ also encouraged the user to interact with it by making noise, shaking the iPhone, and touching the screen. Check out the video below if you are interested.... For me DJRJ is actually making me want to shell out for an iPhone ..... When does my contract run out i wonder?