documentation

"Missing ports" message in Cubase

A "Missing posts" error in Cubase means that the hardware (Apogee Ensemble) is offline or not being seen by the application. To fix this, go to the "Devices" menu and choose the last item, "Device Setup..". In the dialog box that appears choose "VST Audiobay" and make sure the device is set to "Ensemble" and not "Built-in audio".

If the Apogee Ensemble does not show up as a selection, close Cubase and power the Apogee Ensemble hardware on and off. Re-open Cubase and repeat the "Device Setup..." process above.

You may also need to remap the inputs and outputs by going to Devices/VST Connections. To remap the inputs, under the column Device Port, select Apogee Ensemble 1 and 2 for Mic inputs, and Apogee Ensemble 5 and 6 for QS8.1 inputs

Assignment #1, Due Monday February 9th

Begin looking for video sources, potential short clips (1-2 minutes) to use as a source video for your first sound and music setting.  This is the video clip you will be using for the next couple of weeks so choose something of interest to you, something you think you like and think you might enjoy working with.

Here are several samples (each around 1-2 minutes, sound removed) for those who would rather have the source video supplied (right-click image and choose "Download as..." or similar):

a) Video from class (MTV-style sound removed)

Excerpted from "Stop" by Eoin Duffy on blender.org, 2007 Suzanne Awards WINNER of "Best designed short film"

b) Slow moving animated blob

Excerpted from "Meischeid" by Matray on blender.org

c) HD video (1080p) with characters (may take a long time to dowload!!)

Excerpted from the "Orange Open Movie project", Elephant's Dream

If you have any trouble viewing this or any other video source, download and use VLC as your default video player.

1. Using recording techniques discussed in class in combination with sounds from sflib (the CEMC soundfile library) or freesound, compile a library of sounds appropriate to your chosen video source.  You may wish to check out a hand-held recorder to make environmental or other recordings.  The result should be a minimum of 50 sounds sorted in a meaningful way with directories and subdirectories (or "folders" and "subfolders").  I would encourage you to make "families" of related sounds or variations of a single sound.

Please hand in the resulting folder using the network drive, on the CEMC desktop as "coursework-->MUSIC_3421".   See this FAQ for other suggestions about naming.

Assignments

See semester assignments below.

Music 3421: Scoring the Moving Image

Scoring the moving image is a course in creating sound and music to enhance, accompany, and/or engage with images and movement.  While we will address many traditional multimedia forms throughout the semester (narrative film, documentary, television, music for the theater, music for dance) no single mode of expression will be our focus.  We will be exploring new ways of joining sound and image, of connecting or relating the visual and the aural.  The course is divided into to large sections, “Music for fixed Media” and “Music for live or dynamic media”.

Research at the Cornell Electroacoustic Music Center (CEMC)

There is an array of research projects at CEMC. Many come about as independent studies, others bridge connections across related disciplines (art and architecture, electrical and computer engineering, computer and information science, film and animation, and many more to come), in addition to projects directly in music composition and performance. Here are some highlights (this short list is by no means comprehensive):

CUMotive (2008) Wireless, Wearable Accelerometers: software and hardware research and independent study with electrical engineering major Nathan Ward. The resulting system used small-scale tri-axis accelerometers worn within the clothing to allow user interaction with music and gaming systems including a complete implementation of a dance tracking and music generating system. Nathan's work went on to the following honors:

Where's the BOOM? Award, 2008 BOOM (Bits On Our Mind) exhibition, February 27th 2008, 8th Annual New Interfaces for Musical Expression (NIME), poster session titled “Wearable Interfaces for Cyberphysical Musical Expression”, June 5-7 2008, Genova Italy

Cornell College Scholar project by Alex Krivicich, music for animation/design titled “Mr. Popcorn with original music by visiting artist Adam Matta. Alex's work, part of his College Scholar thesis, went on to the following honors:

Producer's Choice Award, 29th Annual College Television Awards (Mr. Popcorn)
National Finalist and Consideration, 2008 Student Academy Awards (Mr. Popcorn)
Best Animation, 2008 Ivy Film Festival (Mr. Popcorn)

Query by Humming (2007-8), software development project in connection with Google and faculty member Graeme Bailey with graduate student Spencer Topel and a team of undergraduate coders and project managers. The resulting design allows a user to search music databases by humming part of a tune. The audio search results are “displayed” in binaurally projected circle around the listeners head.

Low-latency Networked Audio Performance System (Summer 2006), software development project with CIS graduate student Kashif Javed in conjunction with CIS faculty member Paul Francis.

Multichannel Sound Distribution with Ambisonic/Ambiophonic and Binaural techniques, ongoing research area at CEMC on multichannel psychoacoustic sound distribution software and algorithms. Some notable work that has resulted:

Tetrahedral Ambisonic Array for Separatrix II (2006-7), C++ software “external” and audio installation in Tjaden Gallery, Cornell University with graduate composer David Weaver. David has a background in mathematics and so did the majority of the algorithmic design work himself with code ideas and help from myself and and student programmer, Christopher John, who was paired with him for the project.

Cornell BOOM research booth 2007 (“Sound Sculpture and Spatialization”), winner of the BOOM Sponsor Award from Credit Suisse. The project was also selected for the 2007 CIS Faculty Award but it was given to the second-place project because of rules about giving multiple prizes to the same project.

Vspace software for Macintosh OSX, an OSX-compatible implementation of software by Richard Furse (Faculty at York University, UK; primary developer of ambisonic software libraries and namesake of the 2nd-order Furse-Malham Higher Order Format (.fmt) for ambisonics). We provided resources for Dr. Furse, including a remote user account to develop the code on CEMC systems.

Performance patch for Resonant Sound Spaces by Jean-Claude Risset, 8-channel playback on 4-channel array, designed and implemented by Kevin Ernste

Some Recent Music using ambisonic techniques and ideas developed at CEMC:

Kevin Ernste, Crenshaw Stories (2007, revision in progress for 2009)
Christopher Stark, Augenblick for Wind Ensemble and live electronics (2008)
Christopher Stark, Drowning & Shoegazing for trombone, orchestra, and live electronics (2008)
Saul Appelbaum, Architectonic Silence; performance art sound/video piece; Master's Thesis in Architecture (2008)
Spencer Topel, As They Stood for multichannel tape (2007)
Kevin Ernste, Katafala for solo marimba, four percussion, and live electronics (2007)
Spencer Topel, Concerto for Wind Ensemble (2006)
David Weaver, Separatrix II sound installation (2006)
Spencer Topel, Gnomoncholia for solo violin and electronics (2006)

Software on CEMC Machintosh systems

Primary (found in system dock):

AC Toolbox
Audacity
Ardour
Csound
Cubase (and License Control Center)
Final Cut (or FC Express)
Finale
JackOSX (and QjackCtll)
JackTrip
Ableton Live!
Max/MSP
Melodyn (plugin)
PureData (Pd-extended)
Reason
Sibelius
Spear
SuperCollider

Secondary (found in Applications folder):

Cecilia
Ceres3
CLAM (QtSMStools, NetworkEditor, Prototyper, Annotator,Voice2MIDI)
Chuck and MiniAudicle
Common Music
JAMin
MIDIKeys
Praat
PVCX
sndtools (sndpeek, rt-pvc, rt-lpc)
SooperLooper
SoxWrap
Tapestrea

Plugins and externals:
This section is to be expanded

Additional (non-music):

Auqua Emacs
Firefox
ffmpegX
GIMP
Handbrake
MPEG Streamclip
iMovie
Inkscape
NeoOffice
Scribus
Smultron
Transmission
Cyberduck
VLC

System Utilities:

Perian (for extra video formats)
Growl
DoubleCommand
Flip4Mac (for wmv/wma format support)
Quicksilver
The Unarchiver (for Stuffits support)

Drivers required:

Apogee Drivers
RME Fireface drivers
M-Audio drivers

PD interfaces lecture

The following examples were discussed with respect to building simple graphical interfaces for your class pieces.

In addition to those discussed, I have included the patch to my recent guitar piece, "Roses Don't Need Perfume" including all sounds.  You should be able to simply open it and start advancing through events.

The only patch found below that is not mine is called "mondrian.pd" for which documentation can be found here:

https://puredata.info/Members/AlbertoZ/Mondrian

Class patches and examples

Below are patches and examples from class.

How to mount the network drive in the studios

If you come into the studio and the network drive is not on the desktop:

In the finder, go to the "Go" menu and select "Connect to server" (shortcut: command-K).

The network drive address (132.236.216.245) should be in the window that pops up as the default, so click "connect".

Likewise the username "studiouser" and the password should be in the next window as the default, so, once again, click "connect".

Choose the "coursework" and/or "user_temp" partitions. These will mount and appear on the Desktop, ready to use.