Then we built up a demo of a project John Levee suggested: the playback of a remote location using an array of mics. This involved showing how to set up sample, and then live-streaming, playback as well as how to localize each 'mic source' in the scene.

Links

• using the LOCALIZE() RTcmix instrument -- a text-based tutorial on how to set up and use LOCALIZE()
  
  
• LOCALIZE() video tutorial -- this has a bit more info then the text-based tutorial above, including an explanation of how the audio ray-tracing works
  
  
• the RTcmix documentation for LOCALIZE() -- explanation of all the parameters
  
  NOTE: There are many other extant approaches to sound localization -- ambisonics, binaural encoding, the built-in Unity system, IRCAM's 'spat', etc. You can google them and find lots of documentation on how they are used.

Class Downloads

• g6611-spring2021-week5-maxpatches.zip -- the very basic maxpatch for the MIX() instrument to playback sound samples
  
  
• g6611-spring2021-week5-pd-patches.zip -- the pd version
  
  
• g6611-spring2021-week5-RTcmix_scripts.zip -- the RTcmix text scores from those patches (for use in RTcmixShell or 'standalone' RTcmix)
  
  
• sfsrc.zip -- the "sfsrc/" folder with the 'whidbey-institute1.wav' and 'harpoon3.wav' soundfiles used in the Unity projects below (these are already included in each project, but you will need them to run the max and pd patches above)
  
  
• getMyTransform.cs -- this is the script file that needs to be added to the Main Camera to calcualte the LOCALIZE() source position
  
  
• g6611-spring2021-week5-Unity-trigger-distance.zip -- two Unity scenes showing how to remotely call functions from a Game Object script (component), using a trigger, and how to measure distance between two Game Objects
  
  
• g6611-spring2021-week5-Unity-1mic_only.zip -- Unity project showing basic playback of one channel of a soundfile
  
  
• g6611-spring2021-week5-Unity-1mic_localize.zip -- apply localization to the source (Game Object) of one channel of a soundfile
  
  
• g6611-spring2021-week5-Unity-rt_localize.zip -- apply localization to a real-time input being played through a Game Object source
  
  
• g6611-spring2021-week5-Unity-2mics_localize.zip -- apply localization to two separate sound sources (stereo) (note: we did not do this one in class)
  
  
• g6611-spring2021-week5-Unity-4mics_localize.zip -- apply localization to four sound sources in an array. Two of them play the "whidbey-institute1.wav" soundfile (left/right channels, 0/1) and two play another field-recorded soundfile ("harpoon3.wav"), left/right channels, 0/1. (note: we did not do this one in class)