This is a quick sneek preview of part of my installation thats going to be on exhibit for six months at the Dallas Museum of Art starting in June.
In a nutshell this is a Max patch that will generate/manipulate audio in a number of different methods (samping/synthesis) from various diff. inputs (planned: custom monome, 3D capacitive sensor, custom iPhone/iPod Touch application) and simultaneously control parameters within a custom piece I built in Unity3D. Even though right now im just actually clicking and dragging some tied in knobs but in the near future i will have all 3 diff controllers going…..performance is def. going to be a concern in this.
Will need to trim fat where possible…streamline…
Communication is done through UDP.
Thanks to friends on the Unity Forum for help. Especially Bierre Jacobsen!
I have just barely scratched the surface here with what I want to accomplish with this.
So Im planning on using the Monome to control on/off of different textures in Unity and another row of buttons for different geometry, another for lighting and so on.
and the wii mote will mainly be for tweaking controllers in Max. And i want to build a custom iPhone app to be yet another controller within my environment perhaps color….

This is a quick status update video on my project for the Dallas museum of art.
Major breakthrough is communication with iPhone through mrmr software. In this vid its only tied to a tiny portion of the audio.