criteria = respond(stimulus / arrange(time));
beauty = produce(inspiration * criteria);
Summer/Fall 2008: As part the Allosphere research group at UCSB, I managed a development project working toward a new paradigm for multimodal human-computer interaction. The “Dii” (Digital Information Interactor) project consisted of an ubiquitous device server combined with a prototypical “shared interaction space” in which users’ avatars could control a scientific simulation, implement new code rules, introduce new media, or inform other users’ actions. In addition to project management, I worked on implementation of nonstandard device input and control structures, using VRPN and CV libraries; I also contributed to gesture tracking and overall control algorithms. My code was in C++ on a Linux platform.
For more info, please see the whitepaper or browse the source code.
Winter 2008: I worked with internationally recognized artist Marie Sester on her project BE[AM], a gallery installation examining the roles that violent video games and films play in contemporary culture. As part of a reworking of her existing gallery piece, I developed a streamlined, user-friendly interface for the technicians who will need to tweak the artwork’s control system in response to environmental and other site-specific factors. I also wrote clear, competent documentation for this project. For more on the project, see http://www.sester.net/projects/beam/beam.html
2005-2007: I was part of a NSF-funded research team at UCSB that created a novel instrument for human-computer interaction: The Multimodal Music Stand (MMMS). This project combined various sensing techniques (microphone, camera tracking, electronic field sensing, etc.) with a physical microprocessor instrument and computerized sound synthesis system. I managed the project and built the camera and sound sensing modules, writing custom objects in C++ for the Max/MSP/Jitter environment. For a more detailed description of the project, please see the NIME Whitepaper.
CONTROL INTERFACE SCREENSHOTS:
BE[AM] user interface
MMMS user interface