This is the product of a few weeks trying to get jitter, openGL, and Ableton Live all to play nice together. Along the way I ran into plenty of pitfalls, mostly concerning performance optimization and quarantining all of the visual processing to my graphics card.
Basically there are three different visual generators active in this performance. The main cube structure with a video texture. The background cube texture which is generating the visuals based on incoming audio, and the geometric structure that bounces and twists according to amplitude detection.
I am triggering clips, controlling audio processing, and parameters of the visuals all in real time.