One of the worlds largest tv productions was this year produced in Denmark, the largest tv production ever to be made here. I was early in the process invited in to inspire the producers with whats possible with interactive technology nowadays, and ended up getting a task for one of the interval acts (the opening of 2. semi-final). The task was to live track 3 boxes on stage, and digitally render a 3D box ontop of the boxes on stage, and make it as if there where people standing inside the boxes.
Together with Obscura who supplied me with the equipment, created I an openFrameworks application that based on OpenCV's calibration tracking could track the boxes live on the SDI signal. The content was then composed in Millumin and output back to the OB-van over SDI.
But after first rehearsal on stage, we decided to record the next rehearsal, and just use that during the show in the end. There was no real reason to do it live, when we could tape it, and by that minimizing the risk.
Big thanks to Kyle McDonald for all of the code we used.
Watch the video from the showVideo: