In order to show a client how they might integrate a concept I have seen implemented years ago I quickly built this prototype with the help of the Unity 3D comunity and Joshua Fernandes. Unfortunately the video is a bit grainy and jittery but I hope the effect comes across...
What did I learn from this test?
1. The kinect gets confused when it tries to track you while you are sitting in a chair with a high backrest
2. Holding a camera in front of your face can give the kinect issues
3. Visual cues (Objects / lines that extend in Z direction) are important to get the 3D effect across better
4. A better video camera might help