At a guess - something like IDA Pro to disassemble and debug, something like a directx profiler to get a view of what's going on in there.

And a lot of blood, sweat and tears twisting your brain around what's going on!