NASA Controls Robot Using Kinect 2 And Occulus Rift

Watch NASA control this robotic arm with an Occulus Rift and the Kinect 2. Using the new Xbox One Kinect sensor, we are able to manipulate the JACO robot arm in real time. By combining position tracking from the Kinect and rotational tracking with the Oculus, we provide a first-person view for the operator. Future work will include integrating sensor array data into the scene and translating our research to the Robonaut 2 humanoid on the International Space Station.