Controlling Robot Swarms with Augmented Reality

Engineers at NYU have built an AR app to operate robots in the real world


While robots are getting increasingly more capable and autonomous, they may still require our help to carry out tasks in real-world environments. That’s why robotics researchers continue to look for new ways to allow human operators to control robots without extensive training.

At New York University, Jared Alan Frank has turned to augmented reality (AR) to develop a robot control interface that runs on a conventional smartphone or tablet. The system uses the device’s camera to capture details from a scene and overlay virtual objects, as other AR applications do. 

(See more...)