After ChatGPT was given access to object-detection and object-distance data via application interfaces, the Microsoft researchers investigated its ability to generate code, mostly in Python, for robotics scenarios such as zero-shot planning and code generation.