Overview
ARM Institute's (Advanced Robotics for Manufacturing) learning centre includes an immersive multimodal MR robot‑annotation application, VR end‑effector selection game and an AI chatbot.
My Role
This project was the result of a 2-semester capstone at the Carnegie Mellon University Masters of HCI programme. I as a student took the role of Lead XR developer and the expert on XR and game design in the team.
The Mixed Reality robot-annotation application shows a virtual robot workcell in Mixed Reality. The users can pick up and read (or listen!) about different components of the workcell like the teach pendant, the camera and the gripper. The application also has an "admin" mode where the ARM institute employees can pick a spot to place the robot so that they can arrange their physical exhibit around the virtual workcell.
The VR factory problem-solving game is a VR video game prototype where the player has to look at whats going on in the chocolate-making process in a factory, and then fix it by putting the end-effectors in the right order.
The AI chatbot is fine tuned to answer questions about automation in manufacturing. Small-to-medium manufacturers can ask specific questions about their specific problems, and get relevant answers about their problems.
This was done as a part of the capstone project at the Carnegie Mellon Institute School of Computer Science's Master of Human Computer Interaction degree. This capstone project was made for our client Advanced Robotics for Manufacturing Institute or ARM.
Creative Technologist and XR Expert:
Aarnav Sangekar
Developer:
Tassy Chen
Designers:
Esha Garg
Jackie Strawbridge
Victor Wang
Aarnav Sangekar 2025