Mixed reality assisted spatial programming of robotic systems
Published in USPTO, 2022
đź“Ś Overview
This patent, issued on May 17, 2022, covers a mixed reality (MR) system for programming robotic devices. A computer‑based tool selects an object, determines its spatial location (Cartesian and orientation coordinates), and executes tasks on the object via a robotic device. The tasks can be simulated in a mixed reality environment before deployment.
Why It Matters
Traditional robot programming approaches (code‑based, teaching pendants, vision systems, motion tracking) are expensive, time‑consuming, and require expert knowledge. This patent addresses the need for accessible robot programming that reduces dependence on specialists while improving reusability and scalability of robotic task teaching.
Core Innovations
- Spatial programming with MR: The system captures precise spatial coordinates and uses MR to visualize tasks in real-time during programming phases.
- Simulation of tasks: Initial parameters and task execution are simulated in a virtual environment before deployment to physical robots.
- User‑friendly programming: Users can teach robots complex skills without deep programming knowledge, relying on intuitive MR interfaces.
Core Value
This invention democratizes robot programming by making it accessible to non-specialists through mixed reality interfaces. It enables scalable teaching of skill sets to robotic devices while reducing implementation costs and development time for industrial automation applications.
Benefits & Applications
- Reduced expertise barrier: Eliminates need for specialized robot programming knowledge through intuitive MR interfaces.
- Enhanced reusability: Programmed tasks can be easily adapted and reused across different robotic systems and scenarios.
- Cost-effective deployment: Reduces time and resources needed for robot programming and reconfiguration.
- Simulation-first approach: Virtual testing reduces errors and improves safety before physical implementation.
🔍 TL;DP Summary
| Element | Description |
|---|---|
| Patent No. | US 11,331,803 B2 |
| Issue Date | May 17, 2022 |
| Inventors / Assignee | Bank, Singa, Chou, Wu, Rigano, Mayer / Siemens Corporation |
| Goal | Enable accessible robot programming through mixed reality interfaces |
| Mechanism | MR tool captures spatial coordinates, simulates tasks, executes via robotics |
| Key Innovation | Spatial programming with MR visualization and simulation-based validation |
| Outcome | Democratized robot programming with reduced complexity and increased scalability |
BibTeX Citation:
@misc {bank2022mixed, title= {Mixed reality assisted spatial programming of robotic systems} , author= {Bank, Hasan Sinan and Singa, Naresh Kumar and Chou, Chiajen and Wu, Xingang and Rigano, Giuseppe Francesco and Mayer, Stefan} , year= {2022} , month=may # "~17", publisher= {Google Patents} , note= {US Patent 11,331,803} }