Silicon Studio Corporation, a company developing digital content related businesses for a variety of industries including the entertainment industry, automotive, video, and architecture, is pleased to announce that it has developed and provided a life-size virtual space using 3D digital twin technology powered by NVIDIA Omniverse as a simulation environment for a research project on the development of collaborative robots being conducted by the National University Corporation, University of Tsukuba.
The virtual space we developed enables advance simulations by reflecting various sensor data attached to robots and rooms in the real world, as well as motion capture data of the robot’s movements, on a 3D model on the simulator. It is being used to test the movements of a collaborative robot developed in a research project at the University of Tsukuba.
We have also developed and implemented our own extensions (plugins for expanding functionality) in Python scripts to access data on the cloud and import it into Omniverse. We have also built a mechanism to notify outside Omniverse of collision results between the robot and other objects that occur in the virtual space through ROS.
Also Read: Hitachi and Sumitomo Chemical Test AI-Based System to Optimize Energy Consumption in Production
The virtual space includes the University of Tsukuba’s research buildings, as well as the surrounding area including sidewalks, disabled parking spaces and roadways, as well as the entrance and elevators inside the center, several rooms and corridors.
The 3D model was created based on point cloud data captured by a high-precision laser scanner and photogrammetry captured by a single-lens reflex camera. Our technical artists (TAs) referred to on-site photos and performed tasks such as correcting inaccurate shapes, supplementing unmeasured areas such as exterior walls hidden by trees, and adjusting the transmittance of glass. Some 3D models, such as lighting, air conditioners, furniture, and home appliances, were combined and finished using existing data. In addition, the 3D models created were placed on Omniverse and displayed on an HMD (head-mounted display), making it possible to open and close doors and operate elevator buttons.
SOURCE: PRTimes
