Difference between revisions of "Omniverse"

From UFRC
Jump to navigation Jump to search
Line 43: Line 43:
 
NVIDIA Omniverse Isaac Sim is a robotics simulation toolkit for the NVIDIA Omniverse platform. Isaac Sim has essential features for building virtual robotic worlds and experiments. It provides researchers and practitioners with the tools and workflows they need to create robust, physically accurate simulations and synthetic datasets. Isaac Sim supports navigation and manipulation applications through ROS/ROS2. It simulates sensor data from sensors such as RGB-D, Lidar, and IMU for various computer vision techniques such as domain randomization, ground-truth labeling, segmentation, and bounding boxes.
 
NVIDIA Omniverse Isaac Sim is a robotics simulation toolkit for the NVIDIA Omniverse platform. Isaac Sim has essential features for building virtual robotic worlds and experiments. It provides researchers and practitioners with the tools and workflows they need to create robust, physically accurate simulations and synthetic datasets. Isaac Sim supports navigation and manipulation applications through ROS/ROS2. It simulates sensor data from sensors such as RGB-D, Lidar, and IMU for various computer vision techniques such as domain randomization, ground-truth labeling, segmentation, and bounding boxes.
  
==Steps on installing NVIDIA Omniverse launcher and Issac-Sim==
+
==Steps to install the NVIDIA Omniverse launcher and Omniverse Applications==
  
1. navigate to the HiPerGator OpenOnDemand[ood.rc.ufl.edu] webpage. Request a Hipergator Desktop on a '''hwgui''' node with a RTX6000 GPU [https://user-images.githubusercontent.com/6526592/232131919-33cfeeda-dcd4-40bc-a943-2e128cee6c19.png].
+
1. Navigate to the HiPerGator OpenOnDemand[ood.rc.ufl.edu] webpage. Request a HiPerGator Desktop on a '''hwgui''' node with a RTX6000 GPU [https://user-images.githubusercontent.com/6526592/232131919-33cfeeda-dcd4-40bc-a943-2e128cee6c19.png].
  
 
2. Once you enter the HiPerGator Desktop, download the free standard omniverse launcher from  https://www.nvidia.com/en-us/omniverse/download/. You may need to register to download the Omniverse launcher.
 
2. Once you enter the HiPerGator Desktop, download the free standard omniverse launcher from  https://www.nvidia.com/en-us/omniverse/download/. You may need to register to download the Omniverse launcher.
  
3. open a terminal and make the downloaded file executable:  <code>chmod +x omniverse-launcher-linux.AppImage</code>. run the Omniverse launcher AppImage file:  
+
3. Open a terminal and make the downloaded file executable:  <code>chmod +x omniverse-launcher-linux.AppImage</code>, or alternatively open the file properties and check "Allow this file to run as a program" in the permissions tab. Run the Omniverse launcher AppImage file from a terminal window with:  
 
<code>./omniverse-launcher-linux.AppImage </code>  
 
<code>./omniverse-launcher-linux.AppImage </code>  
  
4. The first time you logon Omniverse Launcher, you will be asked to signup and login. Just follow the instructions to create an NVIDIA developer account and login.
+
4. The first time you log into the Omniverse Launcher, you will be asked to sign up and login. Just follow the instructions to create an NVIDIA developer account and login.
  
5. Once you have login the Omniverse launcher, you can see the Omniverse launcher interface, click the top right user-setting and change the '''library path data path''', and '''content path''' to your blue storage [https://user-images.githubusercontent.com/6526592/232133185-d88c4fe0-0ee3-4083-aa13-8bd273ee9328.png]. Please do this before installing any applications, otherwise the default installation path is in '''$HOME''' with limit of 40GB, which will be full immediately.  
+
5. When you first load up the Omniverse launcher, it will ask you to select the library path, data path, content path, and cache locations. Ensure that these point to directories you create in your Blue storage. If they are left at default, the 40 gigabytes on your login node will almost immediately fill up. If you need to change these file paths later, the library, data, and content paths can be changed by clicking on the user settings in the top right [https://user-images.githubusercontent.com/6526592/232133185-d88c4fe0-0ee3-4083-aa13-8bd273ee9328.png]. These paths, including the cache location, can be changed through the omniverse.toml file located in /home/your-username/.nvidia-omniverse/config/
  
6. In the Exchange tab, select your applications (e.g. Issac Sim) to install them. It may takes some time for the downloading and installation. Once the application is installed, you may find it in the "LIBRARY" tab
+
6. In the Exchange tab, search and select any applications (e.g. Issac Sim) you wish to install. It may take some time to download and install them. Once the application is installed, you may find it in the "Library" tab
  
7. Start the Application: From the LIBRARY tab, you can click the launch button to start your application [https://user-images.githubusercontent.com/6526592/232134367-cf930dc2-7c65-4991-9e20-3f4a719e3373.png].  
+
7. In order to start an application, select it in the Library tab and click the launch button [https://user-images.githubusercontent.com/6526592/232134367-cf930dc2-7c65-4991-9e20-3f4a719e3373.png].  
  
8. You can explore more on Isaac Sim App in this page [https://docs.omniverse.nvidia.com/app_isaacsim/app_isaacsim/install_workstation.html#isaac-sim-app-install-workstation].
+
8. You can explore more about installing Isaac Sim at this page [https://docs.omniverse.nvidia.com/app_isaacsim/app_isaacsim/install_workstation.html#isaac-sim-app-install-workstation].
  
 
==Omniverse Connectors==
 
==Omniverse Connectors==

Revision as of 13:54, 29 May 2024

Description

omniverse website  


NVIDIA Omniverse is a platform for creating and operating metaverse applications. Omniverse is a real-time 3D graphics collaboration platform created by Nvidia. It has been used for applications in the visual effects and "digital twin" industrial simulation industries. Omniverse makes extensive use of the Universal Scene Description (USD) format. The support for running Omniverse on HiPerGator is limited to certain applications.

Learn more about Omniverse: 1. NVIDIA OnDemand Videos[1] 2. NVIDIA Omniverse Youtube Channel [2]


Omniverse Launcher [3]

The NVIDIA Omniverse™ Launcher is your first step into the Omniverse. Giving you immediate access to all the apps, connectors and other downloads the Omniverse Launcher is your gateway to the Omniverse. With an intuitive Interface, Launcher allows a quick experience for opening and updating Omniverse Apps and Connectors.

Omniverse Applications

  • Omniverse USD Composer (Create) [4]:

NVIDIA Omniverse USD Composer (Formerly Omniverse Create) is an Omniverse app for world-building that allows users to assemble, light, simulate and render large scale scenes. It is built using NVIDIA Omniverse™ Kit. The Scene Description and in-memory model is based on Pixar’s USD. Omniverse USD Composer takes advantage of the advanced workflows of USD like Layers, Variants, Instancing and much more.


  • Omniverse USD Presenter (View) [5]:

NVIDIA Omniverse USD Presenter is a simple, powerful reference application for interactive viewing and annotating of 3D design projects in stunning, physically-accurate photorealism.

  • Omniverse Isaac Sim [6]:

NVIDIA Omniverse Isaac Sim is a robotics simulation toolkit for the NVIDIA Omniverse platform. Isaac Sim has essential features for building virtual robotic worlds and experiments. It provides researchers and practitioners with the tools and workflows they need to create robust, physically accurate simulations and synthetic datasets. Isaac Sim supports navigation and manipulation applications through ROS/ROS2. It simulates sensor data from sensors such as RGB-D, Lidar, and IMU for various computer vision techniques such as domain randomization, ground-truth labeling, segmentation, and bounding boxes.

Steps to install the NVIDIA Omniverse launcher and Omniverse Applications

1. Navigate to the HiPerGator OpenOnDemand[ood.rc.ufl.edu] webpage. Request a HiPerGator Desktop on a hwgui node with a RTX6000 GPU [7].

2. Once you enter the HiPerGator Desktop, download the free standard omniverse launcher from https://www.nvidia.com/en-us/omniverse/download/. You may need to register to download the Omniverse launcher.

3. Open a terminal and make the downloaded file executable: chmod +x omniverse-launcher-linux.AppImage, or alternatively open the file properties and check "Allow this file to run as a program" in the permissions tab. Run the Omniverse launcher AppImage file from a terminal window with: ./omniverse-launcher-linux.AppImage

4. The first time you log into the Omniverse Launcher, you will be asked to sign up and login. Just follow the instructions to create an NVIDIA developer account and login.

5. When you first load up the Omniverse launcher, it will ask you to select the library path, data path, content path, and cache locations. Ensure that these point to directories you create in your Blue storage. If they are left at default, the 40 gigabytes on your login node will almost immediately fill up. If you need to change these file paths later, the library, data, and content paths can be changed by clicking on the user settings in the top right [8]. These paths, including the cache location, can be changed through the omniverse.toml file located in /home/your-username/.nvidia-omniverse/config/

6. In the Exchange tab, search and select any applications (e.g. Issac Sim) you wish to install. It may take some time to download and install them. Once the application is installed, you may find it in the "Library" tab

7. In order to start an application, select it in the Library tab and click the launch button [9].

8. You can explore more about installing Isaac Sim at this page [10].

Omniverse Connectors

  • Omniverse Connect: Omniverse Connect allows you to use your favorite apps as first class content delivery tools for the Omniverse Platform. With tools like Revit, Rhino, Maya, Unreal Engine, and more these already powerful tools become super charged with all the potential of Omniverse. Realtime Collaboration, Path Traced Side by Side Rendering, Nucleus Snapshots, and USD Translation are just a few of the immediate benefits of working with Omniverse Connectors.

Here is a list of Applications with Omniverse Connectors support [11]. Remember that UFRC is not responsible for purchasing commercial license for the applications that is connected to Omniverse.

On HiPerGator, currently the support for applications with Omniverse Connectors is limited.