Omniverse: Difference between revisions

From UFRC
Jump to navigation Jump to search
No edit summary
Rwhandel (talk | contribs)
Updated to reflect how Omniverse is currently distributed
 
(16 intermediate revisions by 2 users not shown)
Line 1: Line 1:
[[Category:Software]][[Category:Library]][[Category:Math]]
[[Category:Software]][[Category:Library]][[Category:Math]]
{|<!--CONFIGURATION: REQUIRED-->
{|<!--CONFIGURATION: REQUIRED-->
|{{#vardefine:app|omniverse}}
|{{#vardefine:app|Omniverse}}
|{{#vardefine:url|https://www.nvidia.com/en-us/omniverse/}}
|{{#vardefine:url|https://www.nvidia.com/en-us/omniverse/}}
<!--CONFIGURATION: OPTIONAL (|1}} means it's ON)-->
<!--CONFIGURATION: OPTIONAL (|1}} means it's ON)-->
Line 18: Line 18:
{{App_Description|app={{#var:app}}|url={{#var:url}}|name={{#var:app}}}}|}}
{{App_Description|app={{#var:app}}|url={{#var:url}}|name={{#var:app}}}}|}}


Omniverse is a real-time 3D graphics collaboration platform created by Nvidia. It has been used for applications in the visual effects and "digital twin" industrial simulation industries. Omniverse makes extensive use of the Universal Scene Description (USD) format.
NVIDIA Omniverse is a platform for creating and operating metaverse applications. It is a platform of APIs, SDKs, and services that enable developers to integrate OpenUSD, NVIDIA RTX™ rendering technologies, and generative physical AI into existing software tools and simulation workflows for industrial and robotic use cases. It has been used for applications in the visual effects and animation as well. Omniverse makes extensive use of the Universal Scene Description (USD) format, which should generally be the primary focus of those wishing to leverage the technology. Omniverse apps are all built upon the Omniverse Kit SDK, a highly modular application system that makes custom development a breeze.
The support for running Omniverse on HiPerGator is limited to certain applications.  
The support for running Omniverse on HiPerGator is limited to certain applications.  


Learn more about Omniverse:
1. NVIDIA Omniverse Docs[https://docs.nvidia.com/omniverse/index.html]
2. NVIDIA Omniverse Developer Overview[https://developer.nvidia.com/omniverse]
3. NVIDIA Omniverse Youtube Channel [https://www.youtube.com/@NVIDIAOmniverse]
<!--Modules-->
<!--Modules-->


==Omniverse Launcher [https://docs.omniverse.nvidia.com/prod_launcher/prod_launcher/overview.html]==
==Omniverse Launcher [https://docs.omniverse.nvidia.com/prod_launcher/prod_launcher/overview.html]==
The NVIDIA Omniverse™ Launcher is your first step into the Omniverse. Giving you immediate access to all the apps, connectors and other downloads the Omniverse Launcher is your gateway to the Omniverse. With an intuitive Interface, Launcher allows a quick experience for opening and updating Omniverse Apps and Connectors.
The NVIDIA Omniverse™ Launcher is your first step into the Omniverse. Giving you immediate access to all the apps, connectors and other downloads the Omniverse Launcher is your gateway to the Omniverse. With an intuitive Interface, Launcher allows a quick experience for opening and updating Omniverse Apps and Connectors.
This module has been deprecated, and will cease online function in October 2025. It is not recommended to use.


==Omniverse Applications==
==Omniverse Applications==


*'''Omniverse USD Composer [https://docs.omniverse.nvidia.com/app_composer/app_composer/overview.html]''':
Omniverse applications are built using Omniverse Kit, a versatile SDK with an emphasis on modularity. Kit apps are given functionality through the use of extensions that developers can mix and match or build themselves. Nvidia supplies a number of core extensions that can be used to kickstart development, such as the omni.ui extension for easily building UI systems.
NVIDIA Omniverse™ USD Composer is an Omniverse app for world-building that allows users to assemble, light, simulate and render large scale scenes. It is built using NVIDIA Omniverse™ Kit. The Scene Description and in-memory model is based on Pixar’s USD. Omniverse USD Composer takes advantage of the advanced workflows of USD like Layers, Variants, Instancing and much more.


*'''Omniverse USD Composer [https://docs.omniverse.nvidia.com/app_composer/app_composer/overview.html]''':
Nvidia built a number of example applications using the suite of extensions for Kit they developed. Some, like Isaac Sim, are distributed by Nvidia directly, while others are considered "templates" that are accessible from the kit-app-template repository.  
NVIDIA Omniverse™ USD Composer is an Omniverse app for world-building that allows users to assemble, light, simulate and render large scale scenes. It is built using NVIDIA Omniverse™ Kit. The Scene Description and in-memory model is based on Pixar’s USD. Omniverse USD Composer takes advantage of the advanced workflows of USD like Layers, Variants, Instancing and much more.


==Omniverse Connectors==
*'''Omniverse Isaac Sim [https://docs.isaacsim.omniverse.nvidia.com/latest/index.html]''':
NVIDIA Omniverse Isaac Sim is a robotics simulation toolkit for the NVIDIA Omniverse platform. Isaac Sim has essential features for building virtual robotic worlds and experiments. It provides researchers and practitioners with the tools and workflows they need to create robust, physically accurate simulations and synthetic datasets. Isaac Sim supports navigation and manipulation applications through ROS/ROS2. It simulates sensor data from sensors such as RGB-D, Lidar, and IMU for various computer vision techniques such as domain randomization, ground-truth labeling, segmentation, and bounding boxes.


*'''Omniverse Connect''': Omniverse Connect allows you to use your favorite apps as first class content delivery tools for the Omniverse Platform. With tools like Revit, Rhino, Maya, Unreal Engine, and more these already powerful tools become super charged with all the potential of Omniverse. Realtime Collaboration, Path Traced Side by Side Rendering, Nucleus Snapshots, and USD Translation are just a few of the immediate benefits of working with Omniverse Connectors.
*'''USD Composer, Explorer, Presenter [https://github.com/NVIDIA-Omniverse/kit-app-template]''':
Here is a list of Applications with Omniverse Connectors support [https://docs.omniverse.nvidia.com/con_connect/con_connect/connecting-to-omniverse.html]. Remember that UFRC is not responsible for purchasing commercial license for the applications that is connected to Omniverse.  
The USD Composer, Explorer, and Presenter apps are now template apps available through the kit-app-template development repo. They are relatively simple Kit apps that are designed to be built upon and customized to the needs of the user which provide an interface to interact with 3D USD environments. Once the templates are installed, users can access the .kit files associated with them to add and remove extensions and define each app's functionality.


On HiPerGator, currently the support for applications with Omniverse Connectors is limited.
==Steps to install the NVIDIA Omniverse Launcher and Omniverse Applications *DEPRECATED*==


==Steps on installing NVIDIA Omniverse platform and running Issac-Sim==
'''It is no longer recommended to install the launcher. Instead, you may utilize the template apps in the kit-app-template[https://github.com/NVIDIA-Omniverse/kit-app-template], install a program like Isaac Sim directly[https://docs.isaacsim.omniverse.nvidia.com/latest/index.html], or use any Omniverse Tools available in the Nvidia Catalog[https://catalog.ngc.nvidia.com/].'''


1. navigate to the HiPerGator OpenOnDemand[ood.rc.ufl.edu] webpage. Request a Hipergator Desktop on a '''hwgui''' node with a RTX6000 GPU [https://user-images.githubusercontent.com/6526592/232131919-33cfeeda-dcd4-40bc-a943-2e128cee6c19.png].
<div class="toccolours mw-collapsible mw-collapsed">
'''Legacy Instructions'''
<div class="mw-collapsible-content">
1. Navigate to the HiPerGator OpenOnDemand[ood.rc.ufl.edu] webpage. Request a HiPerGator Desktop on a '''hwgui''' node with a RTX6000 GPU [https://user-images.githubusercontent.com/6526592/232131919-33cfeeda-dcd4-40bc-a943-2e128cee6c19.png].


2. Once you enter the HiPerGator Desktop, download the free standard omniverse launcher from  https://www.nvidia.com/en-us/omniverse/download/. You may need to register to download the Omniverse launcher.
2. Once you enter the HiPerGator Desktop, download the free standard omniverse launcher from  https://www.nvidia.com/en-us/omniverse/download/. You may need to register to download the Omniverse launcher.


3. open a terminal and make the downloaded file executable: <code>chmod +x omniverse-launcher-linux.AppImage</code>. run the Omniverse launcher AppImage file:  
3. Open a terminal and make the downloaded file executable:  
<code>./omniverse-launcher-linux.AppImage </code>  
<br>&emsp;<code>chmod +x omniverse-launcher-linux.AppImage</code>
<br>or alternatively open the file properties and check "Allow this file to run as a program" in the permissions tab.
<br>NOTE: It is advised to run the launcher from the terminal as at the time of writing, launched apps will crash unless you run the line
<br>&emsp;<code>export MESA_GL_VERSION_OVERRIDE=4.6</code>
<br>before running the Omniverse launcher AppImage file with:  
<br>&emsp;<code>./omniverse-launcher-linux.AppImage </code>  
 
4. The first time you log into the Omniverse Launcher, you will be asked to sign up and login. Just follow the instructions to create an NVIDIA developer account and login.


4. The first time you logon Omniverse Launcher, you will be asked to signup and login. Just follow the instructions to create an NVIDIA developer account and login.
5. When you first load up the Omniverse launcher, it will ask you to select the library path, data path, content path, and cache locations. Ensure that these point to directories you create in your Blue storage. If they are left at default, the 40 gigabytes on your login node will almost immediately fill up. If you need to change these file paths later, the library, data, and content paths can be changed by clicking on the user settings in the top right [https://user-images.githubusercontent.com/6526592/232133185-d88c4fe0-0ee3-4083-aa13-8bd273ee9328.png]. These paths, including the cache location, can be changed through the omniverse.toml file located in /home/your-username/.nvidia-omniverse/config/


5. Once you have login the Omniverse launcher, you can see the Omniverse launcher interface, click the top right user-setting and change the '''library path data path''', and '''content path''' to your blue storage [https://user-images.githubusercontent.com/6526592/232133185-d88c4fe0-0ee3-4083-aa13-8bd273ee9328.png]. Please do this before installing any applications, otherwise the default installation path is in '''$HOME''' with limit of 40GB, which will be full immediately.
6. In the Exchange tab, search and select any applications (e.g. Issac Sim) you wish to install. It may take some time to download and install them. Once the application is installed, you may find it in the "Library" tab


6. In the Exchange tab, select your applications (e.g. Issac Sim) to install them. It may takes some time for the downloading and installation. Once the application is installed, you may find it in the "LIBRARY" tab
7. In order to start an application, select it in the Library tab and click the launch button [https://user-images.githubusercontent.com/6526592/232134367-cf930dc2-7c65-4991-9e20-3f4a719e3373.png].


7. Start the Application: From the LIBRARY tab, you can click the launch button to start your application [https://user-images.githubusercontent.com/6526592/232134367-cf930dc2-7c65-4991-9e20-3f4a719e3373.png].
8. You can explore more about installing Isaac Sim at this page [https://docs.omniverse.nvidia.com/app_isaacsim/app_isaacsim/install_workstation.html#isaac-sim-app-install-workstation].
</div>
</div>





Latest revision as of 17:24, 10 February 2025

Description

Omniverse website  

NVIDIA Omniverse is a platform for creating and operating metaverse applications. It is a platform of APIs, SDKs, and services that enable developers to integrate OpenUSD, NVIDIA RTX™ rendering technologies, and generative physical AI into existing software tools and simulation workflows for industrial and robotic use cases. It has been used for applications in the visual effects and animation as well. Omniverse makes extensive use of the Universal Scene Description (USD) format, which should generally be the primary focus of those wishing to leverage the technology. Omniverse apps are all built upon the Omniverse Kit SDK, a highly modular application system that makes custom development a breeze. The support for running Omniverse on HiPerGator is limited to certain applications.

Learn more about Omniverse:

1. NVIDIA Omniverse Docs[1]

2. NVIDIA Omniverse Developer Overview[2]

3. NVIDIA Omniverse Youtube Channel [3]

Omniverse Launcher [4]

The NVIDIA Omniverse™ Launcher is your first step into the Omniverse. Giving you immediate access to all the apps, connectors and other downloads the Omniverse Launcher is your gateway to the Omniverse. With an intuitive Interface, Launcher allows a quick experience for opening and updating Omniverse Apps and Connectors. This module has been deprecated, and will cease online function in October 2025. It is not recommended to use.

Omniverse Applications

Omniverse applications are built using Omniverse Kit, a versatile SDK with an emphasis on modularity. Kit apps are given functionality through the use of extensions that developers can mix and match or build themselves. Nvidia supplies a number of core extensions that can be used to kickstart development, such as the omni.ui extension for easily building UI systems.

Nvidia built a number of example applications using the suite of extensions for Kit they developed. Some, like Isaac Sim, are distributed by Nvidia directly, while others are considered "templates" that are accessible from the kit-app-template repository.

  • Omniverse Isaac Sim [5]:

NVIDIA Omniverse Isaac Sim is a robotics simulation toolkit for the NVIDIA Omniverse platform. Isaac Sim has essential features for building virtual robotic worlds and experiments. It provides researchers and practitioners with the tools and workflows they need to create robust, physically accurate simulations and synthetic datasets. Isaac Sim supports navigation and manipulation applications through ROS/ROS2. It simulates sensor data from sensors such as RGB-D, Lidar, and IMU for various computer vision techniques such as domain randomization, ground-truth labeling, segmentation, and bounding boxes.

  • USD Composer, Explorer, Presenter [6]:

The USD Composer, Explorer, and Presenter apps are now template apps available through the kit-app-template development repo. They are relatively simple Kit apps that are designed to be built upon and customized to the needs of the user which provide an interface to interact with 3D USD environments. Once the templates are installed, users can access the .kit files associated with them to add and remove extensions and define each app's functionality.

Steps to install the NVIDIA Omniverse Launcher and Omniverse Applications *DEPRECATED*

It is no longer recommended to install the launcher. Instead, you may utilize the template apps in the kit-app-template[7], install a program like Isaac Sim directly[8], or use any Omniverse Tools available in the Nvidia Catalog[9].

Legacy Instructions

1. Navigate to the HiPerGator OpenOnDemand[ood.rc.ufl.edu] webpage. Request a HiPerGator Desktop on a hwgui node with a RTX6000 GPU [10].

2. Once you enter the HiPerGator Desktop, download the free standard omniverse launcher from https://www.nvidia.com/en-us/omniverse/download/. You may need to register to download the Omniverse launcher.

3. Open a terminal and make the downloaded file executable:
chmod +x omniverse-launcher-linux.AppImage
or alternatively open the file properties and check "Allow this file to run as a program" in the permissions tab.
NOTE: It is advised to run the launcher from the terminal as at the time of writing, launched apps will crash unless you run the line
export MESA_GL_VERSION_OVERRIDE=4.6
before running the Omniverse launcher AppImage file with:
./omniverse-launcher-linux.AppImage

4. The first time you log into the Omniverse Launcher, you will be asked to sign up and login. Just follow the instructions to create an NVIDIA developer account and login.

5. When you first load up the Omniverse launcher, it will ask you to select the library path, data path, content path, and cache locations. Ensure that these point to directories you create in your Blue storage. If they are left at default, the 40 gigabytes on your login node will almost immediately fill up. If you need to change these file paths later, the library, data, and content paths can be changed by clicking on the user settings in the top right [11]. These paths, including the cache location, can be changed through the omniverse.toml file located in /home/your-username/.nvidia-omniverse/config/

6. In the Exchange tab, search and select any applications (e.g. Issac Sim) you wish to install. It may take some time to download and install them. Once the application is installed, you may find it in the "Library" tab

7. In order to start an application, select it in the Library tab and click the launch button [12].

8. You can explore more about installing Isaac Sim at this page [13].