Difference between revisions of "Open OnDemand"

From UFRC
Jump to navigation Jump to search
m (Minor edits)
(Undo revision 27880 by Cabreraruizdiazj (talk))
Tag: Undo
 
(52 intermediate revisions by 5 users not shown)
Line 1: Line 1:
 
[[Category:Software]][[Category:GUI]]
 
[[Category:Software]][[Category:GUI]]
__TOC__
+
{|align=right
Here is some getting started information for using Open OnDemand to access HPG.
+
  |__TOC__
 +
  |}
  
<span style="color:red">'''The OnDemand service is accessible only within the UF campus network and using the campus VPN.'''</span>
+
This page provides getting started information for using Open OnDemand to access HiPerGator.
 +
[https://openondemand.org/ Open OnDemand] is setup to provide a web interface to starting and attaching to HiPerGator jobs and it supports GUI programs, Job Status, and other interactions with HiPerGator via seamless connections through web browsers. This service is available at the following URL: https://ondemand.rc.ufl.edu
  
If you are working off campus, you will need to use the VPN to connect to the UF campus network using [https://connect.ufl.edu/it/wiki/Pages/glvpn-anyconnect-install.aspx AnyConnect VPN] or similar software. Please see: [https://vpn.ufl.edu https://vpn.ufl.edu] for additional information.
+
If you run into issues, please look at our guide for [[Open OnDemand Troubleshooting]]. For questions or support, please open a support request with [OnDemand] in the subject.  
  
=Open OnDemand=
+
==Getting started video==
Open OnDemand [https://openondemand.org/ Open OnDemand] is setup to provide a web-only interface to starting and attaching to HiPerGator and it supports GUI programs, Job Status, and other interactions with HPG via seamless connections through web browsers. This service is available at the following URL:
 
  
https://ondemand.rc.ufl.edu
 
 
To provide feedback, please open a support request with [OnDemand] in the subject.  Please note:
 
 
'''Ondemand is currently a Beta service. Users are welcome to test the service and submit support requests with feedback. However, no SLA is guaranteed and all features should be considered experimental.'''
 
 
==Getting started video==
 
 
Please watch our introductory video here:
 
Please watch our introductory video here:
 
[https://mediasite.video.ufl.edu/Mediasite/Play/4654bfa838624de894085bf54678848f1d Using Open on Demand on HiPerGator]
 
[https://mediasite.video.ufl.edu/Mediasite/Play/4654bfa838624de894085bf54678848f1d Using Open on Demand on HiPerGator]
 
[[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/4654bfa838624de894085bf54678848f1d]] [5 min, 11 sec]
 
[[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/4654bfa838624de894085bf54678848f1d]] [5 min, 11 sec]
 
This video covers the use of Open on Demand https://openondemand.org/ on HiPerGator via https://ood.rc.ufl.edu/.
 
This video covers the use of Open on Demand https://openondemand.org/ on HiPerGator via https://ood.rc.ufl.edu/.
* Connect to https://ood.rc.ufl.edu/
+
# Connect to https://ood.rc.ufl.edu/
* Launch a terminal
+
# Launch a terminal
* Launch many graphical applications like Rstudio, Matlab and Freeview
+
# Launch many graphical applications like Rstudio, Matlab and Freeview
* Manage job submission
+
# Manage job submission
* Upload, download and edit files via your browser
+
# Upload, download and edit files via your browser
  
==Navigating OnDemand==
+
==Navigating OnDemand Menus==
  
 
To Navigate the basic functions of OnDemand, first login to [https://ood.rc.ufl.edu https://ood.rc.ufl.edu]
 
To Navigate the basic functions of OnDemand, first login to [https://ood.rc.ufl.edu https://ood.rc.ufl.edu]
  
[[File:OnDemand.png|On Demand Dashboard|500px]]
+
[[File:OnDemand.png|On Demand Dashboard|500px | right]]
  
 
Once you access the dashboard, you can use the top menus to navigate.
 
Once you access the dashboard, you can use the top menus to navigate.
  
===Files===
+
{| cellpadding = "5"
This menu, if selected, will allow you to access your group's storage areas including:
+
|-
 
+
|
 +
'''Files'''<br>
 +
This menu will allow you to access your groups' storage areas including:
 
*Home
 
*Home
 
*Orange
 
*Orange
*UFRC
+
*Blue
 +
If you're having issues, view our tips for the [[Open OnDemand Files | Files App]]
  
===Jobs===
+
'''Interactive Apps'''<br>
 +
Clicking this menu will present a drop-down menu with a list of the current interactive GUI applications available within OnDemand.<br>
 +
If you don't see an application you need, feel free to select the "Console" application and use the HiPerGator `module load` commands to load and run your application.
 +
 
 +
'''Clusters'''<br>
 +
HiPerGator Shell Access: This link opens a terminal shell in your browser that allows access the HiPerGator
 +
||
 +
'''Jobs'''<br>
 
This menu shows both the job status and job composer links
 
This menu shows both the job status and job composer links
  
*Job Status: This link shows the Job status window.  This query's SLRUM and shows you the current status of your pending, running, and recently completed jobs.
+
*Job Status: This link shows the Job status window.  This queries SLRUM and shows you the current status of your pending, running, and recently completed jobs.
*Job Composer: This link allows access to the job composer if you would like to use OnDemand to run your existing SLRUM scripts.
+
*Job Composer: This link allows access to the job composer if you would like to use OnDemand to run your existing SLURM scripts.
  
===Clusters===
+
'''My Interactive Sessions'''<br>
 +
Clicking this link will take to you a list of your currently running interactive OnDemand jobs.
  
*HiPerGator Shell Access: This link opens a web terminal in your browser that allows access the HiPerGator login shell
+
'''Help'''<br>
 +
This link provides access to some quick links for help on HiPerGator and for OnDemand.
  
===Interactive Apps===
+
'''Logout'''<br>
 +
This link logs you out of the OnDemand page.
 +
|}
  
Clicking this menu will present a drop-down menu with a list of the current interactive GUI applications available within OnDemand.
+
==Starting an Interactive application==
 +
To start an interactive application, first select the application you would like to start from the "Interactive Applications menu".  Then you will see a form with the SLURM options available for that application.  Fill in the fields with the resources you would like allocated for this application session.
  
If you don't see an application you need, feel free to select the "Console" application and use the HPG modules system to load and run your application.
+
===General Form Fields===
  
===My Interactive Sessions===
+
Version: Select the application version
 +
This defines the version of the application you want to load.
 +
<div style="column-count:2">
 +
We recommend leaving the following fields at the default of 1:
 +
*Number of MPI Tasks (--ntasks)
 +
*Number of CPU cores requested per MPI task (--cpus-per-task, -p)
 +
*Maximum memory requested for this job in Gigabytes (--mem, -m)
 +
**'''Note''': If you are using advanced memory options in Additional SLURM Options below, then leave this blank.
 +
*Time Requested for this job in hours (--time, -t)
  
Clicking this link will take to you a list of your currently running interactive OnDemand jobs.
+
We recommend leaving the following fields blank as default
 +
*SLURM Account (--account, -A):
 +
*QoS (Required if custom Account is set, --qos, -q)
 +
*Cluster partition (--partition, -p)
 +
*Generic Resource Request (--gres)
 +
*Additional SLURM Options
 +
</div>
 +
You can have multiple copies of the same application running at the same time by submitting the form multiple times. Then select "Launch" to submit your job request.
 +
 
 +
==Display Environment on the Console==
 +
 
 +
You can use the "Console" Interactive application from the OOD menu to get a console session enabled with the frame-buffer.  To do this:
 +
 
 +
# login to https://ood.rc.ufl.edu
 +
# Select the "Console" Application
 +
#* Interactive Apps -> Console
 +
# Fill in the form with your job resource request (please make sure to ask for at least 4 GB of RAM to make sure you have enough to render the frame buffers) and then select "Launch" at the bottom of the form. For specific parameters, see the [https://help.rc.ufl.edu/doc/GPU_Access#Open_On_Demand_Access Open OnDemand Access] page
 +
# Select "Launch Console" from the "My Interactive Sessions" page once your job starts.
 +
 
 +
This console session will open in your web browser and will have both the DISPLAY variable set and the X11 server started.
 +
 
 +
==Connecting to an Interactive application==
 +
 
 +
Once a job has started, you can connect using the "My Interactive Applications" menu. 
 +
*Select this menu and you will see a connection box for each application you have running and pending. 
 +
*Once the job starts, a Launch (App Name) icon will appear. 
 +
*Select this link to open a new browser window connecting you to your application.
  
===Help===
+
===Connecting to a HWGUI application===
  
This link provides access to some quick links for help on HPG and for OnDemand.
+
To use the hardware accelerated resources with your interactive sessions, please select the hwgui partition from the partition list when submitting your job resource form.
  
===Logout===
+
Additionally, many applications that require hardware acceleration by default have been added under the HWGUI Apps section of the Interactive Apps menu.
  
This link logs you out of the OnDemand page.
+
[[File:OOD-Card.png|600px|right|Example highlighting the components of an OOD connection card]]
 +
==Job Connect Card==
 +
This section outlines several of the key features of the job connect card:
  
==Starting an Interactive application==
+
# JobID:  This is the SLURM JobID for this job
 +
# Delete:  This will cancel a running job, (or delete the session if the job has already ended)
 +
# OOD Session ID: This is the unique identifier for the OOD session for this job, can be clicked to bring up the OOD log directory for troubleshooting
 +
# Image Quality: This setting controls the quality of the visual interface at the source, use a lower setting for slower internet connections
 +
# Compression: This setting adjusts the amount of CPU based compression used for the NoVNC connection, use higher settings for slower connections but note it will increase CPU usage on both the job and client
 +
# Launch Button: Click this button to connect to your running job in a web-browser session

Latest revision as of 16:46, 5 May 2023

This page provides getting started information for using Open OnDemand to access HiPerGator. Open OnDemand is setup to provide a web interface to starting and attaching to HiPerGator jobs and it supports GUI programs, Job Status, and other interactions with HiPerGator via seamless connections through web browsers. This service is available at the following URL: https://ondemand.rc.ufl.edu

If you run into issues, please look at our guide for Open OnDemand Troubleshooting. For questions or support, please open a support request with [OnDemand] in the subject.

Getting started video

Please watch our introductory video here: Using Open on Demand on HiPerGator Play icon.png [5 min, 11 sec] This video covers the use of Open on Demand https://openondemand.org/ on HiPerGator via https://ood.rc.ufl.edu/.

  1. Connect to https://ood.rc.ufl.edu/
  2. Launch a terminal
  3. Launch many graphical applications like Rstudio, Matlab and Freeview
  4. Manage job submission
  5. Upload, download and edit files via your browser

Navigating OnDemand Menus

To Navigate the basic functions of OnDemand, first login to https://ood.rc.ufl.edu

On Demand Dashboard

Once you access the dashboard, you can use the top menus to navigate.

Files
This menu will allow you to access your groups' storage areas including:

  • Home
  • Orange
  • Blue

If you're having issues, view our tips for the Files App

Interactive Apps
Clicking this menu will present a drop-down menu with a list of the current interactive GUI applications available within OnDemand.
If you don't see an application you need, feel free to select the "Console" application and use the HiPerGator `module load` commands to load and run your application.

Clusters
HiPerGator Shell Access: This link opens a terminal shell in your browser that allows access the HiPerGator

Jobs
This menu shows both the job status and job composer links

  • Job Status: This link shows the Job status window. This queries SLRUM and shows you the current status of your pending, running, and recently completed jobs.
  • Job Composer: This link allows access to the job composer if you would like to use OnDemand to run your existing SLURM scripts.

My Interactive Sessions
Clicking this link will take to you a list of your currently running interactive OnDemand jobs.

Help
This link provides access to some quick links for help on HiPerGator and for OnDemand.

Logout
This link logs you out of the OnDemand page.

Starting an Interactive application

To start an interactive application, first select the application you would like to start from the "Interactive Applications menu". Then you will see a form with the SLURM options available for that application. Fill in the fields with the resources you would like allocated for this application session.

General Form Fields

Version: Select the application version This defines the version of the application you want to load.

We recommend leaving the following fields at the default of 1:

  • Number of MPI Tasks (--ntasks)
  • Number of CPU cores requested per MPI task (--cpus-per-task, -p)
  • Maximum memory requested for this job in Gigabytes (--mem, -m)
    • Note: If you are using advanced memory options in Additional SLURM Options below, then leave this blank.
  • Time Requested for this job in hours (--time, -t)

We recommend leaving the following fields blank as default

  • SLURM Account (--account, -A):
  • QoS (Required if custom Account is set, --qos, -q)
  • Cluster partition (--partition, -p)
  • Generic Resource Request (--gres)
  • Additional SLURM Options

You can have multiple copies of the same application running at the same time by submitting the form multiple times. Then select "Launch" to submit your job request.

Display Environment on the Console

You can use the "Console" Interactive application from the OOD menu to get a console session enabled with the frame-buffer. To do this:

  1. login to https://ood.rc.ufl.edu
  2. Select the "Console" Application
    • Interactive Apps -> Console
  3. Fill in the form with your job resource request (please make sure to ask for at least 4 GB of RAM to make sure you have enough to render the frame buffers) and then select "Launch" at the bottom of the form. For specific parameters, see the Open OnDemand Access page
  4. Select "Launch Console" from the "My Interactive Sessions" page once your job starts.

This console session will open in your web browser and will have both the DISPLAY variable set and the X11 server started.

Connecting to an Interactive application

Once a job has started, you can connect using the "My Interactive Applications" menu.

  • Select this menu and you will see a connection box for each application you have running and pending.
  • Once the job starts, a Launch (App Name) icon will appear.
  • Select this link to open a new browser window connecting you to your application.

Connecting to a HWGUI application

To use the hardware accelerated resources with your interactive sessions, please select the hwgui partition from the partition list when submitting your job resource form.

Additionally, many applications that require hardware acceleration by default have been added under the HWGUI Apps section of the Interactive Apps menu.

Example highlighting the components of an OOD connection card

Job Connect Card

This section outlines several of the key features of the job connect card:

  1. JobID: This is the SLURM JobID for this job
  2. Delete: This will cancel a running job, (or delete the session if the job has already ended)
  3. OOD Session ID: This is the unique identifier for the OOD session for this job, can be clicked to bring up the OOD log directory for troubleshooting
  4. Image Quality: This setting controls the quality of the visual interface at the source, use a lower setting for slower internet connections
  5. Compression: This setting adjusts the amount of CPU based compression used for the NoVNC connection, use higher settings for slower connections but note it will increase CPU usage on both the job and client
  6. Launch Button: Click this button to connect to your running job in a web-browser session