Difference between revisions of "Training Videos"

From UFRC
Jump to navigation Jump to search
 
(135 intermediate revisions by 4 users not shown)
Line 1: Line 1:
[[Category:Training]]
+
[[Category:Essentials]]__NOTOC__
{|align=right
+
==Quick How Tos==
  |__TOC__
+
The following videos are designed to provide quick help for users on various topics, most are only a few minutes long. Please let us know if there are additional topics that you feel would be useful for a quick help video.
  |}
 
  
[[File:How_To_Videos.png | frameless]]  
+
In addition to the pre-recorded content, we also provide in-person training sessions. Visit the [[Trainings|main training page]] for additional training information.
 +
<div style = 'text-align: center;'>
 +
===Connecting to HPG===
 +
[[Image:SSH_MACOS.png|frameless|upright=0.7| link=https://mediasite.video.ufl.edu/Mediasite/Play/89b780ef71094f568a6c091953445ff31d]]
 +
[[Image:Sshwin.png|frameless|upright=0.7|link=https://mediasite.video.ufl.edu/Mediasite/Play/227c2cae1147422c91afff28435a51ac1d]]
 +
[[Image:Jup.png|frameless|upright=0.7|link=https://mediasite.video.ufl.edu/Mediasite/Play/8efcf534ef3c408e9238d8deeeda083a1d]]
 +
[[Image:Ood.png|frameless|upright=0.7|link=https://mediasite.video.ufl.edu/Mediasite/Play/4654bfa838624de894085bf54678848f1d]]
  
The following videos are designed to provide quick help for users on various topics. Most are only a few minutes long.  
+
===Data Transfer===
 +
[[Image:Macsam.png|frameless|upright=0.7|link=https://mediasite.video.ufl.edu/Mediasite/Play/8af63885f3e64f55b938eda14c092b291d]]
 +
[[Image:Winsam.png|frameless|upright=0.7|link=https://mediasite.video.ufl.edu/Mediasite/Play/9ef9efe534814246b4115de01e8411691d]]
 +
[[Image:GDT.png|frameless|upright=0.7|link=https://mediasite.video.ufl.edu/Mediasite/Play/1c74e8bfd7e74447a13885cdaa033f461d]]
 +
[[Image:GCP.png|frameless|upright=0.7| 200px|link=https://mediasite.video.ufl.edu/Mediasite/Play/81b2234b09d84d0ebf5d4ca47b35712b1d]]
 +
[[Image:Shared.png|frameless|upright=0.7|link=https://mediasite.video.ufl.edu/Mediasite/Play/98f7c82da478426298f95e6b9fbbac2a1d]]
  
Please let us know if there are additional topics that you feel would be useful for a quick help video.
+
===Other How Tos===
 +
[[Image:FRS.png|frameless|upright=0.7|link=https://mediasite.video.ufl.edu/Mediasite/Play/79fb67818dc6467eac6271561c7e20ce1d]]
 +
[[Image:DEM.png|frameless|upright=0.7|link=https://mediasite.video.ufl.edu/Mediasite/Play/828d67ceed634ab4bce083c0cab7b1431d]]
 +
[[Image:SJA.png|frameless|upright=0.7|link=https://mediasite.video.ufl.edu/Mediasite/Play/5bbd7cfb22b2416bbb0541e79875def51d]]
 +
[[Image:SPR.png|frameless|upright=0.7|link=https://mediasite.video.ufl.edu/Mediasite/Play/e0eb646aa861441785133060757d78861d]]
 +
</div>
  
Visit the [[Training|main training page]] for additional training information.
+
==Recorded Trainings==
  
==Connecting to HiPerGator==
+
For the topics below, the link on the orange and blue play icon ([[File:Play_icon.png|frameless|30px]]) links to a studio recorded version of the training material. Those tend to be higher quality, but also older and potentially somewhat outdated. The Zoom icon ([[File:ZoomLogo.png|frameless|50px]]) links to the most recent recording of a live session. The Zoom recordings may have participant Q&A and additional information added during a live session, but tend to be the most recent information.
===[https://mediasite.video.ufl.edu/Mediasite/Play/0b238bfffb684fd6b7306129af63a6711d ssh from MacOS]===
 
[[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/0b238bfffb684fd6b7306129af63a6711d]] [2 min, 22 sec]
 
This video demonstrates launching the MacOS Terminal, logging into HiPerGator at hpg.rc.ufl.edu using ssh, and demonstration of the user's /home and /blue directories.
 
* The HiPerGator hostname is: hpg.rc.ufl.edu
 
* Your username and password are your Gatorlink username and password.
 
  
{{Note|This video mentions our older /ufrc folder for group directories. That filesystem has been removed and all users should have folders in <code>/blue/<group></code>. So, where the video mentions the command <code>cd /ufrc/...</code>, your would type <code>cd /blue/...</code>.|warn}}
+
{| cellspacing="30" cellpadding="0" width="100%"
 +
|- valign="top"
 +
| width="50%" |
 +
{| width="100%"
 +
=== HiPerGator Account Training ===
  
===[https://mediasite.video.ufl.edu/Mediasite/Play/2bf4c860f19b48a593fb581018b813a11d ssh from Windows]===
+
{{Note | ''All'' new HiPerGator users are required to take the HiPerGator Account training: '''[[New user training|Link and overview on this page]]'''.|warn}}
[[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/2bf4c860f19b48a593fb581018b813a11d]] [3 min, 41 sec]
 
This video covers download and installation of the Windows ssh client MobaXterm, logging into HiPerGator at hpg.rc.ufl.edu using ssh, demonstration of /home and /blue directories and copy/paste on Windows ssh clients.
 
* The HiPerGator hostname is: hpg.rc.ufl.edu
 
* Your username and password are your Gatorlink username and password.
 
  
{{Note|This video mentions our older /ufrc folder for group directories. That filesystem has been removed and all users should have folders in <code>/blue/<group></code>. So, where the video mentions the command <code>cd /ufrc/...</code>, your would type <code>cd /blue/...</code>.|warn}}
+
=== Introduction to Research Computing and HiPerGator===
 +
Intended for new users, this training provides a general overview of the UF Research Computing facilities and basic usage of HiPerGator. <br>
 +
This training is available in three parts:
 +
* [https://mediasite.video.ufl.edu/Mediasite/Play/69473454b72740579e1d2f406241834c1d Part 1: Intro to UF Research Computing and HiPerGator] [[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/69473454b72740579e1d2f406241834c1d]]
 +
* [https://mediasite.video.ufl.edu/Mediasite/Play/80b0e4c850ff4835aa55dfcb7789b5f01d Part 2: Getting logged in, storage and using HiPerGator] [[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/80b0e4c850ff4835aa55dfcb7789b5f01d]]
 +
* [https://mediasite.video.ufl.edu/Mediasite/Play/bc7ded7444ac4ad6b3b91cd42dc88ede1d Part 3: Working with the SLURM Scheduler to run Jobs] [[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/bc7ded7444ac4ad6b3b91cd42dc88ede1d]]
 +
Or as a recording of the most recent Zoom session:[[File:ZoomLogo.png|frameless|50px|link=https://ufl.zoom.us/rec/share/DtzIP1b7PAyxqhWq0Q2q-mhSLpewbN-2bWdXDzKKVhy4SDva1-SYCdlAVosgg8QS.N6Kq88YnTtX47TbJ?startTime=1725547197000]][https://ufl.zoom.us/rec/share/DtzIP1b7PAyxqhWq0Q2q-mhSLpewbN-2bWdXDzKKVhy4SDva1-SYCdlAVosgg8QS.N6Kq88YnTtX47TbJ?startTime=1725547197000 Recording of the Sept. 5, 2024 session].<br>
 +
You can [https://www.dropbox.com/s/ei6xrdpv695f0fo/RC_Intro_to_RC.pdf?dl=0 download a copy of the slides used from here].<br>
  
===[https://mediasite.video.ufl.edu/Mediasite/Play/8efcf534ef3c408e9238d8deeeda083a1d Using Jupyter Notebooks on HiPerGator]===
+
===Introduction to the Linux Command Line===
[[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/8efcf534ef3c408e9238d8deeeda083a1d]] [8 min, 1 sec]
+
This session will lead users new to the Command Line through some exercises that go over basic Linux commands. These include moving around the file system, making directories, moving and copying files, etc. We will also go over some of the applications you can use on your computer to connect to and move files to and from HiPerGator.
This video covers the use of Jupyter Notebooks via https://jhub.rc.ufl.edu/ to run Python, R and other notebooks on HiPerGator.
 
* Connect to https://jhub.rc.ufl.edu/
 
* Launch notebooks in various coding languages
 
* Launch a terminal
 
* Upload and download files via your browser
 
  
===[https://mediasite.video.ufl.edu/Mediasite/Play/4654bfa838624de894085bf54678848f1d Using Open on Demand on HiPerGator]===
+
This session is available as a pre-recorded video or Zoom recording: [[File:Play_icon.png|frameless|30px|link=https://training.it.ufl.edu/training/items/introduction-to-linux-command-line.html]]  [[File:ZoomLogo.png|frameless|50px|https://ufl.zoom.us/rec/share/r8k-s4DZ1OBfrNcRKKiD_cw3iwT424NC042kX3dorK40VHpMb7Om7hN1ouOEWZA.Jok4hF68KZcgQyow?startTime=1706197225000]]
[[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/4654bfa838624de894085bf54678848f1d]] [5 min, 11 sec]
+
 
This video covers the use of Open on Demand https://openondemand.org/ on HiPerGator via https://ood.rc.ufl.edu/.
+
The handout and files for the session are now located in a git repository here: https://github.com/UFResearchComputing/Linux_training<br>
* Connect to https://ood.rc.ufl.edu/
+
The handout can be [https://github.com/UFResearchComputing/Linux_training/blob/main/README.pdf downloaded as a PDF file].
* Launch a terminal
+
 
* Launch many graphical applications like Rstudio, Matlab and Freeview
+
The <code>molecules</code> folder used in the training is at <code>/data/training/LinuxCLI/molecules</code>.
* Manage job submission
+
 
* Upload, download and edit files via your browser
+
For those wishing to use this training outside of HiPerGator, the <code>molecules</code> folder is in the <code>data</code> folder in the repository. There are also directions for non-HiPerGator use in the [https://github.com/UFResearchComputing/Linux_training/blob/main/non_HiPerGator.md non-HiPerGator.md] file or as a [https://github.com/UFResearchComputing/Linux_training/blob/main/non_HiPerGator.pdf PDF].  The repository can be downloaded to your own computer and run there.
 +
 
 +
===HiPerGator: SLURM Submission Scripts===
 +
 
 +
In this session, participants will practice working with SLURM submission scripts using sample files, but are encourage to bring their own scripts as well. The training will cover the most common scheduler directives and how to tell SLURM the information it needs to run your jobs efficiently. This session assumes a basic familiarity with the Unix command line and will be aimed at beginning to intermediate users. See the Introduction to the Linux Command Line Training for help with Linux.
 +
 
 +
This session is available as a pre-recorded video:
 +
This video is approximately 35 minutes and includes a demonstration.
 +
[[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/3fe6e15428ad401e97afa093252e0e151d]]
 +
 
 +
The files used in this video are on the [[Sample_SLURM_Scripts]] page and on the cluster in <code>/data/training/SLURM/</code>.
 +
 
 +
The slides from the training can be [https://www.dropbox.com/scl/fi/ndgdrxe7zrnhdcu3ro1ke/RC_SLURM.pdf?rlkey=dc3dinh00t6v1orvopbul1sf7&dl=0 downloaded here].
 +
 
 +
[[File:ZoomLogo.png|frameless|50px|link=https://ufl.zoom.us/rec/share/J6LbLhBVVetNHbHmnAb59YLHSGgA6qbuOyi0V1FkNdxVqr-RdNi0fbMp5yPiIHs.LIRXLIwNPiSuMEdm?startTime=1726756814000]] [https://ufl.zoom.us/rec/share/J6LbLhBVVetNHbHmnAb59YLHSGgA6qbuOyi0V1FkNdxVqr-RdNi0fbMp5yPiIHs.LIRXLIwNPiSuMEdm?startTime=1726756814000 Recording of the Sept. 19, 2024 session].
 +
 
 +
===Getting Started in AI===
 +
 
 +
This session in our Getting Started with AI series will introduce PyTorch for image classification using Jupyter Notebooks running on HiPerGator.
 +
 
 +
Users will have hands-on exercises covering the steps of preparing data, and training and validating a neural network model for image classification.
 +
 
 +
If you are unfamiliar with Jupyter Notebooks, we recommend watching the [[Training Videos#Jupyter_Hub_and_Jupyter_Notebooks_for_R.2C_Python_and_More|Jupyter training first]].
 +
 
 +
The Jupyter notebooks used for the training are on GitHub: [[File:Github logo.png|frameless|25px|link=https://github.com/UFResearchComputing/DL_pytorch_CNN DL_pytorch_CNN]][https://github.com/UFResearchComputing/DL_pytorch_CNN DL_pytorch_CNN]
 +
|}
 +
||
 +
{| cellspacing="30" cellpadding="0" width="100%"
 +
|- valign="top"
 +
{| width="100%"
 +
 
 +
===HiPerGator: SLURM Submission Scripts for MPI Jobs===
 +
 
 +
This session will go into depth on the details of scheduling MPI jobs on HiPerGator. Efficiently running MPI applications requires an understanding of both how to specify the needed resources as well as the layout and properties of the available hardware. This session will provide examples from several commonly used applications and provide guidelines for users to optimize their own runs.
 +
 
 +
This video is approximately 25 minutes and includes a demonstration.
 +
[[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/9d09e1dda67a4993b1877b33e40b30b51d]]
  
==Data Transfer==
+
The files used in this video are on the [[Sample_SLURM_Scripts]] page and on the cluster in <code>/data/training/SLURM/</code>.
===[https://mediasite.video.ufl.edu/Mediasite/Play/873a2b08bf1d4ccda49a51f5c84692491d SFTP transfer with FileZilla]===
 
[[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/873a2b08bf1d4ccda49a51f5c84692491d]] [2 min, 12 sec]
 
This video demonstrates using the FileZilla SFTP client to transfer data to/from HiPerGator.
 
*The HiPerGator hostname is: hpg.rc.ufl.edu
 
* '''note:''' for larger transfers, you may have better network performance with the host: sftp.rc.ufl.edu
 
* Your username and password are your Gatorlink username and password.
 
*The port for SFTP transfers is: 22
 
  
===[https://mediasite.video.ufl.edu/Mediasite/Play/1c74e8bfd7e74447a13885cdaa033f461d Data transfer with Globus]===
+
The slides used in this workshop can be [https://www.dropbox.com/scl/fi/ndgdrxe7zrnhdcu3ro1ke/RC_SLURM.pdf?rlkey=dc3dinh00t6v1orvopbul1sf7&dl=0 downloaded here].
  
[[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/1c74e8bfd7e74447a13885cdaa033f461d]][4 min, 22 sec]
+
[[File:ZoomLogo.png|frameless|50px|link=https://ufl.zoom.us/rec/share/P-llE16rneblibiSq9zsAzNH7batJBN_eBYHWBEnws_N-JbnljxxFcvkvh7cVRCF.xUCk1wZotqvEAk42?startTime=1695912013000]] [https://ufl.zoom.us/rec/share/P-llE16rneblibiSq9zsAzNH7batJBN_eBYHWBEnws_N-JbnljxxFcvkvh7cVRCF.xUCk1wZotqvEAk42?startTime=1695912013000 Recording of the September 28th, 2023 session].
  
This video demonstrates the basics of:
+
===Running Graphical Applications on HiPerGator===
* Logging in to [https://globus.org Globus.org] using UF Gatorlink credentials.
 
* Connecting to the UFRC main endpoint at '''ufrc#hpg2'''
 
* Connecting to another endpoint for data transfer
 
* Transferring a file
 
* Additional options for file transfer, including folder synchronization and encryption.
 
  
View [https://help.rc.ufl.edu/doc/Globus Globus page] for overview.
+
Users can run applications with graphical user interfaces (GUI) on HiPerGator either using Open on Demand or using the gui module and submitting jobs from the command line.
  
===[https://mediasite.video.ufl.edu/Mediasite/Play/81b2234b09d84d0ebf5d4ca47b35712b1d Setting up Globus Connect Personal]===
+
This video provides and overview of Open on Demand, which offers many GUI applications:
[[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/81b2234b09d84d0ebf5d4ca47b35712b1d]][3 min, 24 sec]
+
[[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/4654bfa838624de894085bf54678848f1d]] [5 min, 11 sec]
  
This video demonstrates the basics of:
+
The most recent Zoom session, covering Open on Demand is also available: [[File:ZoomLogo.png|frameless|50px|link=https://ufl.zoom.us/rec/share/2kFFjiOBHrslbkZRBduPmkf42v7_oIhm0T6Fibm1NeKKb9BDvPN_7SCHnFrUo8Su.3RZ3xOXIlQBPaPni?startTime=1708011604000]] [https://ufl.zoom.us/rec/share/2kFFjiOBHrslbkZRBduPmkf42v7_oIhm0T6Fibm1NeKKb9BDvPN_7SCHnFrUo8Su.3RZ3xOXIlQBPaPni?startTime=1708011604000 Recording of the February 15th, 2024 session].
* Establishing a Globus Connect Endpoint for your computer
 
* Installing the Globus Connect Personal client
 
* Using the setup key to initialize your client.
 
  
===[https://mediasite.video.ufl.edu/Mediasite/Play/98f7c82da478426298f95e6b9fbbac2a1d Setting up a shared end-point with Globus]===
+
The [[GUI Programs]] page has additional information.
[[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/98f7c82da478426298f95e6b9fbbac2a1d]][3 min, 42 sec]
 
  
This video demonstrates the basics of:
+
===Jupyter Hub and Jupyter Notebooks and Managing Conda/Mamba Environments===
* Connecting to the '''ufrc#hpg2''' endpoint
 
* Designating a folder as a shared endpoint
 
* Setting share options
 
* Creating a Globus group
 
  
View [https://help.rc.ufl.edu/doc/Globus Globus page] for overview.
+
This session covers using Jupyter Notebooks through [https://jhub.rc.ufl.edu https://jhub.rc.ufl.edu] and [https://ood.rc.ufl.edu Open on Demand].
  
===Data transfer with Samba===
+
For additional information on Jupyter at Research Computing see the [[Jupyter Notebooks]] page.
View [https://help.rc.ufl.edu/doc/Samba_Access Samba page] for overview.
 
====[https://mediasite.video.ufl.edu/Mediasite/Play/8af63885f3e64f55b938eda14c092b291d Samba Access from MacOS]====
 
[[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/8af63885f3e64f55b938eda14c092b291d]] [2 min, 46 sec] This video demonstrate how to mount a UFRC filesystem on your MacOS computer using Samba.
 
  
====[https://mediasite.video.ufl.edu/Mediasite/Play/9d44a4213d1040b889cd9c19d3c2cf781d Samba Access from Windows]====
+
This session is available as a pre-recorded training and zoom recording: [[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/1afd6f069ab44ebaa0b91c39c876e9d41d]] [[File:ZoomLogo.png|frameless|50px|link=https://ufl.zoom.us/rec/share/AxsUTFdDzBAIIrABSagX4l6KSBf8ijXTzg0fvvdCd770G3kTcmhC6U-v8DcI6NzG.IBXQHjNasHSM5UtF?startTime=1677771682000]]
[[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/9d44a4213d1040b889cd9c19d3c2cf781d]] [2 min, 1 sec] This video demonstrate how to mount a UFRC filesystem on your Windows computer using Samba.
 
  
==Storage and Data Management==
+
===Git and GitHub.com===
===[https://mediasite.video.ufl.edu/Mediasite/Play/79fb67818dc6467eac6271561c7e20ce1d Restoring Files in /home from snapshots]===
+
Slides for the presentation are at:[[File:Github logo.png|frameless|25px|link=https://ufresearchcomputing.github.io/git-training/#/]]https://ufresearchcomputing.github.io/git-training/#/<br>
[[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/79fb67818dc6467eac6271561c7e20ce1d]] [5 min, 43 sec]
+
The hands-on content is in the <code>main</code> branch of the repository at:[[File:Github logo.png|frameless|25px|link=https://github.com/UFResearchComputing/git-training]]https://github.com/UFResearchComputing/git-training
  
A small home directory (20GB quota) is provided for HiPerGator users, which '''is not intended for high performance work'''. Your /home area is intended for source code, scripts, and other human-readable data; the amount of data stored in your /home area should be kept to a minimum. Home directories have one week of daily snapshots available, which can be accessed by the user to recover older versions of files or accidentally deleted files. This video shows how to restore these files.
+
[[File:ZoomLogo.png|frameless|50px|link=https://ufl.zoom.us/rec/share/BTjCd6pf0dNq1MYaKjP9B49Ct6y8ngYDgTLuxuvWihwXnfza53lu28Qtfwr5o7k1.JhLwt_F813r7zQBf?startTime=1669909303000]] [https://ufl.zoom.us/rec/share/BTjCd6pf0dNq1MYaKjP9B49Ct6y8ngYDgTLuxuvWihwXnfza53lu28Qtfwr5o7k1.JhLwt_F813r7zQBf?startTime=1669909303000 Recording of the December 1, 2022 session]
  
==Submitting Jobs==
+
===Orientation Material for Courses using HiPerGator===
===Running many short jobs with job arrays===
+
For UF courses that use HiPerGator, please review our policies on [https://www.rc.ufl.edu/services/support/teaching-support/ teaching use of HiPerGator].
[[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/5bbd7cfb22b2416bbb0541e79875def51d]] [10 min, 16sec]
 
This video reviews important considerations for running [[SLURM Job Arrays]], especially when the individual tasks are short in duration. The video walks through the example script on the [[SLURM_Job_Arrays|Job array page]] to help users run multiple short tasks in a single job to maximize their efficiency.
 
  
==Making Investments in UF Research Computing Resources==
+
Recording of the training is available here: [[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/11fcf111fb204e1991f7a252d15e64571d]]
===[https://mediasite.video.ufl.edu/Mediasite/Play/e0eb646aa861441785133060757d78861d Submitting a purchase request]===
 
[[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/e0eb646aa861441785133060757d78861d]][3 min, 34 sec]
 
  
This video covers:
+
The most recent slides can be [https://www.dropbox.com/s/muhogibypyogur5/RC_Class_Orientation.pdf?dl=0 downloaded from here] and have also been shared with your professor.
* [https://www.rc.ufl.edu/services/rates/ UFRC Price sheets]
+
|}
* Hardware vs. Services investments
 
* [https://www.rc.ufl.edu/services/purchase-request/ Submitting the purchase request form]
 

Latest revision as of 18:03, 19 September 2024

Quick How Tos

The following videos are designed to provide quick help for users on various topics, most are only a few minutes long. Please let us know if there are additional topics that you feel would be useful for a quick help video.

In addition to the pre-recorded content, we also provide in-person training sessions. Visit the main training page for additional training information.

Connecting to HPG

SSH MACOS.png Sshwin.png Jup.png Ood.png

Data Transfer

Macsam.png Winsam.png GDT.png GCP.png Shared.png

Other How Tos

FRS.png DEM.png SJA.png SPR.png

Recorded Trainings

For the topics below, the link on the orange and blue play icon (Play icon.png) links to a studio recorded version of the training material. Those tend to be higher quality, but also older and potentially somewhat outdated. The Zoom icon (ZoomLogo.png) links to the most recent recording of a live session. The Zoom recordings may have participant Q&A and additional information added during a live session, but tend to be the most recent information.

HiPerGator Account Training

All new HiPerGator users are required to take the HiPerGator Account training: Link and overview on this page.

Introduction to Research Computing and HiPerGator

Intended for new users, this training provides a general overview of the UF Research Computing facilities and basic usage of HiPerGator.
This training is available in three parts:

Or as a recording of the most recent Zoom session:ZoomLogo.pngRecording of the Sept. 5, 2024 session.
You can download a copy of the slides used from here.

Introduction to the Linux Command Line

This session will lead users new to the Command Line through some exercises that go over basic Linux commands. These include moving around the file system, making directories, moving and copying files, etc. We will also go over some of the applications you can use on your computer to connect to and move files to and from HiPerGator.

This session is available as a pre-recorded video or Zoom recording: Play icon.png https://ufl.zoom.us/rec/share/r8k-s4DZ1OBfrNcRKKiD_cw3iwT424NC042kX3dorK40VHpMb7Om7hN1ouOEWZA.Jok4hF68KZcgQyow?startTime=1706197225000

The handout and files for the session are now located in a git repository here: https://github.com/UFResearchComputing/Linux_training
The handout can be downloaded as a PDF file.

The molecules folder used in the training is at /data/training/LinuxCLI/molecules.

For those wishing to use this training outside of HiPerGator, the molecules folder is in the data folder in the repository. There are also directions for non-HiPerGator use in the non-HiPerGator.md file or as a PDF. The repository can be downloaded to your own computer and run there.

HiPerGator: SLURM Submission Scripts

In this session, participants will practice working with SLURM submission scripts using sample files, but are encourage to bring their own scripts as well. The training will cover the most common scheduler directives and how to tell SLURM the information it needs to run your jobs efficiently. This session assumes a basic familiarity with the Unix command line and will be aimed at beginning to intermediate users. See the Introduction to the Linux Command Line Training for help with Linux.

This session is available as a pre-recorded video: This video is approximately 35 minutes and includes a demonstration. Play icon.png

The files used in this video are on the Sample_SLURM_Scripts page and on the cluster in /data/training/SLURM/.

The slides from the training can be downloaded here.

ZoomLogo.png Recording of the Sept. 19, 2024 session.

Getting Started in AI

This session in our Getting Started with AI series will introduce PyTorch for image classification using Jupyter Notebooks running on HiPerGator.

Users will have hands-on exercises covering the steps of preparing data, and training and validating a neural network model for image classification.

If you are unfamiliar with Jupyter Notebooks, we recommend watching the Jupyter training first.

The Jupyter notebooks used for the training are on GitHub: link=https://github.com/UFResearchComputing/DL_pytorch_CNN DL_pytorch_CNNDL_pytorch_CNN

HiPerGator: SLURM Submission Scripts for MPI Jobs

This session will go into depth on the details of scheduling MPI jobs on HiPerGator. Efficiently running MPI applications requires an understanding of both how to specify the needed resources as well as the layout and properties of the available hardware. This session will provide examples from several commonly used applications and provide guidelines for users to optimize their own runs.

This video is approximately 25 minutes and includes a demonstration. Play icon.png

The files used in this video are on the Sample_SLURM_Scripts page and on the cluster in /data/training/SLURM/.

The slides used in this workshop can be downloaded here.

ZoomLogo.png Recording of the September 28th, 2023 session.

Running Graphical Applications on HiPerGator

Users can run applications with graphical user interfaces (GUI) on HiPerGator either using Open on Demand or using the gui module and submitting jobs from the command line.

This video provides and overview of Open on Demand, which offers many GUI applications: Play icon.png [5 min, 11 sec]

The most recent Zoom session, covering Open on Demand is also available: ZoomLogo.png Recording of the February 15th, 2024 session.

The GUI Programs page has additional information.

Jupyter Hub and Jupyter Notebooks and Managing Conda/Mamba Environments

This session covers using Jupyter Notebooks through https://jhub.rc.ufl.edu and Open on Demand.

For additional information on Jupyter at Research Computing see the Jupyter Notebooks page.

This session is available as a pre-recorded training and zoom recording: Play icon.png ZoomLogo.png

Git and GitHub.com

Slides for the presentation are at:Github logo.pnghttps://ufresearchcomputing.github.io/git-training/#/
The hands-on content is in the main branch of the repository at:Github logo.pnghttps://github.com/UFResearchComputing/git-training

ZoomLogo.png Recording of the December 1, 2022 session

Orientation Material for Courses using HiPerGator

For UF courses that use HiPerGator, please review our policies on teaching use of HiPerGator.

Recording of the training is available here: Play icon.png

The most recent slides can be downloaded from here and have also been shared with your professor.