Difference between revisions of "Training Videos"
(46 intermediate revisions by 2 users not shown) | |||
Line 1: | Line 1: | ||
[[Category:Essentials]]__NOTOC__ | [[Category:Essentials]]__NOTOC__ | ||
==Quick How Tos== | ==Quick How Tos== | ||
− | The following videos are designed to provide quick help for users on various topics, most are only a few minutes long. | + | The following videos are designed to provide quick help for users on various topics, most are only a few minutes long. Please let us know if there are additional topics that you feel would be useful for a quick help video. |
− | + | In addition to the pre-recorded content, we also provide in-person training sessions. Visit the [[Trainings|main training page]] for additional training information. | |
− | |||
− | In addition to the pre-recorded content, we also provide in-person training sessions. Visit the [[ | ||
<div style = 'text-align: center;'> | <div style = 'text-align: center;'> | ||
===Connecting to HPG=== | ===Connecting to HPG=== | ||
− | [[ | + | [[Image:SSH_MACOS.png|frameless|upright=0.7| link=https://mediasite.video.ufl.edu/Mediasite/Play/89b780ef71094f568a6c091953445ff31d]] |
− | [[ | + | [[Image:Sshwin.png|frameless|upright=0.7|link=https://mediasite.video.ufl.edu/Mediasite/Play/227c2cae1147422c91afff28435a51ac1d]] |
− | [[ | + | [[Image:Jup.png|frameless|upright=0.7|link=https://mediasite.video.ufl.edu/Mediasite/Play/8efcf534ef3c408e9238d8deeeda083a1d]] |
− | [[ | + | [[Image:Ood.png|frameless|upright=0.7|link=https://mediasite.video.ufl.edu/Mediasite/Play/4654bfa838624de894085bf54678848f1d]] |
===Data Transfer=== | ===Data Transfer=== | ||
− | [[ | + | [[Image:Macsam.png|frameless|upright=0.7|link=https://mediasite.video.ufl.edu/Mediasite/Play/8af63885f3e64f55b938eda14c092b291d]] |
− | [[ | + | [[Image:Winsam.png|frameless|upright=0.7|link=https://mediasite.video.ufl.edu/Mediasite/Play/9ef9efe534814246b4115de01e8411691d]] |
− | [[ | + | [[Image:GDT.png|frameless|upright=0.7|link=https://mediasite.video.ufl.edu/Mediasite/Play/1c74e8bfd7e74447a13885cdaa033f461d]] |
− | [[ | + | [[Image:GCP.png|frameless|upright=0.7| 200px|link=https://mediasite.video.ufl.edu/Mediasite/Play/81b2234b09d84d0ebf5d4ca47b35712b1d]] |
− | [[ | + | [[Image:Shared.png|frameless|upright=0.7|link=https://mediasite.video.ufl.edu/Mediasite/Play/98f7c82da478426298f95e6b9fbbac2a1d]] |
===Other How Tos=== | ===Other How Tos=== | ||
− | [[ | + | [[Image:FRS.png|frameless|upright=0.7|link=https://mediasite.video.ufl.edu/Mediasite/Play/79fb67818dc6467eac6271561c7e20ce1d]] |
− | [[ | + | [[Image:DEM.png|frameless|upright=0.7|link=https://mediasite.video.ufl.edu/Mediasite/Play/828d67ceed634ab4bce083c0cab7b1431d]] |
− | [[ | + | [[Image:SJA.png|frameless|upright=0.7|link=https://mediasite.video.ufl.edu/Mediasite/Play/5bbd7cfb22b2416bbb0541e79875def51d]] |
− | [[ | + | [[Image:SPR.png|frameless|upright=0.7|link=https://mediasite.video.ufl.edu/Mediasite/Play/e0eb646aa861441785133060757d78861d]] |
</div> | </div> | ||
+ | |||
==Recorded Trainings== | ==Recorded Trainings== | ||
+ | |||
+ | For the topics below, the link on the orange and blue play icon ([[File:Play_icon.png|frameless|30px]]) links to a studio recorded version of the training material. Those tend to be higher quality, but also older and potentially somewhat outdated. The Zoom icon ([[File:ZoomLogo.png|frameless|50px]]) links to the most recent recording of a live session. The Zoom recordings may have participant Q&A and additional information added during a live session, but tend to be the most recent information. | ||
+ | |||
{| cellspacing="30" cellpadding="0" width="100%" | {| cellspacing="30" cellpadding="0" width="100%" | ||
|- valign="top" | |- valign="top" | ||
Line 33: | Line 35: | ||
=== HiPerGator Account Training === | === HiPerGator Account Training === | ||
− | All new HiPerGator users are required to take the HiPerGator Account training | + | {{Note | ''All'' new HiPerGator users are required to take the HiPerGator Account training: '''[[New user training|Link and overview on this page]]'''.|warn}} |
=== Introduction to Research Computing and HiPerGator=== | === Introduction to Research Computing and HiPerGator=== | ||
− | Intended for new users, this training provides a general overview of the UF Research Computing facilities and basic usage of HiPerGator. | + | Intended for new users, this training provides a general overview of the UF Research Computing facilities and basic usage of HiPerGator. <br> |
− | |||
This training is available in three parts: | This training is available in three parts: | ||
* [https://mediasite.video.ufl.edu/Mediasite/Play/69473454b72740579e1d2f406241834c1d Part 1: Intro to UF Research Computing and HiPerGator] [[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/69473454b72740579e1d2f406241834c1d]] | * [https://mediasite.video.ufl.edu/Mediasite/Play/69473454b72740579e1d2f406241834c1d Part 1: Intro to UF Research Computing and HiPerGator] [[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/69473454b72740579e1d2f406241834c1d]] | ||
* [https://mediasite.video.ufl.edu/Mediasite/Play/80b0e4c850ff4835aa55dfcb7789b5f01d Part 2: Getting logged in, storage and using HiPerGator] [[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/80b0e4c850ff4835aa55dfcb7789b5f01d]] | * [https://mediasite.video.ufl.edu/Mediasite/Play/80b0e4c850ff4835aa55dfcb7789b5f01d Part 2: Getting logged in, storage and using HiPerGator] [[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/80b0e4c850ff4835aa55dfcb7789b5f01d]] | ||
* [https://mediasite.video.ufl.edu/Mediasite/Play/bc7ded7444ac4ad6b3b91cd42dc88ede1d Part 3: Working with the SLURM Scheduler to run Jobs] [[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/bc7ded7444ac4ad6b3b91cd42dc88ede1d]] | * [https://mediasite.video.ufl.edu/Mediasite/Play/bc7ded7444ac4ad6b3b91cd42dc88ede1d Part 3: Working with the SLURM Scheduler to run Jobs] [[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/bc7ded7444ac4ad6b3b91cd42dc88ede1d]] | ||
− | + | Or as a recording of the most recent Zoom session:[[File:ZoomLogo.png|frameless|50px|link=https://ufl.zoom.us/rec/share/DtzIP1b7PAyxqhWq0Q2q-mhSLpewbN-2bWdXDzKKVhy4SDva1-SYCdlAVosgg8QS.N6Kq88YnTtX47TbJ?startTime=1725547197000]][https://ufl.zoom.us/rec/share/DtzIP1b7PAyxqhWq0Q2q-mhSLpewbN-2bWdXDzKKVhy4SDva1-SYCdlAVosgg8QS.N6Kq88YnTtX47TbJ?startTime=1725547197000 Recording of the Sept. 5, 2024 session].<br> | |
− | Or as a recording of the most recent Zoom session:[[File:ZoomLogo.png|frameless|50px|link=https://ufl.zoom.us/rec/share/ | + | You can [https://www.dropbox.com/s/ei6xrdpv695f0fo/RC_Intro_to_RC.pdf?dl=0 download a copy of the slides used from here].<br> |
− | |||
− | You can [https://www.dropbox.com/s/ei6xrdpv695f0fo/RC_Intro_to_RC.pdf?dl=0 download a copy of the slides used from here]. | ||
===Introduction to the Linux Command Line=== | ===Introduction to the Linux Command Line=== | ||
− | This session will lead | + | This session will lead users new to the Command Line through some exercises that go over basic Linux commands. These include moving around the file system, making directories, moving and copying files, etc. We will also go over some of the applications you can use on your computer to connect to and move files to and from HiPerGator. |
− | |||
− | |||
− | |||
− | |||
− | + | This session is available as a pre-recorded video or Zoom recording: [[File:Play_icon.png|frameless|30px|link=https://training.it.ufl.edu/training/items/introduction-to-linux-command-line.html]] [[File:ZoomLogo.png|frameless|50px|https://ufl.zoom.us/rec/share/r8k-s4DZ1OBfrNcRKKiD_cw3iwT424NC042kX3dorK40VHpMb7Om7hN1ouOEWZA.Jok4hF68KZcgQyow?startTime=1706197225000]] | |
+ | The handout and files for the session are now located in a git repository here: https://github.com/UFResearchComputing/Linux_training<br> | ||
The handout can be [https://github.com/UFResearchComputing/Linux_training/blob/main/README.pdf downloaded as a PDF file]. | The handout can be [https://github.com/UFResearchComputing/Linux_training/blob/main/README.pdf downloaded as a PDF file]. | ||
− | The molecules folder used in the training is at <code>/data/training/LinuxCLI/molecules</code>. | + | The <code>molecules</code> folder used in the training is at <code>/data/training/LinuxCLI/molecules</code>. |
− | For those wishing to use this training outside of HiPerGator, the molecules folder is in the | + | For those wishing to use this training outside of HiPerGator, the <code>molecules</code> folder is in the <code>data</code> folder in the repository. There are also directions for non-HiPerGator use in the [https://github.com/UFResearchComputing/Linux_training/blob/main/non_HiPerGator.md non-HiPerGator.md] file or as a [https://github.com/UFResearchComputing/Linux_training/blob/main/non_HiPerGator.pdf PDF]. The repository can be downloaded to your own computer and run there. |
===HiPerGator: SLURM Submission Scripts=== | ===HiPerGator: SLURM Submission Scripts=== | ||
− | In this session, participants will practice working with SLURM submission scripts using sample files. The training will cover the most common scheduler directives and how to tell SLURM the information it needs to run your jobs efficiently | + | In this session, participants will practice working with SLURM submission scripts using sample files, but are encourage to bring their own scripts as well. The training will cover the most common scheduler directives and how to tell SLURM the information it needs to run your jobs efficiently. This session assumes a basic familiarity with the Unix command line and will be aimed at beginning to intermediate users. See the Introduction to the Linux Command Line Training for help with Linux. |
This session is available as a pre-recorded video: | This session is available as a pre-recorded video: | ||
Line 72: | Line 68: | ||
The files used in this video are on the [[Sample_SLURM_Scripts]] page and on the cluster in <code>/data/training/SLURM/</code>. | The files used in this video are on the [[Sample_SLURM_Scripts]] page and on the cluster in <code>/data/training/SLURM/</code>. | ||
− | [[File:ZoomLogo.png|frameless|50px|link=https://ufl.zoom.us/rec/share/ | + | The slides from the training can be [https://www.dropbox.com/scl/fi/ndgdrxe7zrnhdcu3ro1ke/RC_SLURM.pdf?rlkey=dc3dinh00t6v1orvopbul1sf7&dl=0 downloaded here]. |
+ | |||
+ | [[File:ZoomLogo.png|frameless|50px|link=https://ufl.zoom.us/rec/share/J6LbLhBVVetNHbHmnAb59YLHSGgA6qbuOyi0V1FkNdxVqr-RdNi0fbMp5yPiIHs.LIRXLIwNPiSuMEdm?startTime=1726756814000]] [https://ufl.zoom.us/rec/share/J6LbLhBVVetNHbHmnAb59YLHSGgA6qbuOyi0V1FkNdxVqr-RdNi0fbMp5yPiIHs.LIRXLIwNPiSuMEdm?startTime=1726756814000 Recording of the Sept. 19, 2024 session]. | ||
+ | |||
===Getting Started in AI=== | ===Getting Started in AI=== | ||
− | |||
This session in our Getting Started with AI series will introduce PyTorch for image classification using Jupyter Notebooks running on HiPerGator. | This session in our Getting Started with AI series will introduce PyTorch for image classification using Jupyter Notebooks running on HiPerGator. | ||
Users will have hands-on exercises covering the steps of preparing data, and training and validating a neural network model for image classification. | Users will have hands-on exercises covering the steps of preparing data, and training and validating a neural network model for image classification. | ||
− | If you are unfamiliar with Jupyter Notebooks, we recommend watching the [[ | + | If you are unfamiliar with Jupyter Notebooks, we recommend watching the [[Training Videos#Jupyter_Hub_and_Jupyter_Notebooks_for_R.2C_Python_and_More|Jupyter training first]]. |
− | |||
− | |||
The Jupyter notebooks used for the training are on GitHub: [[File:Github logo.png|frameless|25px|link=https://github.com/UFResearchComputing/DL_pytorch_CNN DL_pytorch_CNN]][https://github.com/UFResearchComputing/DL_pytorch_CNN DL_pytorch_CNN] | The Jupyter notebooks used for the training are on GitHub: [[File:Github logo.png|frameless|25px|link=https://github.com/UFResearchComputing/DL_pytorch_CNN DL_pytorch_CNN]][https://github.com/UFResearchComputing/DL_pytorch_CNN DL_pytorch_CNN] | ||
− | |||
− | |||
|} | |} | ||
|| | || | ||
Line 92: | Line 86: | ||
|- valign="top" | |- valign="top" | ||
{| width="100%" | {| width="100%" | ||
+ | |||
===HiPerGator: SLURM Submission Scripts for MPI Jobs=== | ===HiPerGator: SLURM Submission Scripts for MPI Jobs=== | ||
This session will go into depth on the details of scheduling MPI jobs on HiPerGator. Efficiently running MPI applications requires an understanding of both how to specify the needed resources as well as the layout and properties of the available hardware. This session will provide examples from several commonly used applications and provide guidelines for users to optimize their own runs. | This session will go into depth on the details of scheduling MPI jobs on HiPerGator. Efficiently running MPI applications requires an understanding of both how to specify the needed resources as well as the layout and properties of the available hardware. This session will provide examples from several commonly used applications and provide guidelines for users to optimize their own runs. | ||
− | |||
− | |||
This video is approximately 25 minutes and includes a demonstration. | This video is approximately 25 minutes and includes a demonstration. | ||
Line 103: | Line 96: | ||
The files used in this video are on the [[Sample_SLURM_Scripts]] page and on the cluster in <code>/data/training/SLURM/</code>. | The files used in this video are on the [[Sample_SLURM_Scripts]] page and on the cluster in <code>/data/training/SLURM/</code>. | ||
− | [[File:ZoomLogo.png|frameless|50px|link=https://ufl.zoom.us/rec/share/ | + | The slides used in this workshop can be [https://www.dropbox.com/scl/fi/ndgdrxe7zrnhdcu3ro1ke/RC_SLURM.pdf?rlkey=dc3dinh00t6v1orvopbul1sf7&dl=0 downloaded here]. |
+ | |||
+ | [[File:ZoomLogo.png|frameless|50px|link=https://ufl.zoom.us/rec/share/P-llE16rneblibiSq9zsAzNH7batJBN_eBYHWBEnws_N-JbnljxxFcvkvh7cVRCF.xUCk1wZotqvEAk42?startTime=1695912013000]] [https://ufl.zoom.us/rec/share/P-llE16rneblibiSq9zsAzNH7batJBN_eBYHWBEnws_N-JbnljxxFcvkvh7cVRCF.xUCk1wZotqvEAk42?startTime=1695912013000 Recording of the September 28th, 2023 session]. | ||
===Running Graphical Applications on HiPerGator=== | ===Running Graphical Applications on HiPerGator=== | ||
Line 112: | Line 107: | ||
[[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/4654bfa838624de894085bf54678848f1d]] [5 min, 11 sec] | [[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/4654bfa838624de894085bf54678848f1d]] [5 min, 11 sec] | ||
− | + | The most recent Zoom session, covering Open on Demand is also available: [[File:ZoomLogo.png|frameless|50px|link=https://ufl.zoom.us/rec/share/2kFFjiOBHrslbkZRBduPmkf42v7_oIhm0T6Fibm1NeKKb9BDvPN_7SCHnFrUo8Su.3RZ3xOXIlQBPaPni?startTime=1708011604000]] [https://ufl.zoom.us/rec/share/2kFFjiOBHrslbkZRBduPmkf42v7_oIhm0T6Fibm1NeKKb9BDvPN_7SCHnFrUo8Su.3RZ3xOXIlQBPaPni?startTime=1708011604000 Recording of the February 15th, 2024 session]. | |
− | |||
− | |||
− | |||
The [[GUI Programs]] page has additional information. | The [[GUI Programs]] page has additional information. | ||
− | + | ===Jupyter Hub and Jupyter Notebooks and Managing Conda/Mamba Environments=== | |
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | ===Jupyter Hub and Jupyter Notebooks | ||
This session covers using Jupyter Notebooks through [https://jhub.rc.ufl.edu https://jhub.rc.ufl.edu] and [https://ood.rc.ufl.edu Open on Demand]. | This session covers using Jupyter Notebooks through [https://jhub.rc.ufl.edu https://jhub.rc.ufl.edu] and [https://ood.rc.ufl.edu Open on Demand]. | ||
Line 134: | Line 117: | ||
For additional information on Jupyter at Research Computing see the [[Jupyter Notebooks]] page. | For additional information on Jupyter at Research Computing see the [[Jupyter Notebooks]] page. | ||
− | This session is available as a pre-recorded training: [[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/1afd6f069ab44ebaa0b91c39c876e9d41d]] | + | This session is available as a pre-recorded training and zoom recording: [[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/1afd6f069ab44ebaa0b91c39c876e9d41d]] [[File:ZoomLogo.png|frameless|50px|link=https://ufl.zoom.us/rec/share/AxsUTFdDzBAIIrABSagX4l6KSBf8ijXTzg0fvvdCd770G3kTcmhC6U-v8DcI6NzG.IBXQHjNasHSM5UtF?startTime=1677771682000]] |
===Git and GitHub.com=== | ===Git and GitHub.com=== | ||
− | + | Slides for the presentation are at:[[File:Github logo.png|frameless|25px|link=https://ufresearchcomputing.github.io/git-training/#/]]https://ufresearchcomputing.github.io/git-training/#/<br> | |
− | + | The hands-on content is in the <code>main</code> branch of the repository at:[[File:Github logo.png|frameless|25px|link=https://github.com/UFResearchComputing/git-training]]https://github.com/UFResearchComputing/git-training | |
− | |||
− | [[File:ZoomLogo.png|frameless|50px|link=https://ufl.zoom.us/rec/share/ | + | [[File:ZoomLogo.png|frameless|50px|link=https://ufl.zoom.us/rec/share/BTjCd6pf0dNq1MYaKjP9B49Ct6y8ngYDgTLuxuvWihwXnfza53lu28Qtfwr5o7k1.JhLwt_F813r7zQBf?startTime=1669909303000]] [https://ufl.zoom.us/rec/share/BTjCd6pf0dNq1MYaKjP9B49Ct6y8ngYDgTLuxuvWihwXnfza53lu28Qtfwr5o7k1.JhLwt_F813r7zQBf?startTime=1669909303000 Recording of the December 1, 2022 session] |
===Orientation Material for Courses using HiPerGator=== | ===Orientation Material for Courses using HiPerGator=== |
Latest revision as of 18:03, 19 September 2024
Quick How Tos
The following videos are designed to provide quick help for users on various topics, most are only a few minutes long. Please let us know if there are additional topics that you feel would be useful for a quick help video.
In addition to the pre-recorded content, we also provide in-person training sessions. Visit the main training page for additional training information.
Recorded Trainings
For the topics below, the link on the orange and blue play icon () links to a studio recorded version of the training material. Those tend to be higher quality, but also older and potentially somewhat outdated. The Zoom icon () links to the most recent recording of a live session. The Zoom recordings may have participant Q&A and additional information added during a live session, but tend to be the most recent information.
HiPerGator Account Training All new HiPerGator users are required to take the HiPerGator Account training: Link and overview on this page. Introduction to Research Computing and HiPerGatorIntended for new users, this training provides a general overview of the UF Research Computing facilities and basic usage of HiPerGator.
Or as a recording of the most recent Zoom session:Recording of the Sept. 5, 2024 session. Introduction to the Linux Command LineThis session will lead users new to the Command Line through some exercises that go over basic Linux commands. These include moving around the file system, making directories, moving and copying files, etc. We will also go over some of the applications you can use on your computer to connect to and move files to and from HiPerGator. This session is available as a pre-recorded video or Zoom recording: The handout and files for the session are now located in a git repository here: https://github.com/UFResearchComputing/Linux_training The For those wishing to use this training outside of HiPerGator, the HiPerGator: SLURM Submission ScriptsIn this session, participants will practice working with SLURM submission scripts using sample files, but are encourage to bring their own scripts as well. The training will cover the most common scheduler directives and how to tell SLURM the information it needs to run your jobs efficiently. This session assumes a basic familiarity with the Unix command line and will be aimed at beginning to intermediate users. See the Introduction to the Linux Command Line Training for help with Linux. This session is available as a pre-recorded video: This video is approximately 35 minutes and includes a demonstration. The files used in this video are on the Sample_SLURM_Scripts page and on the cluster in The slides from the training can be downloaded here. Recording of the Sept. 19, 2024 session. Getting Started in AIThis session in our Getting Started with AI series will introduce PyTorch for image classification using Jupyter Notebooks running on HiPerGator. Users will have hands-on exercises covering the steps of preparing data, and training and validating a neural network model for image classification. If you are unfamiliar with Jupyter Notebooks, we recommend watching the Jupyter training first. The Jupyter notebooks used for the training are on GitHub: DL_pytorch_CNN |
HiPerGator: SLURM Submission Scripts for MPI JobsThis session will go into depth on the details of scheduling MPI jobs on HiPerGator. Efficiently running MPI applications requires an understanding of both how to specify the needed resources as well as the layout and properties of the available hardware. This session will provide examples from several commonly used applications and provide guidelines for users to optimize their own runs. This video is approximately 25 minutes and includes a demonstration. The files used in this video are on the Sample_SLURM_Scripts page and on the cluster in The slides used in this workshop can be downloaded here. Recording of the September 28th, 2023 session. Running Graphical Applications on HiPerGatorUsers can run applications with graphical user interfaces (GUI) on HiPerGator either using Open on Demand or using the gui module and submitting jobs from the command line. This video provides and overview of Open on Demand, which offers many GUI applications: [5 min, 11 sec] The most recent Zoom session, covering Open on Demand is also available: Recording of the February 15th, 2024 session. The GUI Programs page has additional information. Jupyter Hub and Jupyter Notebooks and Managing Conda/Mamba EnvironmentsThis session covers using Jupyter Notebooks through https://jhub.rc.ufl.edu and Open on Demand. For additional information on Jupyter at Research Computing see the Jupyter Notebooks page. This session is available as a pre-recorded training and zoom recording: Git and GitHub.comSlides for the presentation are at:https://ufresearchcomputing.github.io/git-training/#/ Recording of the December 1, 2022 session Orientation Material for Courses using HiPerGatorFor UF courses that use HiPerGator, please review our policies on teaching use of HiPerGator. Recording of the training is available here: The most recent slides can be downloaded from here and have also been shared with your professor. |