Difference between revisions of "Training Videos"

From UFRC
Jump to navigation Jump to search
Line 16: Line 16:
 
| style="width: 30%"|
 
| style="width: 30%"|
 
==Connecting to HiPerGator==
 
==Connecting to HiPerGator==
 +
 +
{|style="margin: auto;"
 +
|-
 +
[[File:DEMO.png|alt="How to videos"|400px|link=https://mediasite.video.ufl.edu/Mediasite/Play/227c2cae1147422c91afff28435a51ac1d]]||
 +
|}
 
===[https://mediasite.video.ufl.edu/Mediasite/Play/89b780ef71094f568a6c091953445ff31d ssh from MacOS]===
 
===[https://mediasite.video.ufl.edu/Mediasite/Play/89b780ef71094f568a6c091953445ff31d ssh from MacOS]===
 
[[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/89b780ef71094f568a6c091953445ff31d]] [5 min, 11 sec]
 
[[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/89b780ef71094f568a6c091953445ff31d]] [5 min, 11 sec]
Line 44: Line 49:
 
* Upload, download and edit files via your browser
 
* Upload, download and edit files via your browser
 
!
 
!
 +
 
==Data Transfer==
 
==Data Transfer==
  

Revision as of 13:48, 1 November 2022


Quick How Tos

How To Videos.png

The following videos are designed to provide quick help for users on various topics. Most are only a few minutes long.

Please let us know if there are additional topics that you feel would be useful for a quick help video.

Visit the main training page for additional training information.

Connecting to HiPerGator

400px||

ssh from MacOS

Play icon.png [5 min, 11 sec] This video demonstrates launching the MacOS Terminal, logging into HiPerGator at hpg.rc.ufl.edu using ssh, and demonstration of the user's /home and /blue directories and checking quotas.

  • The HiPerGator hostname is: hpg.rc.ufl.edu
  • For UF users, your username and password are your Gatorlink username and password.

ssh from Windows

Play icon.png [7 min, 19 sec] This video covers use of the Windows command prompt and Bitvise, logging into HiPerGator at hpg.rc.ufl.edu using ssh, demonstration of /home and /blue directories and checking on quotas.

  • The HiPerGator hostname is: hpg.rc.ufl.edu
  • For UF users, your username and password are your GatorLink username and password.

Using Jupyter Notebooks on HiPerGator

Play icon.png [8 min, 1 sec] This video covers the use of Jupyter Notebooks via https://jhub.rc.ufl.edu/ to run Python, R and other notebooks on HiPerGator.

  • Connect to https://jhub.rc.ufl.edu/
  • Launch notebooks in various coding languages
  • Launch a terminal
  • Upload and download files via your browser

Using Open on Demand on HiPerGator

Play icon.png [5 min, 11 sec] This video covers the use of Open on Demand https://openondemand.org/ on HiPerGator via https://ood.rc.ufl.edu/.

  • Connect to https://ood.rc.ufl.edu/
  • Launch a terminal
  • Launch many graphical applications like Rstudio, Matlab and Freeview
  • Manage job submission
  • Upload, download and edit files via your browser

Data Transfer

Data transfer with Globus

Play icon.png[4 min, 22 sec]

This video demonstrates the basics of:

  • Logging in to Globus.org using UF Gatorlink credentials.
  • Connecting to the UFRC main endpoint at ufrc#hpg2
  • Connecting to another endpoint for data transfer
  • Transferring a file
  • Additional options for file transfer, including folder synchronization and encryption.

View Globus page for overview.

Setting up Globus Connect Personal

Play icon.png[3 min, 24 sec]

This video demonstrates the basics of:

  • Establishing a Globus Connect Endpoint for your computer
  • Installing the Globus Connect Personal client
  • Using the setup key to initialize your client.

Setting up a shared end-point with Globus

Play icon.png[3 min, 42 sec]

This video demonstrates the basics of:

  • Connecting to the ufrc#hpg2 endpoint
  • Designating a folder as a shared endpoint
  • Setting share options
  • Creating a Globus group

View Globus page for overview.

Data transfer with Samba

View Samba page for overview.

Samba Access from MacOS

Play icon.png [2 min, 46 sec] This video demonstrate how to mount a UFRC filesystem on your MacOS computer using Samba.

The Mac video mention our older cifs.rc.ufl.edu server. The current server is exasmb.rc.ufl.edu. We are working to update the videos.

Samba Access from Windows

Play icon.png [3 min, 3 sec] This video demonstrate how to mount a /blue filesystem on your Windows computer using Samba.

Storage and Data Management

Restoring Files in /home from snapshots

Play icon.png [5 min, 43 sec]

A small home directory (20GB quota) is provided for HiPerGator users, which is not intended for high performance work. Your /home area is intended for source code, scripts, and other human-readable data; the amount of data stored in your /home area should be kept to a minimum. Home directories have one week of daily snapshots available, which can be accessed by the user to recover older versions of files or accidentally deleted files. This video shows how to restore these files.

Demo of automounted directories in /blue and /orange

Play icon.png [1 min, 36 sec]

A quick demonstration of automounted directories in /blue and /orange. Users are often alarmed by their group directory not showing up. This video shows how automouting works.

Submitting Jobs

Running many short jobs with job arrays

Play icon.png [10 min, 16sec] This video reviews important considerations for running SLURM Job Arrays, especially when the individual tasks are short in duration. The video walks through the example script on the Job array page to help users run multiple short tasks in a single job to maximize their efficiency.

Making Investments in UF Research Computing Resources

Submitting a purchase request

Play icon.png[3 min, 34 sec]

This video covers:


In addition to the in-person training sessions, we provide pre-recorded content for many of our sessions.

Visit the main training page for additional training information.

HiPerGator Account Training

All new HiPerGator users are required to take the HiPerGator Account training. Link and overview on this page.

Prerecorded Training.png

Introduction to Research Computing and HiPerGator

Intended for new users, this training provides a general overview of the UF Research Computing facilities and basic usage of HiPerGator.

This training is available in three parts:

Or as a recording of the most recent Zoom session:

ZoomLogo.png Recording of the January 13, 2022 session.

You can download a copy of the slides used from here.

Introduction to the Linux Command Line

This session will lead participants through some exercises that go over basic Linux commands such as moving around the file system, making directories, moving and copying files, etc. We will also go over some of the applications you can use on your computer to connect to and move files to and from HiPerGator. This session is largely aimed at users who are new to the Command Line.

This session is available as a pre-recorded video: Play icon.png

Or as a recording of a live training session:

ZoomLogo.png Recording of the September 9th, 2021 session

The handout and files for the session are now located in a git repository here: https://github.com/UFResearchComputing/Linux_training

The handout can be downloaded as a PDF file.

The molecules folder used in the training is at /data/training/LinuxCLI/molecules.

For those wishing to use this training outside of HiPerGator, the molecules folder is in the repository in the /data folder. There are also directions for non-HiPerGator use in the non-HiPerGator.md file or as a PDF. The repository can be downloaded to you own computer and run using the Mac/Linux Terminal or MobaXterm terminal on Windows.

HiPerGator: SLURM Submission Scripts

In this session, participants will practice working with SLURM submission scripts using sample files. The training will cover the most common scheduler directives and how to tell SLURM the information it needs to run your jobs efficiently. Example scripts will be provided, though users are encouraged to bring their own scripts to work with. This session assumes a basic familiarity with the Unix command line and will be aimed at beginning to intermediate users. See the Introduction to the Linux Command Line Training for help with Linux.

This session is available as a pre-recorded video: This video is approximately 35 minutes and includes a demonstration. Play icon.png

The files used in this video are on the Sample_SLURM_Scripts page and on the cluster in /data/training/SLURM/.

ZoomLogo.png Recording of the October 6th, 2022 session Note due to Hurricane Ian, this session also includes the MPI content.

HiPerGator: SLURM Submission Scripts for MPI Jobs

This session will go into depth on the details of scheduling MPI jobs on HiPerGator. Efficiently running MPI applications requires an understanding of both how to specify the needed resources as well as the layout and properties of the available hardware. This session will provide examples from several commonly used applications and provide guidelines for users to optimize their own runs.

This session is available as a pre-recorded video:

This video is approximately 25 minutes and includes a demonstration. Play icon.png

The files used in this video are on the Sample_SLURM_Scripts page and on the cluster in /data/training/SLURM/.

ZoomLogo.png Recording of the October 6th, 2022 session Note due to Hurricane Ian, this session includes both the non-MPI and the MPI content.

Running Graphical Applications on HiPerGator

Users can run applications with graphical user interfaces (GUI) on HiPerGator either using Open on Demand or using the gui module and submitting jobs from the command line.

This video provides and overview of Open on Demand, which offers many GUI applications: Play icon.png [5 min, 11 sec]

This video reviews launching additional GUI applications using the gui module to submit jobs from the command line: Play icon.png [5 min, 16 sec]

A recording of the most recent Zoom session, coving both Open on Demand and gui module is also available:

ZoomLogo.png Recording of the Oct. 20, 2022 session

The GUI Programs page has additional information.

Running MATLAB on HiPerGator

Users walk through a hands-on examples using MATLAB at Research Computing. Participants will work with the MATLAB GUI, compiling code and submitting MATLAB jobs to the scheduler to run on the cluster.

This video is approximately 24 minutes and includes a demonstration. Play icon.png

Users should also review the Matlab page for additional information.

Jupyter Hub and Jupyter Notebooks for R, Python and More

This session covers using Jupyter Notebooks through https://jhub.rc.ufl.edu and Open on Demand.


For additional information on Jupyter at Research Computing see the Jupyter Notebooks page.


This session is available as a pre-recorded training: Play icon.png

Git and GitHub.com

While there is not a video associated with this, all of the content is available online.

ZoomLogo.png Recording of the October 14, 2021 session


Getting Started in AI

Image Classification with PyTorch in Jupyter on HiPerGator

This session in our Getting Started with AI series will introduce PyTorch for image classification using Jupyter Notebooks running on HiPerGator.

Users will have hands-on exercises covering the steps of preparing data, and training and validating a neural network model for image classification.

If you are unfamiliar with Jupyter Notebooks, we recommend watching the Jupyter training first.

This training is largely based off of the

The Jupyter notebooks used for the training are on GitHub: link=https://github.com/UFResearchComputing/DL_pytorch_CNN DL_pytorch_CNNDL_pytorch_CNN

Orientation Material for Courses using HiPerGator

For UF courses that use HiPerGator, please review our policies on teaching use of HiPerGator.

Recording of the training is available here: Play icon.png

The most recent slides can be downloaded from here and have also been shared with your professor.