Difference between revisions of "Training"

From UFRC
Jump to navigation Jump to search
(Remove outdated training material)
Line 1: Line 1:
__NOTOC__
 
 
[[Category:Training]]
 
[[Category:Training]]
==Training Overview==
+
{|align=right
At UF Research Computing we strive to make our resources accessible, efficient, and easy to use. An important part of the effective research computing is the knowledge of how to apply the many available tools in a productive and efficient manner. The comprehensive and clear documentation, well-structured training, and individual help that we provide are all means of achieving that goal. We run a series of training sessions and tutorials during each semester of the school year and in the Summer.
+
  |__TOC__
 +
  |}
 +
=Training and Videos=
  
'''Much of our training content has migrated to the [https://training.it.ufl.edu/ UFIT Training page].''' The training schedule below is still maintained, though we are in the process of migrating videos to the UFIT page. With the transition to HiPerGator 2.0, much of the content below is out of date and will be removed as new material is placed on the UFIT training page.
 
 
You can request a [https://training.it.ufl.edu/services/training-service-requests/ Group Training Session] for your group.
 
  
 +
==In-Person Training sessions==
 +
{| class="wikitable" style="float:right; margin-left: 10px; width: 50%;"
 +
|
 
==Training Schedule==
 
==Training Schedule==
 
{{#widget:Google Calendar
 
{{#widget:Google Calendar
 
|height=400
 
|height=400
|width=75%
+
|width=100%
 
|view=AGENDA
 
|view=AGENDA
 
|id=u2lnbulnfkcgg44pqksmup4cm8@group.calendar.google.com
 
|id=u2lnbulnfkcgg44pqksmup4cm8@group.calendar.google.com
Line 18: Line 19:
 
}}
 
}}
  
 +
|}
 +
 +
Research Computing runs regular in-person training sessions throughout the year. These sessions are free and open to all UF researchers. Most sessions include hands-on exercises and users are encouraged to bring their own computers.
 +
 +
In addition to the regularly scheduled sessions, you can request a [https://training.it.ufl.edu/services/training-service-requests/ Group Training Session] for your group.
 +
 +
Many of the sessions are also available as pre-recorded videos linked from this page and also listed on the [https://training.it.ufl.edu/training/ UFIT Training page].
 +
 +
 +
 +
==Quick Help Videos==
 +
The following videos are designed to provide quick help for users on various topics. Most are only a few minutes long.
 +
 +
Please let us know if there are additional topics that you feel would be useful for a quick help video.
 +
 +
===Connecting to HiPerGator===
 +
{|
 +
|-
 +
| '''[https://mediasite.video.ufl.edu/Mediasite/Play/0b238bfffb684fd6b7306129af63a6711d ssh from MacOS]''' [2 min, 22 sec]: This video demonstrates launching the MacOS Terminal, logging into HiPerGator at hpg.rc.ufl.edu using ssh, and demonstration of the user's /home and /ufrc directories.
 +
 +
The HiPerGator hostname is: hpg.rc.ufl.edu
 +
 +
Your username and password are your Gatorlink username and password.
 +
 +
 +
|| [[File:Ssh.mac.png|thumbnail|link=https://mediasite.video.ufl.edu/Mediasite/Play/0b238bfffb684fd6b7306129af63a6711d]]
 +
|-
 +
|'''[https://mediasite.video.ufl.edu/Mediasite/Play/2bf4c860f19b48a593fb581018b813a11d ssh from Windows]''' [3 min, 41 sec]: This video covers download and installation of the Windows ssh client MobaXterm, logging into HiPerGator at hpg.rc.ufl.edu using ssh, demonstration of /home and /ufrc directories and copy/paste on Windows ssh clients.
 +
 +
 +
'''The HiPerGator hostname is:''' hpg.rc.ufl.edu
 +
 +
Your username and password are your Gatorlink username and password.
 +
 +
 +
|| [[File:Mobaxterm.video.png|thumbnail|link= https://mediasite.video.ufl.edu/Mediasite/Play/2bf4c860f19b48a593fb581018b813a11d]]
 +
|}
 +
 +
===Data Transfer===
 +
{|
 +
|-
 +
| '''[https://mediasite.video.ufl.edu/Mediasite/Play/873a2b08bf1d4ccda49a51f5c84692491d SFTP transfer with FileZilla]''' [2 min, 12 sec]: This video demonstrates using the FileZilla SFTP client to transfer data to/from HiPerGator.
 +
 +
'''The HiPerGator hostname is:''' hpg.rc.ufl.edu ('''note:''' for larger transfers, you may have better network performance with the host: sftp.rc.ufl.edu )
 +
 +
Your username and password are your Gatorlink username and password.
 +
 +
'''The port for SFTP transfers is:''' 22
 +
 +
||[[File:Filezilla.video.png|thumbnail|link= https://mediasite.video.ufl.edu/Mediasite/Play/873a2b08bf1d4ccda49a51f5c84692491d]]
 +
 +
|-
 +
| '''Data transfer with Globus'''
 +
 +
Coming soon. View [https://help.rc.ufl.edu/doc/Globus Globus page] for overview.
 +
 +
|-
 +
| '''Data transfer with Samba'''
 +
 +
Coming soon. View [https://help.rc.ufl.edu/doc/Samba_Access Samba page] for overview.
 +
 +
|}
 +
 +
 +
===/home snapshots===
 +
{|
 +
|-
 +
| '''[https://mediasite.video.ufl.edu/Mediasite/Play/79fb67818dc6467eac6271561c7e20ce1d Restoring Files in /home from snapshots]''' [5 min, 43 sec]
 +
A small home directory (20GB quota) is provided for HiPerGator users, which '''is not intended for high performance work'''. Your /home area is intended for source code, scripts, and other human-readable data; the amount of data stored in your /home area should be kept to a minimum. Home directories have one week of daily snapshots available, which can be accessed by the user to recover older versions of files or accidentally deleted files. This video shows how to restore these files.
 +
|| [[File:Snapshot.video.png|thumbnail|link=https://mediasite.video.ufl.edu/Mediasite/Play/79fb67818dc6467eac6271561c7e20ce1d]]
 +
|}
 +
 +
==Training Videos==
 +
In addition to the in-person training sessions, we provide pre-recorded content for many of our sessions.
 +
 +
=== Introduction to Research Computing and HiPerGator===
 +
 +
Intended for new users, this training provides a general overview of the UF Research Computing facilities and basic usage of HiPerGator. This training is available as a single webinar or face-to-face session, or may be viewed as a three-part series below.
 +
 +
[[File:IntrotoRC.video.png|thumbnail|center|link=https://training.it.ufl.edu/training/items/introduction-to-research-computing-and-hipergator.html]]
 +
 +
===Introduction to the Linux Command Line===
 +
This session will lead participants through some exercises that go over basic Linux commands such as moving around the file system, making directories, moving and copying files, etc. We will also go over some of the applications you can use on your computer to connect to and move files to and from HiPerGator. This session is largely aimed at users who are new to the Command Line.
 +
 +
[[File:LinuxCLI.video.png|thumbnail|center|link=https://training.it.ufl.edu/training/items/introduction-to-linux-command-line.html]]
 +
 +
Download the [https://training.it.ufl.edu/media/trainingitufledu/documents/research-computing/INTRO-TO-LINUX-COMMAND-LINE.pdf Handout] used for the hands-on section of this training. The molecules folder used in the training is at <code>/ufrc/data/training/LinuxCLI/molecules</code>.
 +
 +
For those wishing to use this training outside of HiPerGator, the molecules folder is part of the [https://swcarpentry.github.io/shell-novice/ Software Carpentry Unix Shell] training available in the [https://swcarpentry.github.io/shell-novice/data/data-shell.zip data-shell.zip] file on the [https://swcarpentry.github.io/shell-novice/setup.html setup page]. This can be downloaded to you own computer and run using the Mac/Linux Terminal or [https://mobaxterm.mobatek.net/ MobaXterm] terminal on Windows.
 +
 +
 +
===HiPerGator: SLURM Submission Scripts===
 +
 +
In this session, participants will practice working with SLURM submission scripts using sample files. The training will cover the most common scheduler directives and how to tell SLURM the information it needs to run your jobs efficiently. Example scripts will be provided, though users are encouraged to bring their own scripts to work with. This session assumes a basic familiarity with the Unix command line and will be aimed at beginning to intermediate users. See the Introduction to the Linux Command Line Training for help with Linux.
  
 +
This video is approximately 30 minutes and includes a demonstration.
 +
[[File:SLURM.video.png|thumbnail|center|link=https://training.it.ufl.edu/training/items/hipergator-slurm-submission-scripts.html]]
  
 +
The files used in this video are on the [[Sample_SLURM_Scripts]] page and on the cluster in <code>/ufrc/data/training/SLURM/</code>.
  
 
==Additional Training Opportunities==
 
==Additional Training Opportunities==

Revision as of 18:44, 26 February 2019

Training and Videos

In-Person Training sessions

Training Schedule

Research Computing runs regular in-person training sessions throughout the year. These sessions are free and open to all UF researchers. Most sessions include hands-on exercises and users are encouraged to bring their own computers.

In addition to the regularly scheduled sessions, you can request a Group Training Session for your group.

Many of the sessions are also available as pre-recorded videos linked from this page and also listed on the UFIT Training page.


Quick Help Videos

The following videos are designed to provide quick help for users on various topics. Most are only a few minutes long.

Please let us know if there are additional topics that you feel would be useful for a quick help video.

Connecting to HiPerGator

ssh from MacOS [2 min, 22 sec]: This video demonstrates launching the MacOS Terminal, logging into HiPerGator at hpg.rc.ufl.edu using ssh, and demonstration of the user's /home and /ufrc directories.

The HiPerGator hostname is: hpg.rc.ufl.edu

Your username and password are your Gatorlink username and password.


Ssh.mac.png
ssh from Windows [3 min, 41 sec]: This video covers download and installation of the Windows ssh client MobaXterm, logging into HiPerGator at hpg.rc.ufl.edu using ssh, demonstration of /home and /ufrc directories and copy/paste on Windows ssh clients.


The HiPerGator hostname is: hpg.rc.ufl.edu

Your username and password are your Gatorlink username and password.


Mobaxterm.video.png

Data Transfer

SFTP transfer with FileZilla [2 min, 12 sec]: This video demonstrates using the FileZilla SFTP client to transfer data to/from HiPerGator.

The HiPerGator hostname is: hpg.rc.ufl.edu (note: for larger transfers, you may have better network performance with the host: sftp.rc.ufl.edu )

Your username and password are your Gatorlink username and password.

The port for SFTP transfers is: 22

Filezilla.video.png
Data transfer with Globus

Coming soon. View Globus page for overview.

Data transfer with Samba

Coming soon. View Samba page for overview.


/home snapshots

Restoring Files in /home from snapshots [5 min, 43 sec]

A small home directory (20GB quota) is provided for HiPerGator users, which is not intended for high performance work. Your /home area is intended for source code, scripts, and other human-readable data; the amount of data stored in your /home area should be kept to a minimum. Home directories have one week of daily snapshots available, which can be accessed by the user to recover older versions of files or accidentally deleted files. This video shows how to restore these files.

Snapshot.video.png

Training Videos

In addition to the in-person training sessions, we provide pre-recorded content for many of our sessions.

Introduction to Research Computing and HiPerGator

Intended for new users, this training provides a general overview of the UF Research Computing facilities and basic usage of HiPerGator. This training is available as a single webinar or face-to-face session, or may be viewed as a three-part series below.

IntrotoRC.video.png

Introduction to the Linux Command Line

This session will lead participants through some exercises that go over basic Linux commands such as moving around the file system, making directories, moving and copying files, etc. We will also go over some of the applications you can use on your computer to connect to and move files to and from HiPerGator. This session is largely aimed at users who are new to the Command Line.

LinuxCLI.video.png

Download the Handout used for the hands-on section of this training. The molecules folder used in the training is at /ufrc/data/training/LinuxCLI/molecules.

For those wishing to use this training outside of HiPerGator, the molecules folder is part of the Software Carpentry Unix Shell training available in the data-shell.zip file on the setup page. This can be downloaded to you own computer and run using the Mac/Linux Terminal or MobaXterm terminal on Windows.


HiPerGator: SLURM Submission Scripts

In this session, participants will practice working with SLURM submission scripts using sample files. The training will cover the most common scheduler directives and how to tell SLURM the information it needs to run your jobs efficiently. Example scripts will be provided, though users are encouraged to bring their own scripts to work with. This session assumes a basic familiarity with the Unix command line and will be aimed at beginning to intermediate users. See the Introduction to the Linux Command Line Training for help with Linux.

This video is approximately 30 minutes and includes a demonstration.

SLURM.video.png

The files used in this video are on the Sample_SLURM_Scripts page and on the cluster in /ufrc/data/training/SLURM/.

Additional Training Opportunities

In addition to the training sessions coordinated by UF Research Computing, we are aware of many training opportunities provided by other institutions and vendors. These are listed below.


Intel Software Tools Technical Webinar Series

This free webinar series presents tools, tips, and techniques that will help sharpen your development skills on developing and improving your high performance compute applications for multicore and manycore on Intel® Xeon® processors and Intel® Xeon Phi™ coprocessors. Expert technical teams at Intel as well as open source innovators discuss development tools, programming models, vectorization and execution models that will get your development efforts powered up to get the best out of your applications and platforms.

Full schedule and registration information is available here.


XSEDE

The Extreme Science and Engineering Discovery Environment online training mostly lists html tutorials offered at the Cornell University. Offered tutorials cover general programming, scripting, parallel programming (concepts, message passing interface (MPI), openmp), visualisation, code improvement, and other topics.

The XSEDE Training Calendar includes many useful webcasts that are provided by a number of institutions. For most events registration is required.

TACC

Many TACC online training sessions are webcast and are listed in the XSEDE Training Calendar above. Training materials, recordings and webcasts are available from the TACC Course Materials site.