|
|
| (45 intermediate revisions by 4 users not shown) |
| Line 1: |
Line 1: |
| − | [[Category:Training]] | + | [[Category:Essentials]] |
| | {|align=right | | {|align=right |
| | |__TOC__ | | |__TOC__ |
| | |} | | |} |
| − | | + | ==Live Training Sessions== |
| − | =In-Person Training sessions= | |
| | Research Computing runs regular in-person training sessions throughout the year. These sessions are free and open to all UF researchers. Most sessions include hands-on exercises and users are encouraged to bring their own computers. | | Research Computing runs regular in-person training sessions throughout the year. These sessions are free and open to all UF researchers. Most sessions include hands-on exercises and users are encouraged to bring their own computers. |
| | | | |
| Line 11: |
Line 10: |
| | Many of the sessions are also available as pre-recorded videos linked from this page and also listed on the [https://training.it.ufl.edu/training/ UFIT Training page]. | | Many of the sessions are also available as pre-recorded videos linked from this page and also listed on the [https://training.it.ufl.edu/training/ UFIT Training page]. |
| | | | |
| − | ==Training Schedule== | + | ==Training Videos== |
| | + | |
| | + | There are a number of how-to and other training videos on out [[Training Videos]] page. |
| | + | |
| | + | ===Training Schedule=== |
| | | | |
| | {{#widget:Google Calendar | | {{#widget:Google Calendar |
| − | |height=400
| + | |width=75% |
| − | |width=50% | + | |view=Month |
| − | |view=AGENDA | |
| | |id=u2lnbulnfkcgg44pqksmup4cm8@group.calendar.google.com | | |id=u2lnbulnfkcgg44pqksmup4cm8@group.calendar.google.com |
| | |color=FF4A00 | | |color=FF4A00 |
| − | |title=UFRC Events | + | |id=usa@holiday.calendar.google.com |
| | + | |color=0021A5 |
| | + | |title=UFRC Events, US Holidays |
| | + | |timezone='America/New_York' |
| | }} | | }} |
| | | | |
| | + | ==HiPerGator New User Training in Coursera== |
| | + | See the [[New user training]] page, which mirrors and expands upon the content provided in the HiPerGator Account Training in Coursera. This is a private course, only accessible by the link, it will ''not'' appear in a search on Coursera. |
| | | | |
| − | =Quick Help Videos=
| + | Effective January 11th, 2021, this training module is required for all new account holders to obtain an account. |
| − | The following videos are designed to provide quick help for users on various topics. Most are only a few minutes long.
| |
| − | | |
| − | Please let us know if there are additional topics that you feel would be useful for a quick help video.
| |
| − |
| |
| − | ==Connecting to HiPerGator==
| |
| − | ===[https://mediasite.video.ufl.edu/Mediasite/Play/0b238bfffb684fd6b7306129af63a6711d ssh from MacOS]===
| |
| − | [[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/0b238bfffb684fd6b7306129af63a6711d]] [2 min, 22 sec]
| |
| − | This video demonstrates launching the MacOS Terminal, logging into HiPerGator at hpg.rc.ufl.edu using ssh, and demonstration of the user's /home and /ufrc directories.
| |
| − | * The HiPerGator hostname is: hpg.rc.ufl.edu
| |
| − | * Your username and password are your Gatorlink username and password.
| |
| − | | |
| − | ===[https://mediasite.video.ufl.edu/Mediasite/Play/2bf4c860f19b48a593fb581018b813a11d ssh from Windows]===
| |
| − | [[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/2bf4c860f19b48a593fb581018b813a11d]] [3 min, 41 sec]
| |
| − | This video covers download and installation of the Windows ssh client MobaXterm, logging into HiPerGator at hpg.rc.ufl.edu using ssh, demonstration of /home and /ufrc directories and copy/paste on Windows ssh clients.
| |
| − | * The HiPerGator hostname is: hpg.rc.ufl.edu
| |
| − | * Your username and password are your Gatorlink username and password.
| |
| − | | |
| − | ===[https://mediasite.video.ufl.edu/Mediasite/Play/8efcf534ef3c408e9238d8deeeda083a1d Using Jupyter Notebooks on HiPerGator]===
| |
| − | [[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/8efcf534ef3c408e9238d8deeeda083a1d]] [8 min, 1 sec]
| |
| − | This video covers the use of Jupyter Notebooks via https://jhub.rc.ufl.edu/ to run Python, R and other notebooks on HiPerGator.
| |
| − | * Connect to https://jhub.rc.ufl.edu/
| |
| − | * Launch notebooks in various coding languages
| |
| − | * Launch a terminal
| |
| − | * Upload and download files via your browser
| |
| − | | |
| − | ===[https://mediasite.video.ufl.edu/Mediasite/Play/4654bfa838624de894085bf54678848f1d Using Open on Demand on HiPerGator]===
| |
| − | [[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/4654bfa838624de894085bf54678848f1d]] [5 min, 11 sec]
| |
| − | This video covers the use of Open on Demand https://openondemand.org/ on HiPerGator via https://ood.rc.ufl.edu/.
| |
| − | * Connect to https://ood.rc.ufl.edu/
| |
| − | * Launch a terminal
| |
| − | * Launch many graphical applications like Rstudio, Matlab and Freeview
| |
| − | * Manage job submission
| |
| − | * Upload, download and edit files via your browser
| |
| − | | |
| − | ==Data Transfer==
| |
| − | ===[https://mediasite.video.ufl.edu/Mediasite/Play/873a2b08bf1d4ccda49a51f5c84692491d SFTP transfer with FileZilla]===
| |
| − | [[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/873a2b08bf1d4ccda49a51f5c84692491d]] [2 min, 12 sec]
| |
| − | This video demonstrates using the FileZilla SFTP client to transfer data to/from HiPerGator.
| |
| − | *The HiPerGator hostname is: hpg.rc.ufl.edu
| |
| − | * '''note:''' for larger transfers, you may have better network performance with the host: sftp.rc.ufl.edu
| |
| − | * Your username and password are your Gatorlink username and password.
| |
| − | *The port for SFTP transfers is: 22
| |
| − | | |
| − | ===[https://mediasite.video.ufl.edu/Mediasite/Play/1c74e8bfd7e74447a13885cdaa033f461d Data transfer with Globus]===
| |
| − | | |
| − | [[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/1c74e8bfd7e74447a13885cdaa033f461d]][4 min, 22 sec]
| |
| − | | |
| − | This video demonstrates the basics of:
| |
| − | * Logging in to [https://globus.org Globus.org] using UF Gatorlink credentials.
| |
| − | * Connecting to the UFRC main endpoint at '''ufrc#hpg2'''
| |
| − | * Connecting to another endpoint for data transfer
| |
| − | * Transferring a file
| |
| − | * Additional options for file transfer, including folder synchronization and encryption.
| |
| − | | |
| − | View [https://help.rc.ufl.edu/doc/Globus Globus page] for overview.
| |
| − | | |
| − | ===[https://mediasite.video.ufl.edu/Mediasite/Play/81b2234b09d84d0ebf5d4ca47b35712b1d Setting up Globus Connect Personal]===
| |
| − | [[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/81b2234b09d84d0ebf5d4ca47b35712b1d]][3 min, 24 sec]
| |
| − | | |
| − | This video demonstrates the basics of:
| |
| − | * Establishing a Globus Connect Endpoint for your computer
| |
| − | * Installing the Globus Connect Personal client
| |
| − | * Using the setup key to initialize your client.
| |
| − | | |
| − | ===[https://mediasite.video.ufl.edu/Mediasite/Play/98f7c82da478426298f95e6b9fbbac2a1d Setting up a shared end-point with Globus]===
| |
| − | [[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/98f7c82da478426298f95e6b9fbbac2a1d]][3 min, 42 sec]
| |
| − | | |
| − | This video demonstrates the basics of:
| |
| − | * Connecting to the '''ufrc#hpg2''' endpoint
| |
| − | * Designating a folder as a shared endpoint
| |
| − | * Setting share options
| |
| − | * Creating a Globus group
| |
| − | | |
| − | View [https://help.rc.ufl.edu/doc/Globus Globus page] for overview.
| |
| − | | |
| − | ===Data transfer with Samba===
| |
| − | View [https://help.rc.ufl.edu/doc/Samba_Access Samba page] for overview.
| |
| − | ====[https://mediasite.video.ufl.edu/Mediasite/Play/8af63885f3e64f55b938eda14c092b291d Samba Access from MacOS]====
| |
| − | [[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/8af63885f3e64f55b938eda14c092b291d]] [2 min, 46 sec] This video demonstrate how to mount a UFRC filesystem on your MacOS computer using Samba.
| |
| − | | |
| − | ====[https://mediasite.video.ufl.edu/Mediasite/Play/9d44a4213d1040b889cd9c19d3c2cf781d Samba Access from Windows]====
| |
| − | [[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/9d44a4213d1040b889cd9c19d3c2cf781d]] [2 min, 1 sec] This video demonstrate how to mount a UFRC filesystem on your Windows computer using Samba.
| |
| − | | |
| − | ==Storage and Data Management==
| |
| − | ===[https://mediasite.video.ufl.edu/Mediasite/Play/79fb67818dc6467eac6271561c7e20ce1d Restoring Files in /home from snapshots]===
| |
| − | [[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/79fb67818dc6467eac6271561c7e20ce1d]] [5 min, 43 sec]
| |
| − | | |
| − | A small home directory (20GB quota) is provided for HiPerGator users, which '''is not intended for high performance work'''. Your /home area is intended for source code, scripts, and other human-readable data; the amount of data stored in your /home area should be kept to a minimum. Home directories have one week of daily snapshots available, which can be accessed by the user to recover older versions of files or accidentally deleted files. This video shows how to restore these files.
| |
| − | | |
| − | ==Submitting Jobs==
| |
| − | ===Running many short jobs with job arrays===
| |
| − | [[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/5bbd7cfb22b2416bbb0541e79875def51d]] [10 min, 16sec]
| |
| − | This video reviews important considerations for running [[SLURM Job Arrays]], especially when the individual tasks are short in duration. The video walks through the example script on the [[SLURM_Job_Arrays|Job array page]] to help users run multiple short tasks in a single job to maximize their efficiency.
| |
| − | | |
| − | ==Making Investments in UF Research Computing Resources==
| |
| − | ===[https://mediasite.video.ufl.edu/Mediasite/Play/e0eb646aa861441785133060757d78861d Submitting a purchase request]===
| |
| − | [[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/e0eb646aa861441785133060757d78861d]][3 min, 34 sec]
| |
| − | | |
| − | This video covers:
| |
| − | * [https://www.rc.ufl.edu/services/rates/ UFRC Price sheets]
| |
| − | * Hardware vs. Services investments
| |
| − | * [https://www.rc.ufl.edu/services/purchase-request/ Submitting the purchase request form]
| |
| − | | |
| − | =Training Videos=
| |
| − | In addition to the in-person training sessions, we provide pre-recorded content for many of our sessions.
| |
| − | | |
| − | == Introduction to Research Computing and HiPerGator==
| |
| − | Intended for new users, this training provides a general overview of the UF Research Computing facilities and basic usage of HiPerGator.
| |
| − | | |
| − | This training is available as a three-part series on the UFIT Training site: [[File:Play_icon.png|frameless|30px|link=https://training.it.ufl.edu/training/items/introduction-to-research-computing-and-hipergator.html]]
| |
| − | | |
| − | Or as a recording of the most recent Zoom session:
| |
| − | | |
| − | [[File:ZoomLogo.png|frameless|100px|link=https://ufl.zoom.us/rec/share/p8tWUCqHL1L5yQ0-CskV-60O2n7YLXxMRr52uNRi6ttWOLNp1SD58fAYjK2jd4pl.5aDQy7wUr7cxQt1D]] [https://ufl.zoom.us/rec/share/p8tWUCqHL1L5yQ0-CskV-60O2n7YLXxMRr52uNRi6ttWOLNp1SD58fAYjK2jd4pl.5aDQy7wUr7cxQt1D Recording of the Sept. 10, 2020 session]. I apologize that the first minute was not captured in the recording.
| |
| − | | |
| − | You can [https://www.dropbox.com/s/15h47kit9djkcmg/RC_Intro_to_RC.pdf?dl=0 download a copy of the slides used from here].
| |
| − | | |
| − | ==Introduction to the Linux Command Line==
| |
| − | This session will lead participants through some exercises that go over basic Linux commands such as moving around the file system, making directories, moving and copying files, etc. We will also go over some of the applications you can use on your computer to connect to and move files to and from HiPerGator. This session is largely aimed at users who are new to the Command Line.
| |
| − | | |
| − | This session is available as a pre-recorded video:
| |
| − | | |
| − | [[File:Play_icon.png|frameless|30px|link=https://training.it.ufl.edu/training/items/introduction-to-linux-command-line.html]]
| |
| − | | |
| − | Or as a recording of a live training session:
| |
| − | | |
| − | [[File:ZoomLogo.png|frameless|100px|link=https://ufl.zoom.us/rec/share/O9RUIJC-agemGfvNojzQDZ4ylYaTnO6PTVslEXP0MWVidiy0KVG_1POkLnl6B7Lr.KjXIULCsgY1vK12B?startTime=1600352866000]] [https://ufl.zoom.us/rec/share/O9RUIJC-agemGfvNojzQDZ4ylYaTnO6PTVslEXP0MWVidiy0KVG_1POkLnl6B7Lr.KjXIULCsgY1vK12B?startTime=1600352866000 Recording of the Sept. 17, 2020 session]
| |
| − | | |
| − | The handout and files for the session are now located in a git repository here: https://github.com/UFResearchComputing/Linux_training
| |
| − | | |
| − | The handout can be [https://github.com/UFResearchComputing/Linux_training/raw/main/Handout.pdf downloaded as a PDF file].
| |
| − | | |
| − | The molecules folder used in the training is at <code>/data/training/LinuxCLI/molecules</code>.
| |
| − | | |
| − | For those wishing to use this training outside of HiPerGator, the molecules folder is part of the [https://swcarpentry.github.io/shell-novice/ Software Carpentry Unix Shell] training available in the [https://swcarpentry.github.io/shell-novice/data/data-shell.zip data-shell.zip] file on the [https://swcarpentry.github.io/shell-novice/setup.html setup page]. This can be downloaded to you own computer and run using the Mac/Linux Terminal or [https://mobaxterm.mobatek.net/ MobaXterm] terminal on Windows.
| |
| − | | |
| − | ==HiPerGator: SLURM Submission Scripts==
| |
| − | | |
| − | In this session, participants will practice working with SLURM submission scripts using sample files. The training will cover the most common scheduler directives and how to tell SLURM the information it needs to run your jobs efficiently. Example scripts will be provided, though users are encouraged to bring their own scripts to work with. This session assumes a basic familiarity with the Unix command line and will be aimed at beginning to intermediate users. See the Introduction to the Linux Command Line Training for help with Linux.
| |
| − | | |
| − | This session is available as a pre-recorded video:
| |
| − | This video is approximately 30 minutes and includes a demonstration.
| |
| − | [[File:Play_icon.png|frameless|30px|link=https://training.it.ufl.edu/training/items/hipergator-slurm-submission-scripts.html]]
| |
| − | | |
| − | Or as a recording of the most recent Zoom session:
| |
| − | | |
| − | [[File:ZoomLogo.png|frameless|100px|link=https://ufl.zoom.us/rec/share/Dwf_NVRtiiHYfHZHCQ2sa1zpIu0-JZkACzY0u29dj9x2G1m_qPxEOiDpIjQjevGb.TyrGT_CIldSfQbjy?startTime=1600957747000]] [https://ufl.zoom.us/rec/share/Dwf_NVRtiiHYfHZHCQ2sa1zpIu0-JZkACzY0u29dj9x2G1m_qPxEOiDpIjQjevGb.TyrGT_CIldSfQbjy?startTime=1600957747000 Recording of the Sept. 24, 2020 session].
| |
| − | | |
| − | The files used in this video are on the [[Sample_SLURM_Scripts]] page and on the cluster in <code>/data/training/SLURM/</code>.
| |
| − | | |
| − | ==HiPerGator: SLURM Submission Scripts for MPI Jobs==
| |
| − | | |
| − | This session will go into depth on the details of scheduling MPI jobs on HiPerGator. Efficiently running MPI applications requires an understanding of both how to specify the needed resources as well as the layout and properties of the available hardware. This session will provide examples from several commonly used applications and provide guidelines for users to optimize their own runs.
| |
| − | | |
| − | This video is approximately 26 minutes and includes a demonstration.
| |
| − | [[File:Play_icon.png|frameless|30px|link=https://training.it.ufl.edu/training/items/hipergator-slurm-scripts-for-mpi-jobs.html]]
| |
| − | | |
| − | The files used in this video are on the [[Sample_SLURM_Scripts]] page and on the cluster in <code>/ufrc/data/training/SLURM/</code>.
| |
| − | | |
| − | ==Running Graphical Applications on HiPerGator with Xpra==
| |
| − | Users can run applications with graphical user interfaces (GUI) on HiPerGator in the SLURM “gui” partition. Xpra is the software we use to connect to the graphics window of the application running on HiPerGator from your local computer. These videos walk through setting up and connecting to Xpra sessions.
| |
| − | | |
| − | The new gui/2 module is explained in this video:
| |
| − | [[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/195d0d9dc3e640ffb874cf90ac505a1a1d]] [5 min, 16 sec]
| |
| − | | |
| − | Also check out the Open on Demand video which covers many GUI applications:
| |
| − | [[File:Play_icon.png|frameless|30px|link=https://mediasite.video.ufl.edu/Mediasite/Play/4654bfa838624de894085bf54678848f1d]] [5 min, 11 sec]
| |
| − | | |
| − | For the older, gui/1 modules, there are both Mac and Windows versions are available and are about 10 minutes each: [[File:Play_icon.png|frameless|30px|link=https://training.it.ufl.edu/training/items/running-graphical-applications-on-hipergator-with-xpra.html]]
| |
| − | | |
| − | The [[GUI Programs]] page has additional information.
| |
| − | | |
| − | ==Running MATLAB on HiPerGator==
| |
| − | | |
| − | Users walk through a hands-on examples using MATLAB at Research Computing. Participants will work with the MATLAB GUI, compiling code and submitting MATLAB jobs to the scheduler to run on the cluster.
| |
| − | | |
| − | This video is approximately 24 minutes and includes a demonstration.
| |
| − | [[File:Play_icon.png|frameless|30px|link=https://training.it.ufl.edu/training/items/running-matlab-on-hipergator.html]]
| |
| − | | |
| − | Users should also review the [[Matlab]] page for additional information.
| |
| − | | |
| − | ==Git and GitHub.com==
| |
| − | While there is not a video associated with this, all of the content is available online.
| |
| − | * Slides for the presentation are at: https://ufresearchcomputing.github.io/git-training/#/
| |
| − | * The hands-on content is in the master branch of the repository at: https://github.com/UFResearchComputing/git-training
| |
| − | | |
| − | ==Orientation Material for Courses using HiPerGator==
| |
| − | For UF courses that use HiPerGator, please review our policies on [https://www.rc.ufl.edu/services/support/teaching-support/ teaching use of HiPerGator].
| |
| | | | |
| − | Recordings and slides are on the UFIT Training page: [[File:Play_icon.png|frameless|30px|link=https://training.it.ufl.edu/training/items/orientation-materials-for-courses-using-rc.html]]
| + | == AI Education and Training == |
| | + | [[File:Rc-web-icons ai training.png|alt="AI Training"|frameless | link=[[AI Education and Training]]]] The '''[[AI Education and Training]]''' lists selected AI education and learning materials. |
| | | | |
| − | =Additional Training Opportunities= | + | ==Additional Training Opportunities== |
| | In addition to the training sessions coordinated by UF Research Computing, we are aware of many training opportunities provided by other institutions and vendors. These are listed below. | | In addition to the training sessions coordinated by UF Research Computing, we are aware of many training opportunities provided by other institutions and vendors. These are listed below. |
| | | | |
| − | ==Intel Software Tools Technical Webinar Series== | + | ===Intel Software Tools Technical Webinar Series=== |
| | This free webinar series presents tools, tips, and techniques that will help sharpen your development skills on developing and improving your high performance compute applications for multicore and manycore on Intel® Xeon® processors and Intel® Xeon Phi™ coprocessors. Expert technical teams at Intel as well as open source innovators discuss development tools, programming models, vectorization and execution models that will get your development efforts powered up to get the best out of your applications and platforms. | | This free webinar series presents tools, tips, and techniques that will help sharpen your development skills on developing and improving your high performance compute applications for multicore and manycore on Intel® Xeon® processors and Intel® Xeon Phi™ coprocessors. Expert technical teams at Intel as well as open source innovators discuss development tools, programming models, vectorization and execution models that will get your development efforts powered up to get the best out of your applications and platforms. |
| | | | |
| | Full schedule and registration information is available [http://software.intel.com/en-us/articles/intel-software-tools-technical-webinar-series here]. | | Full schedule and registration information is available [http://software.intel.com/en-us/articles/intel-software-tools-technical-webinar-series here]. |
| | | | |
| − | ==XSEDE== | + | ===XSEDE=== |
| | The ''Extreme Science and Engineering Discovery Environment'' [https://portal.xsede.org/online-training online training] mostly lists html tutorials offered at the [http://www.cornell.edu/ Cornell University]. Offered tutorials cover general programming, scripting, parallel programming (concepts, message passing interface (MPI), openmp), visualisation, code improvement, and other topics. | | The ''Extreme Science and Engineering Discovery Environment'' [https://portal.xsede.org/online-training online training] mostly lists html tutorials offered at the [http://www.cornell.edu/ Cornell University]. Offered tutorials cover general programming, scripting, parallel programming (concepts, message passing interface (MPI), openmp), visualisation, code improvement, and other topics. |
| | | | |
| | The [https://portal.xsede.org/course-calendar XSEDE Training Calendar] includes many useful webcasts that are provided by a number of institutions. For most events registration is required. | | The [https://portal.xsede.org/course-calendar XSEDE Training Calendar] includes many useful webcasts that are provided by a number of institutions. For most events registration is required. |
| | | | |
| − | ==TACC== | + | ===TACC=== |
| | | | |
| | Many TACC online training sessions are webcast and are listed in the XSEDE Training Calendar above. Training materials, recordings and webcasts are available from the [http://www.tacc.utexas.edu/user-services/training/course-materials TACC Course Materials site]. | | Many TACC online training sessions are webcast and are listed in the XSEDE Training Calendar above. Training materials, recordings and webcasts are available from the [http://www.tacc.utexas.edu/user-services/training/course-materials TACC Course Materials site]. |
The AI Education and Training lists selected AI education and learning materials.