Difference between revisions of "UFRC Help and Documentation"

From UFRC
Jump to navigation Jump to search
m
 
(317 intermediate revisions by 13 users not shown)
Line 1: Line 1:
{|align=right
+
Welcome to the <span class="plainlinks">[http://www.ufl.edu/ University of Florida] [https://it.ufl.edu/ UFIT] [https://www.rc.ufl.edu Research Computing] Help and Documentation site. General information, announcements, and purchase request forms are on our [https://www.rc.ufl.edu main web site]. The information here is focused on particular applications, services, and usage examples. [https://support.rc.ufl.edu Provide Feedback].</span>
  |__TOC__
+
<br>
  |}
+
<!-- {{Note|Submit a support request at [https://support.rc.ufl.edu https://support.rc.ufl.edu]|warn}} -->
Welcome to the University of Florida High Performance Computing Center Wiki
+
<!-- {{Note|See an important message about EL7->EL8 migration on HiPerGator at [[Rolling Upgrade from RHEL7 to RHEL8]]|warn}} -->
 +
 
 +
{| cellspacing="0" cellpadding="5"
 +
|- valign="top"
 +
| width="50%" |
 +
{| width="100%"
 +
| style="width: 7%; vertical-align: top" | [[Image:Setup.png|frameless|upright=0.2]]
 +
| style="padding-left: 10px" | <h1 style="border: 0; margin: 0 0 3px 0; padding: 0">FOR NEW USERS</h1>
 +
Guides to get you started with HPG, and best practices!
 +
<hr style="margin: 4px 0" />
 +
<span style="font-size: 12pt">'''[[Getting Started ]]''' | [[Training Videos]] | [[Training|Trainings & Events]] | [[Development_and_Testing|Interactive Development and Testing]] | [[Storage|Practical Storage Use]] </span>
 +
|}
 +
||
 +
{| width="100%"
 +
| style="width: 7%; vertical-align: top" | [[Image:Access.png|frameless|upright=0.2]]
 +
| style="padding-left: 10px" | <h1 style="border: 0; margin: 0 0 3px 0; padding: 0">ACCESS</h1>
 +
How to connect to HPG with Duo, authenticate multiple connections, or check account.
 +
<hr style="margin: 4px 0" />
 +
<span style="font-size: 12pt">'''[[Authentication With MFA|Multi-Factor Authentication]]''' | [[SSH Multiplexing]] | [[Using SSH Keys To Access HPG | SSH Keys]] | [[Blocked Accounts]] | [[Federated_Account_Request|Federated Access]] and [[Federated_login|Login]] </span>
 +
|}
 +
 
 +
|- valign="top"
  
{|
 
|-valign="top"
 
|
 
* [[Getting Started]]
 
* [[Policies]]
 
* [[Installed Software]]
 
* [[Common Problems]]
 
* [[Frequently Asked Questions]]
 
* [[Schedulers]]
 
 
||
 
||
* [[Job Submission Queues]]
+
{| width="100%"
* [[Getting_Started#Torque_Scheduler | Sample Submission Script]]
+
| style="width: 7%; vertical-align: top" | [[Image:Question.png|frameless|upright=0.2]]
* [[Hardware]]
+
| style="padding-left: 10px" | <h1 style="border: 0; margin: 0 0 3px 0; padding: 0">HELP</h1>
* [[Shutdown | Shutdown Activities]]
+
Resources to ask questions, get support, or communicate directly.
* [[Cluster Monitoring]]
+
<hr style="margin: 4px 0" />
* [[Operating Environment]]
+
<span style="font-size: 12pt">'''[[Get_Help|How To Get Help]]'''  | [[AI Help]] | [[FAQ]] | <span class="plainlinks">[https://support.rc.ufl.edu/enter_bug.cgi Submit a Support Request] | [[HiPerGator Metrics]] | [[Remote Support]]</span></span>
 
|}
 
|}
==Recent News==
 
* Due to heavy spamming, we are now requiring that you send a request for an account on the wiki in order to edit the pages. You can send requests to support@hpc.ufl.edu.
 
* The UFHPC_SCRATCH Environment Variable has been instituted. Details are located on the [[Scratch]] space page.
 
==Multi-Processing==
 
* [[OpenMPI]]
 
* [[OpenMP]]
 
* [[OFED]]
 
* [[IB HCA Firmware]]
 
  
==Compilers==
+
||
{| border="1"
+
{| width="100%"
! Language !! Compiler !! Version !! Path
+
| style="width: 7%; vertical-align: top" | [[Image:Inter.png|frameless|upright=0.2]]
|-
+
| style="padding-left: 10px" | <h1 style="border: 0; margin: 0 0 3px 0; padding: 0">INTERFACES</h1>
| Fortran || [[Intel]] || 77/90 || /opt/intel/fce/9.1.037/bin
+
Guides for GUI/web interfaces you can run on HPG.
|-
+
<hr style="margin: 4px 0" />
| Fortran || [[Intel]] || 77/90 32-bit || /opt/intel/fc/9.1.039/bin
+
<span style="font-size: 12pt"> '''[[Jupyter_Notebooks| Jupyter (Python, R)]]''' | [[Galaxy|Galaxy Genomics Framework]] | [[Open OnDemand|OnDemand (Matlab, RStudio,...)]] | [[Managing Python environments and Jupyter_kernels | Conda and Jupyter Kernels ]] | [[GUI Programs|Running GUI Apps]] </span>
|-
 
| Fortran || [[GNU]] || 95 || /usr/bin/gfortran
 
|-
 
| Fortran || [[GNU]] || 70 || /usr/bin/g77
 
|-
 
| C || [[Intel]] || 9.1.044 || /opt/intel/cce/9.1.044/bin
 
|-
 
| C || [[GNU]] || 3.4.6 || /usr/bin/gcc
 
|-
 
| C++ || [[Intel]] || 9.1.044 || /opt/intel/cce/9.1.044/bin
 
|-
 
| C++ || [[GNU]] || 3.4.6 || /usr/bin/g++
 
 
|}
 
|}
  
==System Connections==
+
|- valign="top"
[[Power Connections]]
 
  
==Collectl and Lustre==
+
||
[[Collectl_docs]] -- collectl general howto
+
{| width="100%"
 +
| style="width: 7%; vertical-align: top" | [[Image:Scheduler.png|frameless|upright=0.2]]
 +
| style="padding-left: 10px" | <h1 style="border: 0; margin: 0 0 3px 0; padding: 0">SCHEDULER</h1>
 +
How to schedule and manage jobs and resources on HPG and more SLURM info.
 +
<hr style="margin: 4px 0" />
 +
<span style="font-size: 12pt">'''[[SLURM_Commands|Commands]]''' | [[Account_and_QOS_limits_under_SLURM|Account/QOS Limits]] | [[Available Node Features]] | [[Sample_SLURM_Scripts|Job Script Examples]] | [[SLURM_Job_Arrays|Job Arrays]] | [[GPU_Access|GPU Access]] | [[SLURM_Job_States|Job States]] | [[SLURM Partition Limits|Time Limits]]</span>
 +
|}
  
[[Lustre_proc]] -- lustre internals for lustre /proc info
+
||
 +
{| width="100%"
 +
| style="width: 7%; vertical-align: top" | [[Image:Software.png|frameless|upright=0.2]]
 +
| style="padding-left: 10px" | <h1 style="border: 0; margin: 0 0 3px 0; padding: 0">SOFTWARE AND REFERENCE DATA</h1>
 +
View installed programs and tools, how to utilize them, and reference data that they can run.
 +
<hr style="margin: 4px 0" />
 +
<span style="font-size: 12pt">'''[[Applications|Installed Applications]]''' | [[UFRC_environment_module|HiPerGator ufrc Tools]] | [[Modules|Environment Modules System]] | [[Reference Data]] | [[AI Reference Datasets]]</span>
 +
|}
 +
|- valign="top"
 +
||
 +
{| width="100%"
 +
| style="width: 7%; vertical-align: top" | [[Image:Transfer.png|frameless|upright=0.2]]
 +
| style="padding-left: 10px" | <h1 style="border: 0; margin: 0 0 3px 0; padding: 0">TRANSFER DATA</h1>
 +
How to move different sizes of data to and from HPG.
 +
<hr style="margin: 4px 0" />
 +
<span style="font-size: 12pt">'''[[Transfer Data]]''' | [[Globus]] | [[Samba Access]] | [[Sharing Within A Cluster]] | [[Rsync]] </span>
 +
|}
 +
||
 +
{| width="100%"
 +
| style="width: 7%; vertical-align: top" | [[Image:Areas.png|frameless|upright=0.2]]
 +
| style="padding-left: 10px" | <h1 style="border: 0; margin: 0 0 3px 0; padding: 0">SPECIFIC RESEARCH AREAS</h1>
 +
Highlighted areas of specialization commonly seen with HPG.
 +
<hr style="margin: 4px 0" />
 +
<span style="font-size: 12pt">'''[[Biology|Biology]]''' | '''[[Nlp|Natural Language Processing]]''' | '''[[Computer Vision]]''' </span>
 +
|}
 +
|- valign="top"
 +
|}
 +
__NOTOC__
 +
__NOEDITSECTION__

Latest revision as of 17:20, 22 July 2024

Welcome to the University of Florida UFIT Research Computing Help and Documentation site. General information, announcements, and purchase request forms are on our main web site. The information here is focused on particular applications, services, and usage examples. Provide Feedback.

Setup.png

FOR NEW USERS

Guides to get you started with HPG, and best practices!


Getting Started | Training Videos | Trainings & Events | Interactive Development and Testing | Practical Storage Use

Access.png

ACCESS

How to connect to HPG with Duo, authenticate multiple connections, or check account.


Multi-Factor Authentication | SSH Multiplexing | SSH Keys | Blocked Accounts | Federated Access and Login

Question.png

HELP

Resources to ask questions, get support, or communicate directly.


How To Get Help | AI Help | FAQ | Submit a Support Request | HiPerGator Metrics | Remote Support

Inter.png

INTERFACES

Guides for GUI/web interfaces you can run on HPG.


Jupyter (Python, R) | Galaxy Genomics Framework | OnDemand (Matlab, RStudio,...) | Conda and Jupyter Kernels | Running GUI Apps

Scheduler.png

SCHEDULER

How to schedule and manage jobs and resources on HPG and more SLURM info.


Commands | Account/QOS Limits | Available Node Features | Job Script Examples | Job Arrays | GPU Access | Job States | Time Limits

Software.png

SOFTWARE AND REFERENCE DATA

View installed programs and tools, how to utilize them, and reference data that they can run.


Installed Applications | HiPerGator ufrc Tools | Environment Modules System | Reference Data | AI Reference Datasets

Transfer.png

TRANSFER DATA

How to move different sizes of data to and from HPG.


Transfer Data | Globus | Samba Access | Sharing Within A Cluster | Rsync

Areas.png

SPECIFIC RESEARCH AREAS

Highlighted areas of specialization commonly seen with HPG.


Biology | Natural Language Processing | Computer Vision