Difference between revisions of "UFRC Help and Documentation"

From UFRC
Jump to navigation Jump to search
 
(183 intermediate revisions by 9 users not shown)
Line 1: Line 1:
__NOTOC__
+
Welcome to the <span class="plainlinks">[http://www.ufl.edu/ University of Florida] [https://it.ufl.edu/ UFIT] [https://www.rc.ufl.edu Research Computing] Help and Documentation site. General information, announcements, and purchase request forms are on our [https://www.rc.ufl.edu main web site]. The information here is focused on particular applications, services, and usage examples. [https://support.rc.ufl.edu Provide Feedback].</span>
Welcome to the <span class="plainlinks">[http://www.ufl.edu/ University of Florida] Research Computing Wiki. The information here augments what is found on our [http://www.hpc.ufl.edu web site] with information we think is best provided in a less formal and official context. It is used for information that changes rapidly and might become quickly dated or incorrect on the web site. While there is good and helpful information here, you ''will'' find text that has not been proofed to the same standards that we try to maintain on our web site. We hope you find it helpful.</span>
+
<br>
 +
<!-- {{Note|Submit a support request at [https://support.rc.ufl.edu https://support.rc.ufl.edu]|warn}} -->
 +
<!-- {{Note|See an important message about EL7->EL8 migration on HiPerGator at [[Rolling Upgrade from RHEL7 to RHEL8]]|warn}} -->
  
=== HiPerGator 2.0 Information ===
+
{| cellspacing="0" cellpadding="5"
{| cellpadding=10 width="100%" style="background-color: #FFF; border-color: #0021A5; border-style: solid; border-width: 3px 3px 3px 3px; color: #444444; vertical-align:top;"
+
|- valign="top"
| scope="col" width="150" |
+
| width="50%" |
* [[HiPerGator2.0|HiPerGator 2.0 Information]]
+
{| width="100%"
* [[Sample_SLURM_Scripts|Sample SLURM Scripts]]
+
| style="width: 7%; vertical-align: top" | [[Image:Setup.png|frameless|upright=0.2]]
| scope="col" width="150" |
+
| style="padding-left: 10px" | <h1 style="border: 0; margin: 0 0 3px 0; padding: 0">FOR NEW USERS</h1>
* [[:Category:SLURM|SLURM Documentation]]
+
Guides to get you started with HPG, and best practices!
* [[PBS2SLURM_Command_Reference|Moab (PBS) to SLURM command reference]]
+
<hr style="margin: 4px 0" />
 +
<span style="font-size: 12pt">'''[[Getting Started ]]''' | [[Training Videos]] | [[Training|Trainings & Events]] | [[Development_and_Testing|Interactive Development and Testing]] | [[Storage|Practical Storage Use]] </span>
 +
|}
 +
||
 +
{| width="100%"
 +
| style="width: 7%; vertical-align: top" | [[Image:Access.png|frameless|upright=0.2]]
 +
| style="padding-left: 10px" | <h1 style="border: 0; margin: 0 0 3px 0; padding: 0">ACCESS</h1>
 +
How to connect to HPG with Duo, authenticate multiple connections, or check account.
 +
<hr style="margin: 4px 0" />
 +
<span style="font-size: 12pt">'''[[Authentication With MFA|Multi-Factor Authentication]]''' | [[SSH Multiplexing]] | [[Using SSH Keys To Access HPG | SSH Keys]] | [[Blocked Accounts]] | [[Federated_Account_Request|Federated Access]] and [[Federated_login|Login]] </span>
 
|}
 
|}
  
=== Getting Started ===
+
|- valign="top"
{| cellpadding=10 width="100%" style="background-color: #FFF; border-color: #FF4A00; border-style: solid; border-width: 3px 3px 3px 3px; color: #444444; vertical-align:top;"  
+
 
|-
+
||
| scope="col" width="150" |
+
{| width="100%"
* [[Getting Started ]]
+
| style="width: 7%; vertical-align: top" | [[Image:Question.png|frameless|upright=0.2]]
* [[SLURM_Commands|SLURM Commands]]
+
| style="padding-left: 10px" | <h1 style="border: 0; margin: 0 0 3px 0; padding: 0">HELP</h1>
*[[Non_Batch-System_Resources|Non-Batch System Resources]]
+
Resources to ask questions, get support, or communicate directly.
| scope="col" width="150" |
+
<hr style="margin: 4px 0" />
* [[Mailing Lists]]
+
<span style="font-size: 12pt">'''[[Get_Help|How To Get Help]]'''  | [[AI Help]] | [[FAQ]] | <span class="plainlinks">[https://support.rc.ufl.edu/enter_bug.cgi Submit a Support Request] | [[HiPerGator Metrics]] | [[Remote Support]]</span></span>
* [[Events_Calendar]]
 
* [[Training]]
 
| scope="col" width="150" |
 
* [[Password | Changing your Password]]
 
* <span class="plainlinks">[http://support.rc.ufl.edu Open a Support Request]</span>
 
* [http://rc.ufl.edu/jobstatus/ View Job Status]
 
|-
 
 
|}
 
|}
  
=== Software and Libraries ===
+
||
{| cellpadding=10 width="100%" style="background-color: #FFF; border-color: #0021A5; border-style: solid; border-width: 3px 3px 3px 3px; color: #444444; vertical-align:top;"
+
{| width="100%"
|-
+
| style="width: 7%; vertical-align: top" | [[Image:Inter.png|frameless|upright=0.2]]
| scope="col" width="150" |
+
| style="padding-left: 10px" | <h1 style="border: 0; margin: 0 0 3px 0; padding: 0">INTERFACES</h1>
* [[Installed Software]]
+
Guides for GUI/web interfaces you can run on HPG.
| scope="col" width="150" |
+
<hr style="margin: 4px 0" />
* [[Modules|Environment Modules System]]
+
<span style="font-size: 12pt"> '''[[Jupyter_Notebooks| Jupyter (Python, R)]]''' | [[Galaxy|Galaxy Genomics Framework]] | [[Open OnDemand|OnDemand (Matlab, RStudio,...)]] | [[Managing Python environments and Jupyter_kernels | Conda and Jupyter Kernels ]] | [[GUI Programs|Running GUI Apps]] </span>
| scope="col" width="150" |
 
* [[CUDA|GPUs and CUDA]]
 
 
|}
 
|}
  
=== Batch System ===
+
|- valign="top"
{| cellpadding=10 width="100%" style="background-color: #FFF; border-color: #FF4A00; border-style: solid; border-width: 3px 3px 3px 3px; color: #444444; vertical-align:top;"
+
 
|-
+
||
| scope="col" width="150" |
+
{| width="100%"
*[[Queues|Queue information]]
+
| style="width: 7%; vertical-align: top" | [[Image:Scheduler.png|frameless|upright=0.2]]
* [[Torque_Job_Arrays|Job Arrays]]
+
| style="padding-left: 10px" | <h1 style="border: 0; margin: 0 0 3px 0; padding: 0">SCHEDULER</h1>
* [[PBS_$TMPDIR|Using TMPDIR Variable]]
+
How to schedule and manage jobs and resources on HPG and more SLURM info.
| scope="col" width="150" |
+
<hr style="margin: 4px 0" />
* [[Annotated_SLURM_Script|Annotated Job Script Example]]
+
<span style="font-size: 12pt">'''[[SLURM_Commands|Commands]]''' | [[Account_and_QOS_limits_under_SLURM|Account/QOS Limits]] | [[Available Node Features]] | [[Sample_SLURM_Scripts|Job Script Examples]] | [[SLURM_Job_Arrays|Job Arrays]] | [[GPU_Access|GPU Access]] | [[SLURM_Job_States|Job States]] | [[SLURM Partition Limits|Time Limits]]</span>
* [[PBS_Directives|Basic PBS Directives]]
 
| scope="col" width="150" |
 
* [[Billed Usage]]
 
* [[Large-Memory_SMP_Servers|Big Memory Queue]]
 
 
|}
 
|}
  
=== Connecting and Data Transfer ===
+
||
{| cellpadding=10 width="100%" style="background-color: #FFF; border-color: #0021A5; border-style: solid; border-width: 3px 3px 3px 3px; color: #444444; vertical-align:top;"  
+
{| width="100%"
|-
+
| style="width: 7%; vertical-align: top" | [[Image:Software.png|frameless|upright=0.2]]
| scope="col" width="150" |
+
| style="padding-left: 10px" | <h1 style="border: 0; margin: 0 0 3px 0; padding: 0">SOFTWARE AND REFERENCE DATA</h1>
* [[Samba Access]]
+
View installed programs and tools, how to utilize them, and reference data that they can run.
* [[FileZilla|SFTP Transfers with FileZilla]]
+
<hr style="margin: 4px 0" />
* [[Rsync]]
+
<span style="font-size: 12pt">'''[[Applications|Installed Applications]]''' | [[UFRC_environment_module|HiPerGator ufrc Tools]] | [[Modules|Environment Modules System]] | [[Reference Data]] | [[AI Reference Datasets]]</span>
| scope="col" width="150" |
+
|}
* [[Globus]]
+
|- valign="top"
* [[GUI Programs|GUI Programs and X11]]
+
||
| scope="col" width="150" |
+
{| width="100%"
* [[PuTTY|Using PuTTY for SSH]]
+
| style="width: 7%; vertical-align: top" | [[Image:Transfer.png|frameless|upright=0.2]]
* [[GatorBox]]
+
| style="padding-left: 10px" | <h1 style="border: 0; margin: 0 0 3px 0; padding: 0">TRANSFER DATA</h1>
|-
+
How to move different sizes of data to and from HPG.
 +
<hr style="margin: 4px 0" />
 +
<span style="font-size: 12pt">'''[[Transfer Data]]''' | [[Globus]] | [[Samba Access]] | [[Sharing Within A Cluster]] | [[Rsync]] </span>
 +
|}
 +
||
 +
{| width="100%"
 +
| style="width: 7%; vertical-align: top" | [[Image:Areas.png|frameless|upright=0.2]]
 +
| style="padding-left: 10px" | <h1 style="border: 0; margin: 0 0 3px 0; padding: 0">SPECIFIC RESEARCH AREAS</h1>
 +
Highlighted areas of specialization commonly seen with HPG.
 +
<hr style="margin: 4px 0" />
 +
<span style="font-size: 12pt">'''[[Biology|Biology]]''' | '''[[Nlp|Natural Language Processing]]''' | '''[[Computer Vision]]''' </span>
 
|}
 
|}
 
+
|- valign="top"
=== Specific Research Areas ===
 
{| cellpadding=10 width="100%" style="background-color: #FFF; border-color: #FF4A00; border-style: solid; border-width: 3px 3px 3px 3px; color: #444444; vertical-align:top;"
 
|-
 
| width="150" | [[Biology|Biological Research Computing]]
 
| scope="col" width="150" |
 
| scope="col" width="150" |
 
|-
 
| scope="col" width="150" |
 
* [[Galaxy|Galaxy Genomics Framework]]
 
* [[R|R (BioConductor)]]
 
|
 
* [[BLASTDB|Blast Databases]]
 
* [[Transfer_NGS_Sequence_Data_to_HPC|Data Transfer]]
 
| scope="col" width="150" |
 
* [[:Category:Bioinformatics|Bioinformatics Software]]
 
* [[Sharing Files]]
 
|-
 
 
|}
 
|}
 +
__NOTOC__
 +
__NOEDITSECTION__

Latest revision as of 17:20, 22 July 2024

Welcome to the University of Florida UFIT Research Computing Help and Documentation site. General information, announcements, and purchase request forms are on our main web site. The information here is focused on particular applications, services, and usage examples. Provide Feedback.

Setup.png

FOR NEW USERS

Guides to get you started with HPG, and best practices!


Getting Started | Training Videos | Trainings & Events | Interactive Development and Testing | Practical Storage Use

Access.png

ACCESS

How to connect to HPG with Duo, authenticate multiple connections, or check account.


Multi-Factor Authentication | SSH Multiplexing | SSH Keys | Blocked Accounts | Federated Access and Login

Question.png

HELP

Resources to ask questions, get support, or communicate directly.


How To Get Help | AI Help | FAQ | Submit a Support Request | HiPerGator Metrics | Remote Support

Inter.png

INTERFACES

Guides for GUI/web interfaces you can run on HPG.


Jupyter (Python, R) | Galaxy Genomics Framework | OnDemand (Matlab, RStudio,...) | Conda and Jupyter Kernels | Running GUI Apps

Scheduler.png

SCHEDULER

How to schedule and manage jobs and resources on HPG and more SLURM info.


Commands | Account/QOS Limits | Available Node Features | Job Script Examples | Job Arrays | GPU Access | Job States | Time Limits

Software.png

SOFTWARE AND REFERENCE DATA

View installed programs and tools, how to utilize them, and reference data that they can run.


Installed Applications | HiPerGator ufrc Tools | Environment Modules System | Reference Data | AI Reference Datasets

Transfer.png

TRANSFER DATA

How to move different sizes of data to and from HPG.


Transfer Data | Globus | Samba Access | Sharing Within A Cluster | Rsync

Areas.png

SPECIFIC RESEARCH AREAS

Highlighted areas of specialization commonly seen with HPG.


Biology | Natural Language Processing | Computer Vision