Difference between revisions of "Transfer Data"
Moskalenko (talk | contribs) |
Moskalenko (talk | contribs) |
||
| Line 17: | Line 17: | ||
If you are already logged into HiPerGator and need to transfer data to or from a remote system or a site (ftp, http) log into '<code>dtn1.ufhpc</code>' node from any other node within HiPerGator. This server has a high-throughput network connection to the outside providing an optimal location to transfer data to or from remote systems. | If you are already logged into HiPerGator and need to transfer data to or from a remote system or a site (ftp, http) log into '<code>dtn1.ufhpc</code>' node from any other node within HiPerGator. This server has a high-throughput network connection to the outside providing an optimal location to transfer data to or from remote systems. | ||
| + | ==Providing access to your data== | ||
If you need to serve data either publicly or with password protection for collaborations you can either set up a shared end-point in [[Globus]] or [https://support.rc.ufl.edu contact us] and we'll help you get set up with serving static data from [https://bio.rc.ufl.edu https://bio.rc.ufl.edu] or via dynamic web applications that you develop on our PubApps web application infrastructure. | If you need to serve data either publicly or with password protection for collaborations you can either set up a shared end-point in [[Globus]] or [https://support.rc.ufl.edu contact us] and we'll help you get set up with serving static data from [https://bio.rc.ufl.edu https://bio.rc.ufl.edu] or via dynamic web applications that you develop on our PubApps web application infrastructure. | ||
Revision as of 18:48, 1 December 2016
Overview
This document describes transferring data between a local computer (client) and HiPerGator (HPG).
Tools
There is a variety of command-line, GUI, and even web-based tools available for transferring data to or from HiPerGator. Command-line tools include, for example, 'cp, mv, scp, rsync, sftp, wget, curl, or ncftp (from the ncftp environment module]'. GUI tools like FileZilla, Cyberduck, WinSCP, MobaXTerm SFTP and similar tools can be used on your local computer. Globus data transfer tool is available via a web interface in addition to command-line and GUI versions that can be run on your local computer.
SFTP Servers
It is no longer possible to use interactive SSH login servers on HiPergator (hpg2.rc.ufl.edu) i.e. gator3 and gator4 - for rsync or SFTP transfers. Use the dedicated servers described below for data transfers. At the same time, the data transfer servers do not allow interactive logins via ssh, so do not try to log on into them with ssh.
Transfers between a local computer and HiPerGator
If your data files are large (hundreds of megabytes or gigabytes) then try Globus first.
For smaller file sizes Use SFTP/rsync/scp by connecting to the 'sftp.rc.ufl.edu' data transfer server. SFTP uses port 22 if you have to specify it.
Transfers between HiPerGator and a remote system/site
If you are already logged into HiPerGator and need to transfer data to or from a remote system or a site (ftp, http) log into 'dtn1.ufhpc' node from any other node within HiPerGator. This server has a high-throughput network connection to the outside providing an optimal location to transfer data to or from remote systems.
Providing access to your data
If you need to serve data either publicly or with password protection for collaborations you can either set up a shared end-point in Globus or contact us and we'll help you get set up with serving static data from https://bio.rc.ufl.edu or via dynamic web applications that you develop on our PubApps web application infrastructure.