Difference between revisions of "Transfer Data"
Moskalenko (talk | contribs) |
Moskalenko (talk | contribs) |
||
| Line 14: | Line 14: | ||
For smaller file sizes Use SFTP/rsync/scp by connecting to the '<code>sftp.rc.ufl.edu</code>' data transfer server. SFTP uses port 22 if you have to specify it. | For smaller file sizes Use SFTP/rsync/scp by connecting to the '<code>sftp.rc.ufl.edu</code>' data transfer server. SFTP uses port 22 if you have to specify it. | ||
| − | ==Transfers from HiPerGator== | + | ==Transfers from a remote location to HiPerGator== |
| − | If you are already logged into HiPerGator and need to transfer data to or from a remote system log into '<code>dtn1.ufhpc</code>' node from any other node within HiPerGator. This server has a high-throughput network connection to the outside. | + | If you are already logged into HiPerGator and need to transfer data to or from a remote system log into '<code>dtn1.ufhpc</code>' node from any other node within HiPerGator. This server has a high-throughput network connection to the outside. Once on that node you can use command-line tools like wget, curl, sftp, or ncftp (from the ncft environment module) to transfer data to or from remote systems. |
Revision as of 18:39, 1 December 2016
Overview
This document describes transferring data between a local computer (client) and HiPerGator (HPG).
Tools
There is a variety of command-line, GUI, and even web-based tools available for transferring data to or from HiPerGator. Some examples include 'cp, mv, scp, rsync, or sftp' on the command-line, FileZilla, Cyberduck, WinSCP, or MobaXTerm Gui sotware, or Globus data transfer tool available via a web interface in addition to command-line and GUI versions. The instructions below can be applied to virtually all of the tools mentioned above.
Servers
It is no longer possible to use interactive SSH login servers on HiPergator (hpg2.rc.ufl.edu) i.e. gator3 and gator4 - for rsync or SFTP transfers. Use the dedicated servers described below for data transfers. At the same time, the data transfer servers do not allow interactive logins via ssh, so do not try to log on into them.
From a Local computer to HiPerGator
If your data files are large (hundreds of megabytes or gigabytes) then try Globus first.
For smaller file sizes Use SFTP/rsync/scp by connecting to the 'sftp.rc.ufl.edu' data transfer server. SFTP uses port 22 if you have to specify it.
Transfers from a remote location to HiPerGator
If you are already logged into HiPerGator and need to transfer data to or from a remote system log into 'dtn1.ufhpc' node from any other node within HiPerGator. This server has a high-throughput network connection to the outside. Once on that node you can use command-line tools like wget, curl, sftp, or ncftp (from the ncft environment module) to transfer data to or from remote systems.