Globus

From UFRC
Revision as of 22:14, 13 January 2016 by Moskalenko (talk | contribs)
Jump to navigation Jump to search

Globus is an easy-to-use, high-performance data transfer tool developed by the Computation Institute, the University of Chicago and Argonne National Laboratory. UF Research Computing has deployed Globus as one mechanism to facilitate data transfer to and from HiPerGator.

Globus uses a grid-FTP network which uses the power of multiple servers to simultaneously transfer data.

Getting Started

Getting a Globus Account

To use Globus, users must first create a Globus.org user account. Click the "Sign Up" button at Globus.org and follow the instructions.

Globus Endpoints

Globus transfers files between two endpoints. An endpoint is one of the two file transfer locations – either the source or the destination – between which files can move. Once a resource (server, cluster, storage system, laptop, or other system) is defined as an endpoint, it will be available to authorized users who can transfer files to or from this endpoint.

Globus endpoints are named using the following format: <globus-online-username>#<endpoint-name>. For example, Research Computing has an account under the username "ufrc" and so it's endpoint is named ufrc#go. Likewise, an individual that has a Globus account under the username "maxim" might have a personal endpoint called maxim#mylaptop.

UF Research Computing Endpoints

ufrc#go --The primary Globus endpoint for users.
ufrc#test --A secondary endpoint largely designed for testing purposes.

A valid UF Research Computing account is required to access either of these endpoints. If you do not have a Research Computing account, you may request one here.

Shared Endpoints

UFRC users have Globus Plus user status, so they are able to create shared endpoints, which do not require a Research Computing account to connect to. In this mode Globus acts as a secure high-performance equivalent of the Dropbox and other similar services. See Globus Sharing documentation to learn how to create shared endpoints.

Transferring Data Between Endpoints

To transfer data between two endpoints, log in to your account at Globus.org. In the Quick Links drop down, select Transfer Files. Enter the endpoint information and, if needed, authentication information for each endpoint. The example below, shows settings for a transfer between ufrc#go and the FSU Research Computing endpoint fsurc#lustre

Globus transfer.png

After authenticating at both endpoints, navigate to the folder and select the files to transfer and click the arrow corresponding to the direction of the transfer. The transfer will be scheduled and you will receive an email when the transfer has completed.

Advanced Transfer Options

At the bottom of the transfer window, click the More Options link. The drop down will display advanced transfer options. Many of these are useful for file synchronization. There is also an option to encrypt the data transfer, an important option for sensitive data.

Globus Connect Personal

It is possible to transfer data to and from your own computer using the Globus Connect Personal Client. Select Manage Endpoints from the Manage Data drop down, and click the add Globus Connect Personal. Name the endpoint and click the Generate Setup Key. Copy that key. Download and start the install process for the client for your operating system. When prompted, paste the Setup Key into the installation box.

To transfer data to and from your computer, the Globus Connect Personal client must be running. Select it as one of the endpoints for your transfer.

Additional information

For additional support information, please see the Globus Support Site, especially the Quick Start Guides and FAQs.