Difference between revisions of "Globus"

From UFRC
Jump to navigation Jump to search
(Created page with "== Globus == [https://www.globus.org/ Globus] is an easy-to-use, high-performance data transfer tool developed by the Computation Institute, the University of Chicago and Argo...")
 
Line 1: Line 1:
== Globus ==
 
 
[https://www.globus.org/ Globus] is an easy-to-use, high-performance data transfer tool developed by the Computation Institute, the University of Chicago and Argonne National Laboratory. UF Research Computing has deployed Globus as one mechanism to facilitate data transfer to and from HiPerGator.
 
[https://www.globus.org/ Globus] is an easy-to-use, high-performance data transfer tool developed by the Computation Institute, the University of Chicago and Argonne National Laboratory. UF Research Computing has deployed Globus as one mechanism to facilitate data transfer to and from HiPerGator.
  
 
Globus uses a grid-FTP network which uses the power of multiple servers to simultaneously transfer data.
 
Globus uses a grid-FTP network which uses the power of multiple servers to simultaneously transfer data.
  
== Getting Started ==
+
= Getting Started =
===Globus Endpoints===
+
==Getting a Globus Account==
Globus transfers files between endpoints. An endpoint is one of the two file transfer locations – either the source or the destination – between which files can move. Once a resource (server, cluster, storage system, laptop, or other system) is defined as an endpoint, it will be available to authorized users who can transfer files to or from this endpoint.
+
To use Globus, users must first create a Globus.org user account. Click the "Sign Up" button at [https://globus.org Globus.org] and follow the instructions.
 +
 
 +
==Globus Endpoints==
 +
Globus transfers files between two ''endpoints''. An endpoint is one of the two file transfer locations – either the source or the destination – between which files can move. Once a resource (server, cluster, storage system, laptop, or other system) is defined as an endpoint, it will be available to authorized users who can transfer files to or from this endpoint.
  
 
Globus endpoints are named using the following format: <globus-online-username>#<endpoint-name>. For example, Research Computing has an account under the username "ufrc" and so it's endpoint is named ufrc#go. Likewise, an individual that has a Globus account under the username "maxim" might have a personal endpoint called maxim#mylaptop.
 
Globus endpoints are named using the following format: <globus-online-username>#<endpoint-name>. For example, Research Computing has an account under the username "ufrc" and so it's endpoint is named ufrc#go. Likewise, an individual that has a Globus account under the username "maxim" might have a personal endpoint called maxim#mylaptop.
  
====UF Research Computing Endpoints====
+
===UF Research Computing Endpoints===
 
  ufrc#go --The primary Globus endpoint for users.
 
  ufrc#go --The primary Globus endpoint for users.
 
  ufrc#test --A secondary endpoint largely designed for testing purposes.
 
  ufrc#test --A secondary endpoint largely designed for testing purposes.
Line 16: Line 18:
 
A valid UF Research Computing account is required to access either of these endpoints. If you do not have a Research Computing account, you may [http://www.rc.ufl.edu/help/account-request/ request one here].
 
A valid UF Research Computing account is required to access either of these endpoints. If you do not have a Research Computing account, you may [http://www.rc.ufl.edu/help/account-request/ request one here].
 
   
 
   
===Getting a Globus Account===
+
===Shared Endpoints===
To use Globus, users must first create a Globus.org user account. Click the "Sign Up" button at [https://globus.org Globus.org] and follow the instructions.
+
UFRC users have Globus Plus user status, so they are able to create ''shared'' endpoints, which do not require a Research Computing account to connect to. In this mode Globus acts as a secure high-performance equivalent of the Dropbox and other similar services. See [https://support.globus.org/entries/23602336 Globus Sharing documentation] to learn how to create shared endpoints.
  
===Transferring Data Between Established Endpoints===
+
==Transferring Data Between Endpoints==
To transfer data between two established endpoints, log in to your account at [https://globus.org Globus.org]. In the Quick Links drop down, select Transfer Files. Enter the endpoint information and, if needed, authentication information for each endpoint. The example below, shows settings for a transfer between ufrc#go and the FSU Research Computing endpoint fsurc#lustre
+
To transfer data between two endpoints, log in to your account at [https://globus.org Globus.org]. In the Quick Links drop down, select Transfer Files. Enter the endpoint information and, if needed, authentication information for each endpoint. The example below, shows settings for a transfer between ufrc#go and the FSU Research Computing endpoint fsurc#lustre
 
[[File:Globus transfer.png|thumbnail]]
 
[[File:Globus transfer.png|thumbnail]]
  

Revision as of 22:14, 13 January 2016

Globus is an easy-to-use, high-performance data transfer tool developed by the Computation Institute, the University of Chicago and Argonne National Laboratory. UF Research Computing has deployed Globus as one mechanism to facilitate data transfer to and from HiPerGator.

Globus uses a grid-FTP network which uses the power of multiple servers to simultaneously transfer data.

Getting Started

Getting a Globus Account

To use Globus, users must first create a Globus.org user account. Click the "Sign Up" button at Globus.org and follow the instructions.

Globus Endpoints

Globus transfers files between two endpoints. An endpoint is one of the two file transfer locations – either the source or the destination – between which files can move. Once a resource (server, cluster, storage system, laptop, or other system) is defined as an endpoint, it will be available to authorized users who can transfer files to or from this endpoint.

Globus endpoints are named using the following format: <globus-online-username>#<endpoint-name>. For example, Research Computing has an account under the username "ufrc" and so it's endpoint is named ufrc#go. Likewise, an individual that has a Globus account under the username "maxim" might have a personal endpoint called maxim#mylaptop.

UF Research Computing Endpoints

ufrc#go --The primary Globus endpoint for users.
ufrc#test --A secondary endpoint largely designed for testing purposes.

A valid UF Research Computing account is required to access either of these endpoints. If you do not have a Research Computing account, you may request one here.

Shared Endpoints

UFRC users have Globus Plus user status, so they are able to create shared endpoints, which do not require a Research Computing account to connect to. In this mode Globus acts as a secure high-performance equivalent of the Dropbox and other similar services. See Globus Sharing documentation to learn how to create shared endpoints.

Transferring Data Between Endpoints

To transfer data between two endpoints, log in to your account at Globus.org. In the Quick Links drop down, select Transfer Files. Enter the endpoint information and, if needed, authentication information for each endpoint. The example below, shows settings for a transfer between ufrc#go and the FSU Research Computing endpoint fsurc#lustre

Globus transfer.png

After authenticating at both endpoints, navigate to the folder and select the files to transfer and click the arrow corresponding to the direction of the transfer. The transfer will be scheduled and you will receive an email when the transfer has completed.

Advanced Transfer Options

At the bottom of the transfer window, click the More Options link. The drop down will display advanced transfer options. Many of these are useful for file synchronization. There is also an option to encrypt the data transfer, an important option for sensitive data.

Globus Connect Personal

It is possible to transfer data to and from your own computer using the Globus Connect Personal Client. Select Manage Endpoints from the Manage Data drop down, and click the add Globus Connect Personal. Name the endpoint and click the Generate Setup Key. Copy that key. Download and start the install process for the client for your operating system. When prompted, paste the Setup Key into the installation box.

To transfer data to and from your computer, the Globus Connect Personal client must be running. Select it as one of the endpoints for your transfer.

Additional information

For additional support information, please see the Globus Support Site, especially the Quick Start Guides and FAQs.