Globus file transfers

Web interface transfers | CLI transfers | Globus Connect Personal

Transferring files between GLADE and the separate NCAR Campaign Storage file system requires the use of Globus. CISL also recommends using Globus as the most efficient way to transfer files between NCAR file systems such as GLADE and non-NCAR resources, including XSEDE facilities and other sites.

Globus has both a web interface and a command line interface (CLI). To use either interface, the first step is to create a personal Globus ID account. (UCAR and NCAR staff should not use the NCAR RDA organizational login.)

Several public endpoints are set up on the Globus system for transferring files to and from the GLADE disk storage system. They include:

  • NCAR GLADE
  • NCAR Campaign Storage
  • NCAR Data Sharing Service
  • XSEDE NCAR GLADE for users who have XSEDE credentials.

Globus also offers a feature called Globus Connect Personal for moving files to and from a laptop or desktop computer and other "endpoints."


Transferring files with the web interface

When transferring files between systems, keep in mind that your username might not be the same on each system.

Follow these steps to transfer files. See the image below for reference.

  1. Go to the main Globus page (globus.org) and log in using your personal Globus ID
  2. Go to File Manager.
  3. Use the Panels button to display two endpoint panels side by side.
  4. Enter the name of your source endpoint in the Collection field on one panel.
  5. Specify the path where your source files are located.
  6. Enter your username and token response or password when you are asked to authenticate.
  7. Identify your target endpoint in the other panel.
  8. Specify a destination path.
  9. Select the files you want to copy.
  10. Click the Start button to initiate the transfer.

You can check the status of your transfers any time through the web interface and will be notified when they are complete.

Globus


Transferring files with the command line interface

The Globus CLI application is installed on the NCAR/CISL data-access nodes. It can be used to make both manual and unattended file transfers. How to use the CLI is described in detail here:

Globus CLI tutorial

To begin, log in as shown. (If your UCAR username and your username on your local computer are different, follow the alternative example.)

ssh data-access.ucar.edu (alternative: ssh username@data-access.ucar.edu)

Run globus login and follow the on-screen instructions.

globus login

Output example:

Please log into Globus here:

------------------------------------

URL to copy and paste into your browser.

------------------------------------

Enter the resulting Authorization Code here:

Copy the lengthy URL and paste it into your browser. It will take you to a consent form that looks like this:

Globus CLI access permissions

Click Allow to give the CLI app the necessary access and you will receive an authorization code.

After entering the code, you will be logged in to the Globus CLI and in your /glade/u/home directory.

Additional resources

Globus provides these additional resources for how to make batch transfers and single item transfers, manage endpoints, and more.

Your default shell on the data-access nodes is tcsh. To change your current shell, just enter bash or another preferred shell.


Globus Connect Personal

To set up your laptop or desktop computer to use Globus Connect Personal:

  • Go to Globus Connect Personal and follow the instructions to download and install it on your local system.
  • Add your local system as an endpoint by following the instructions from the Globus Connect website.
  • Start Globus Connect, and then sign in to globus.org.

Your local system should now appear as an endpoint that can be used for transferring files.

Related training courses