Using data-access nodes

Logging in | Using GLADE scratch | Getting files from HPSS | Transferring files

Anyone who has a Yellowstone computing and storage allocation can use CISL's data-access nodes to migrate data from the HPSS tape archive, GLADE disk resource, and Research Data Archive as described below.

The data-access nodes are not compute nodes and any tasks that you run on them are run "at risk." Short, non-memory-intensive processes are allowed, including such tasks as text editing or running small scripts for transferring files. If any task consumes excessive resources (determined at the discretion of the CISL consultants or system administrators), a system administrator will kill the process or processes and you will be notified.

If you do not have an allocation but need to use the nodes to get data from CISL storage resources, submit a Small Data Access Request.

Data-access nodes are not intended for use as long-term storage. No usage charges are assessed for reading data.


Logging in

To use these resources, log in to data-access.ucar.edu. Use your UCAR username, PIN, and authentication token as described in our Authentication and security documentation.

Use ssh as follows if your username on your local computer is the same as your UCAR username:

ssh data-access.ucar.edu

If your UCAR username and your username on your local computer are different, log in with your UCAR username as follows:

ssh username@data-access.ucar.edu

Using GLADE scratch

When you log in, you are in /glade/u/home/username by default. Use the larger /glade/scratch/username file space to hold data that you read out of HPSS.

You can also read files from other GLADE file spaces to which you have been granted read permissions.

See GLADE for more information about file spaces.


Getting files from HPSS

After logging in, use either the HSI interface or the HTAR utility to fetch files from the High Performance Storage System (HPSS) archive.

See our HPSS documentation for details.


Transferring files

To transfer data between data-access.ucar.edu and another system, use any of these tools:

  • Globus - the endpoint for data-access projects is NCAR GLADE (legacy name: ncar#gridftp).
  • SCP/SFTP
  • BBCP

See those links for documentation.