- Data Portals
- User Support
- About Us
The NCAR Data Sharing Service enables users who have access to NCAR storage resources—such as GLADE, CISL's data-access nodes, and HPSS—to share files with anyone who has a Globus account.
An individual does not need to have an NCAR user account or token to retrieve shared data.
To retrieve data: Skip to Retrieving data from a shared endpoint at the bottom of this page.
To share data: Follow the links below to learn about getting access to the service, setting up endpoints for sharing data, and then actually sharing the data.
The shared space is for temporary, short-term use. Data placed there are not backed up. Effective March 27, 2017, files that are not accessed for 45 days are automatically deleted.
The default user quota is 50 TB. More space can be made available upon request.
NCAR is open to considering ideas for additional use cases. Email firstname.lastname@example.org.
After you do the initial setup, you can share data by following these steps, which are described in detail below:
There are two steps to take before you can share files with this service:
Request access to NCAR's Globus data-sharing space by sending an email to email@example.com.
The CISL Help Desk will notify you when your personal directory has been created on the NCAR host endpoint, which is named: NCAR Data Sharing Service. Your personal directory on that endpoint will be identified as a path like this: /glade/p/datashare/bjsmith
You will need to use that information on a Globus Transfer screen later, as shown here:
Go to the Globus site to create an account.
Carefully consider your choice of Globus username. A division or group name might be appropriate in some cases.
Individuals do not need to belong to a group in order for you to share data with them, but the group management features may be useful in some cases. For example, if you need to share data with several people, sharing with them as a group may be more efficient than sharing with each individually.
See Globus Groups for how to establish a group and manage group member access. First, you will need to know what names and email addresses your colleagues used when creating their own Globus accounts. You will use that information to add them as group members. You can add or remove individuals from a group as needed.
After your personal directory has been created on the NCAR host endpoint, you can create your own shared endpoints.
Use the Sharing tab to share your endpoint with others.
To change access and permissions later, go to Endpoints.
After your personal directory has been created on the NCAR host endpoint, you can create shared endpoints from the Globus command line.
First, activate the host endpoint.
endpoint-add -n <name> --sharing <host-endpoint>/<directory>
endpoint-add -n foldername --sharing=ncar#datashare/glade/p/datashare/username/
NCAR users' output will be similar to this:
ncar#datashare - ncar#gridftp - username#mydir - username#shared_endpoint -
Run endpoint-search ncar to get a list of NCAR-related endpoints. The output will include the endpoints' display names, which are used in the web interface, and the legacy names, which are used in the CLI.
Here's an example:
ID : dd1ee92a-6d04-11e5-ba46-22000b92c6ec Display Name : NCAR Data Sharing Service Legacy Name : ncar#datashare Owner : ncar Credential Status : ACTIVE Host Endpoint : n/a Host Endpoint Name: n/a
See Transferring files with the command line interface or enter help on your command line for additional information.
There are two ways to copy files from GLADE to a shared endpoint.
To copy files from a GLADE file space such as /glade/u/home/username to a shared endpoint, use Globus just as you would when transferring files to a non-NCAR system.
You can do that with the Globus GUI or CLI as documented here: Globus file transfers
You can use standard Linux commands to copy files to your shared endpoints from CISL's data-access nodes, which mount both the GLADE file systems and the data-sharing file system.
Log in to data-access.ucar.edu the same way you would log in to yellowstone.ucar.edu.
When you log in, you are in /glade/u/home/username by default. You can change to your other GLADE directories as needed.
Copy the files that you want to share from your GLADE directory to the target for the shared endpoint that you created earlier, as shown in this example.
cp file1 file2 file3 /glade/p/datashare/username/foldername
Notify the users or groups that files are available.
A user must have or create a Globus account in order to retrieve data from a shared endpoint. The user does not need to have an NCAR user account or token to retrieve data.
The user also needs to have access to a destination location. The location which can be:
To copy files from a shared endpoint to a destination endpoint, see the Globus file transfers documentation.