- Data Portals
- User Support
- About Us
The NCAR Data Sharing Service enables users to share files with anyone who has a Globus account. The service is for users who have access to NCAR storage resources such as GLADE and HPSS, typically through the Yellowstone system or via CISL's data-access nodes.
An individual does not need to have an NCAR user account or token to retrieve shared data.
Follow the links below to learn about getting access to the service, setting up endpoints for sharing data, and then actually sharing the data.
The shared space is for temporary, short-term use. Data placed there are not backed up.
The default user quota is 50 TB; more space can be made available upon request.
NCAR is open to considering ideas for additional use cases. Email email@example.com.
After you do the initial setup, you can share data by following these steps, which are described in detail below:
There are two steps to take before you can share files with this service:
Request access to NCAR's Globus data-sharing space by sending an email to firstname.lastname@example.org.
The CISL Help Desk will notify you when your personal directory has been created on the NCAR host endpoint, which is named: ncar#datashare
Your personal directory on that endpoint will be identified as a path like this: /data/share/bjsmith
You will need to use that information on a Globus Transfer screen later, as shown here:
Go to the Globus site to create an account.
Carefully consider your choice of Globus username. Any endpoint that you create will include that username.
For example, if John Smith chooses jsmith as his Globus username, any endpoint he creates with start with "jsmith" – as in jsmith#mydata.
A division or group name might be more appropriate in some cases. The CISL Consulting Services Group, for example, might set up a Globus account with the username cislcsg to have an endpoint named cislcsg#data.
Individuals do not need to belong to a group in order for you to share data with them, but the group management features may be useful in some cases. For example, if you need to share data with several people, it can be more efficient to share with them as a group rather than individually.
See Globus Groups for how to establish a group and manage group member access. First, you will need to know what names and email addresses your colleagues used when creating their own Globus accounts. You will use that information to add them as group members. You can add or remove individuals from a group as needed.
After your personal directory has been created on the NCAR host endpoint, you can create your own shared endpoints.
After you name your new endpoint and click Create and Manage Access (shown in the image just above), click Add Permission.
To change access and permissions later, go to Manage Endpoints.
After your personal directory has been created on the NCAR host endpoint, you can create shared endpoints from the Globus command line.
The host endpoint also must be activated.
endpoint-add <name> --sharing <host-endpoint>/<directory>
endpoint-add foldername --sharing=ncar#datashare/data/share/username/
NCAR users' output will be similar to this:
username#mydir - go#ep1 - go#ep2 - ncar#datashare - ncar#gridftp -
See Transferring files with the command line interface or enter help on your command line for additional information.
There are two ways to copy files from GLADE to a shared endpoint.
To copy files from a GLADE file space such as /glade/u/home/username to a shared endpoint, use Globus just as you would when transferring files to a non-NCAR system.
You can do that with the Globus GUI or CLI as documented here: Globus file transfers
You can use standard Linux commands to copy files to your shared endpoints from CISL's data-access nodes, which mount both the GLADE file systems and the data-sharing file system.
Log in to data-access.ucar.edu the same way you would log in to yellowstone.ucar.edu.
When you log in, you are in /glade/u/home/username by default. You can change to your other GLADE directories as needed.
Copy the files that you want to share from your GLADE directory to the target for the shared endpoint that you created earlier, as shown in this example.
cp file1 file2 file3 /data/share/username/foldername
Notify the users or groups that files are available.
A user must have or create a Globus account in order to retrieve data from a shared endpoint. The user does not need to have an NCAR user account or token to retrieve data.
The user also needs to have access to a destination location, which can be:
To copy files from the shared endpoint to the destination endpoint, see the Globus file transfers documentation.