Quasar archive for data collections

Storing data | Policies

The Quasar archive is a cold archive for storing curated data collections that have an indefinite lifetime. It is not designed to serve data or to store data that will be frequently accessed, overwritten, or deleted. (Active data should be on GLADE or Campaign Storage rather than on Quasar.)

Before requesting access, please review the following information regarding how to archive files, the minimum and maximum file sizes, and related use policies.

The archive is not yet in production but available to some early users. It may be subject to maintenance downtimes on short notice and more frequently than a production resource.


Storing data

Users store data on Quasar by transferring files via the Globus endpoint named NCAR Quasar. For documentation about how to use Globus, see Globus file transfers.

The target file size for Quasar is 1 GB or larger, so use a tool like tar to combine multiple smaller files into a larger file or files before storing them. The minimum file size is 500 MB and the maximum is 5 TB.

If a special need arises, please contact CISL.

File reads and data/metadata change frequency

The system is designed to support large file writes effectively. As a cold archive, however, it's not designed to support a lot of read activity. File reads should be infrequent, and data and metadata changes should also be rare.

Under normal operational use, no more than 10% of your files should be read, rewritten, renamed, or deleted during any 12-month period.

If a special case arises – a recovery operation, for example – and you anticipate more activity, please contact CISL.


Policies

  • The system is not backed up.
  • Vendor support for the system is 9 a.m. to 5 p.m. next business day, so problems that occur outside of those hours may need to wait to be resolved.
  • CISL does not enforce file size at writing time, but when files smaller than the minimum size are found on the system, you may be asked to relocate the holdings to more appropriate storage such as the NCAR Campaign Storage file system or Stratus object storage system.
  • If excessive read, rewrite, or metadata change activity is detected, you may be asked to relocate the holdings to more appropriate storage such as the NCAR Campaign Storage file system or Stratus object storage system.