Opportunity for university researchers on Derecho supercomputer

The National Center for Atmospheric Research (NCAR) will soon be accepting proposals from university-led teams to participate in the Accelerated Scientific Discovery (ASD) program on the new Derecho supercomputer. NCAR will deploy Derecho, its next-generation HPC system, later this year.

NCAR's Derecho supercomputer logoThe ASD program provides a unique opportunity for a small group of large-scale computational projects to have nearly exclusive use of the Derecho system for a few months. During this time, ASD teams will work closely with NCAR’s high-performance computing staff to optimize their workflows, ensure that the environment is properly configured for maximum efficiency, and demonstrate the capabilities of the 19.87-petaflops system.

For university participants in the ASD program, NCAR will make about 225 million core-hours available to five or six CPU-oriented projects and 225,000 GPU-hours to three or four GPU-oriented projects. The bulk of the ASD computational runs should be completed during the first two months after Derecho is accepted – that is, in January and February 2022 as currently planned. 

The minimum scale of CPU-oriented projects is 30 million core-hours and the minimum for GPU-oriented projects is 50,000 GPU-hours. Larger-scale proposals and hybrid CPU/GPU proposals are encouraged. NCAR will provide storage resources to support ASD projects during the computational and analysis phases; long-term storage plans should be described in the proposal.

ASD eligibility, review considerations and support

To be eligible for an ASD allocation, the research team must have an active NSF award that is generally consistent with the proposed ASD activity and is within the atmospheric, climate, oceanographic, or related sciences.

NCAR recognizes that conducting an ASD project places significant demands on a research team. To encourage ASD proposals from the broadest possible range of researchers and institutions, NCAR may be able to provide dedicated, collaborative staffing time and effort to complement a university team’s skill set. Interested researchers should contact the ASD program coordinator, David Hart (dhart@ucar.edu) to discuss possibilities for NCAR collaborative support before preparing an ASD proposal. Research teams led by or in collaboration with minority-serving institutions (MSIs) or non-R1 institutions are strongly encouraged.

ASD proposals will be reviewed by the CISL HPC Allocations Panel (CHAP), and proposals should follow the instructions for preparing large-scale allocation requests, which can be viewed on the CISL web site. In addition to the usual review criteria, the CHAP will closely assess several other factors that must be addressed in the proposal:

  • Project readiness: Successful proposals will have established, science-ready code and a team with sufficient experience to begin conducting full-scale runs on Day One.
  • Team commitment: Successful proposals will demonstrate that the research team has staffing resources available to be committed to the ASD preparation and computing periods and to complete the primary science runs.
  • Analysis and data management plan: Research teams need to show that they have staffing available to analyze the ASD model output and the resources available to handle long-term data management needs. NCAR will provide access to our analysis and storage resources for up to one year after the ASD computation period has ended.

ASD proposal and project schedule

The ASD proposal and project schedule is outlined below. Research teams must commit to have necessary staff members available for the various ASD phases.

Jul. 1 – Sep. 3 University ASD proposals may be submitted.
Sep. 6 – 24 Review of proposals by CHAP.
Sep. 29 University ASD projects selected and notified.
Mid-October ASD teams on Derecho test systems. Test systems should be used to familiarize teams with the Derecho environment and verify that code configurations and workflows compile, run, and produce expected results on the Derecho hardware.
Jan. 3, 2022 ASD teams begin primary computational runs on Derecho following system acceptance.
Feb. 7, 2022 ASD projects not able to make sufficient progress may be ended.
Mar. 7, 2022 ASD science runs should be largely completed; some continued access will be available to complete projects that are making good progress. ASD analysis phase begins.
Mar. 31, 2023 ASD projects expected to complete analysis phase and migrate data for long-term preservation.