Cheyenne

Hardware | Video overview

Cheyenne is a new 5.34-petaflops, high-performance computer built for NCAR by SGI. The system was released for production work on January 12, 2017. 

Cheyenne supercomputer

An SGI ICE XA Cluster, the Cheyenne supercomputer features 145,152 latest-generation Intel Xeon processor cores in 4,032 dual-socket nodes (36 cores/node) and 313 TB of total memory.

Cheyenne's login nodes give users access to the GLADE shared-disk resource and the High Performance Storage System (HPSS). With the introduction of Cheyenne, new data storage components provided by DataDirect Networks (DDN) increased the GLADE system’s total usable capacity from 16 PB to 31 PB, and further increases are planned. The new DDN system transfers data at the rate of 200 GBps, which is more than twice as fast as the older file system’s rate of 90 GBps.

 

Core-hours on Cheyenne and Yellowstone

For purposes of Cheyenne allocations, smaller allocation requests may assume that one Yellowstone core-hour is equivalent to 0.82 Cheyenne core-hours. That is, estimate your computational need based on Yellowstone costs and multiply the total by 0.82 to arrive at your Cheyenne estimate. Users expecting to make larger requests ideally should request a small allocation first and perform benchmark runs for the most accurate cost estimates.

 


Hardware

145,152 processor cores   2.3-GHz Intel Xeon E5-2697V4 (Broadwell) processors
16 flops per clock
4,032 computation nodes Dual-socket nodes, 18 cores per socket
6 login nodes Dual-socket nodes, 18 cores per socket
256 GB memory/node
313 TB total system memory 64 GB/node on 3,168 nodes, DDR4-2400
128 GB/node on 864 nodes, DDR4-2400
Mellanox EDR InfiniBand
high-speed interconnect
Partial 9D Enhanced Hypercube single-plane interconnect topology
Bandwidth: 25 GBps bidirectional per link
Latency: MPI ping-pong < 1 µs; hardware link 130 ns
3 times Yellowstone computational capacity Comparison based on the relative performance of the CISL High Performance Computing Benchmarks run on each system.
> 3.5 times Yellowstone peak performance 5.34 peak petaflops (vs. 1.504)

Video overview

Slides (PDF)