Cheyenne

Hardware | Video overview

Cheyenne is a new 5.34-petaflops, high-performance computer built for NCAR by SGI, now Hewlett Packard Enterprise Company (HPE). The system was released for production work on January 12, 2017. 

Cheyenne supercomputer

An HPE/SGI ICE XA Cluster, the Cheyenne supercomputer features 145,152 latest-generation Intel Xeon processor cores in 4,032 dual-socket nodes (36 cores/node) and 313 TB of total memory.

Cheyenne's login nodes give users access to the GLADE shared-disk resource and the High Performance Storage System (HPSS). With the introduction of Cheyenne, new data storage components provided by DataDirect Networks (DDN) increased the GLADE system’s total usable capacity from 16 PB to 52.7 PB. The new DDN system transfers data at the rate of 200 GBps, which is more than twice as fast as the older file system’s rate of 90 GBps.

 

Estimating core-hours needed

Cheyenne allocations are made in core-hours. The recommended method for estimating your resource needs for an allocation request is to perform benchmark runs. The core-hours used for a job are calculated by multiplying the number of processor cores used by the wall-clock duration in hours. Cheyenne core-hour calculations should assume that all jobs will run in the regular queue and that they are charged for use of all 36 cores on each node.

 


Hardware

145,152 processor cores   2.3-GHz Intel Xeon E5-2697V4 (Broadwell) processors
16 flops per clock
4,032 computation nodes Dual-socket nodes, 18 cores per socket
6 login nodes Dual-socket nodes, 18 cores per socket
256 GB memory/node
313 TB total system memory 64 GB/node on 3,168 nodes, DDR4-2400
128 GB/node on 864 nodes, DDR4-2400
Mellanox EDR InfiniBand
high-speed interconnect
Partial 9D Enhanced Hypercube single-plane interconnect topology
Bandwidth: 25 GBps bidirectional per link
Latency: MPI ping-pong < 1 µs; hardware link 130 ns
3 times Yellowstone computational capacity Comparison based on the relative performance of the CISL High Performance Computing Benchmarks run on each system.
> 3.5 times Yellowstone peak performance 5.34 peak petaflops (vs. 1.504)

Video overview

Slides (PDF)