Hardware

Compute Resources

Node CPU Model CPU Layout Memory GPU OS
darwin
(head node) 		Intel Xeon
Silver 4210 		20 CPUs, 1 socket,
10 cores/socket, 2 threads/core 		32 GB — Rocky Linux 9.7
node01 Intel Xeon
E5-2630 v4 		40 CPUs, 2 sockets,
10 cores/socket, 2 threads/core 		128 GB 2x NVIDIA GeForce RTX 2080 Ti Rocky Linux 9.7
node02 Intel Xeon
E5-2630 v4 		40 CPUs, 2 sockets,
10 cores/socket, 2 threads/core 		128 GB 2x NVIDIA GeForce RTX 2080 Ti Rocky Linux 9.7
node03 Intel Xeon
Gold 6240R 		96 CPUs, 2 sockets,
24 cores/socket, 2 threads/core 		512 GB 2x NVIDIA RTX A5000 Rocky Linux 9.7
node04 Intel Xeon
Gold 5418Y 		96 CPUs, 2 sockets,
24 cores/socket, 2 threads/core 		256 GB 2x NVIDIA RTX A5000 Rocky Linux 9.7
node05 Intel Xeon
Gold 5418Y 		96 CPUs, 2 sockets,
24 cores/socket, 2 threads/core 		256 GB 1x NVIDIA GeForce RTX 2080 Ti
2x NVIDIA GeForce RTX 3080 		Rocky Linux 9.7
node06 Intel Xeon
E5-2630 v4 		40 CPUs, 2 sockets,
10 cores/socket, 2 threads/core 		448 GB 1x NVIDIA RTX A4500 Rocky Linux 9.7
node07 Intel Xeon
E5-2650 v4 		48 CPUs, 2 sockets,
12 cores/socket, 2 threads/core 		256 GB 2x NVIDIA RTX A5000
2x NVIDIA GeForce RTX 2080 Ti 		Rocky Linux 9.7
node08 Intel Xeon
E5-2630 v2 		24 CPUs, 2 sockets,
6 cores/socket, 2 threads/core 		96 GB 2x NVIDIA GeForce RTX 2080 Ti Rocky Linux 9.7
node09 Intel Xeon
X5675 		24 CPUs, 2 sockets,
6 cores/socket, 2 threads/core 		32 GB — Rocky Linux 9.7
node10 Intel Xeon
X5675 		24 CPUs, 2 sockets,
6 cores/socket, 2 threads/core 		32 GB — Rocky Linux 9.7
node11 Intel Xeon
X5675 		24 CPUs, 2 sockets,
6 cores/socket, 2 threads/core 		32 GB — Rocky Linux 9.7
node12 Intel Xeon
X5675 		24 CPUs, 2 sockets,
6 cores/socket, 2 threads/core 		64 GB — Rocky Linux 9.7
node14 Intel Xeon
Gold 6526Y 		64 CPUs, 2 sockets,
16 cores/socket, 2 threads/core 		512 GB 2x NVIDIA RTX A5000
1x NVIDIA RTX A6000 		Rocky Linux 9.7
Performance estimate

~499.6 TFLOPS (FP32): 465.2 TFLOPS from GPUs + 34.4 TFLOPS from CPUs

Storage

Storage Purpose Filesystem Capacity
12x HDD (RAID 6; Seagate ST10000NM0016-1TT101 / ST10000NM001G-2MW103) User data ext4 90.96 TiB
SSD (GIGABYTE GP-ASM2NE6200TTTD) Software ext4 1.8 TiB
SSD (Samsung MZ7LH960HAJR-00005) System XFS 877 GiB
6x SSD (RAID 0; Intel SSDSC2KB019T8) Scratch ext4 11 TiB

Networks

Approximate Darwin network architecture (scheme from trinityX documetation):

The only differences: Darwin has 1 head node (controller) and the head node is also connected to IB network.

Ethernet
  • External (Public) Network: gateway
  • Cluster LAN: internal cluster network for node communication and management
  • IPMI Network: dedicated out-of-band management network (Supermicro IPMI interfaces)
InfiniBand

Switch: 36-port Mellanox Technologies Infiniscale-IV. Speed: 40 Gb/s (4xQDR). Used for high-speed, low-latency communication between compute nodes