Hardware

Compute Resources

Node CPU Model CPU Layout Memory GPU OS
darwin
(head node) 		Intel Xeon
Silver 4210 		20 CPUs, 1 socket,
10 cores/socket, 2 threads/core 		32 GB — Rocky Linux 9.7
node01 Intel Xeon
E5-2630 v4 		40 CPUs, 2 sockets,
10 cores/socket, 2 threads/core 		128 GB 2x NVIDIA GeForce RTX 2080 Ti Rocky Linux 9.7
node02 Intel Xeon
E5-2630 v4 		40 CPUs, 2 sockets,
10 cores/socket, 2 threads/core 		128 GB 2x NVIDIA GeForce RTX 2080 Ti Rocky Linux 9.7
node03 Intel Xeon
Gold 6240R 		96 CPUs, 2 sockets,
24 cores/socket, 2 threads/core 		512 GB 2x NVIDIA RTX A5000 Rocky Linux 9.7
node04 Intel Xeon
Gold 5418Y 		96 CPUs, 2 sockets,
24 cores/socket, 2 threads/core 		256 GB 2x NVIDIA RTX A5000 Rocky Linux 9.7
node05 Intel Xeon
Gold 5418Y 		96 CPUs, 2 sockets,
24 cores/socket, 2 threads/core 		256 GB 1x NVIDIA GeForce RTX 2080 Ti
2x NVIDIA GeForce RTX 3080 		Rocky Linux 9.7
node06 Intel Xeon
E5-2630 v4 		40 CPUs, 2 sockets,
10 cores/socket, 2 threads/core 		448 GB 1x NVIDIA RTX A4500 Rocky Linux 9.7
node08 Intel Xeon
E5-2630 v2 		24 CPUs, 2 sockets,
6 cores/socket, 2 threads/core 		96 GB 2x NVIDIA GeForce RTX 2080 Ti Rocky Linux 9.7
node09 Intel Xeon
X5675 		24 CPUs, 2 sockets,
6 cores/socket, 2 threads/core 		32 GB — Rocky Linux 9.7
node10 Intel Xeon
X5675 		24 CPUs, 2 sockets,
6 cores/socket, 2 threads/core 		32 GB — Rocky Linux 9.7
node11 Intel Xeon
X5675 		24 CPUs, 2 sockets,
6 cores/socket, 2 threads/core 		32 GB — Rocky Linux 9.7
node12 Intel Xeon
X5675 		24 CPUs, 2 sockets,
6 cores/socket, 2 threads/core 		64 GB — Rocky Linux 9.7
node14 Intel Xeon
Gold 6526Y 		64 CPUs, 2 sockets,
16 cores/socket, 2 threads/core 		512 GB 2x NVIDIA RTX A5000
1x NVIDIA RTX A6000 		Rocky Linux 9.7
Performance estimate

~415.7 TFLOPS (FP32): 383.0 TFLOPS from GPUs + 32.7 TFLOPS from CPUs

Storage

Storage Purpose Filesystem Capacity
12x HDD (RAID 6) User data ext4 90.96 TiB
SSD (NVMe) Software ext4 1.8 TB
SSD (SATA) System XFS 877 GB

Networks

Approximate Darwin network architecture (scheme from trinityX documetation):

The only differences: Darwin has 1 head node (controller) and the head node is also connected to IB network.

Ethernet
  • External (Public) Network: gateway
  • Cluster LAN: internal cluster network for node communication and management
  • IPMI Network: dedicated out-of-band management network (Supermicro IPMI interfaces)
InfiniBand

Switch: 36-port Mellanox Technologies Infiniscale-IV. Speed: 40 Gb/s (4xQDR). Used for high-speed, low-latency communication between compute nodes