===== Hardware ===== ==== Compute Resources ==== ^ Node ^ CPU Model ^ CPU Layout ^ Memory ^ GPU ^ %%OS%% ^ | darwin\\ (head node) | Intel Xeon\\ Silver 4210 | 20 CPUs, 1 socket,\\ 10 cores/socket, 2 threads/core | 32 %%GB%% | --- | Rocky Linux 9.7 | | node01 | Intel Xeon\\ E5-2630 v4 | 40 CPUs, 2 sockets,\\ 10 cores/socket, 2 threads/core | 128 %%GB%% | 2x NVIDIA GeForce RTX 2080 Ti | Rocky Linux 9.7 | | node02 | Intel Xeon\\ E5-2630 v4 | 40 CPUs, 2 sockets,\\ 10 cores/socket, 2 threads/core | 128 %%GB%% | 2x NVIDIA GeForce RTX 2080 Ti | Rocky Linux 9.7 | | node03 | Intel Xeon\\ Gold 6240R | 96 CPUs, 2 sockets,\\ 24 cores/socket, 2 threads/core | 512 %%GB%% | 2x NVIDIA RTX A5000 | Rocky Linux 9.7 | | node04 | Intel Xeon\\ Gold 5418Y | 96 CPUs, 2 sockets,\\ 24 cores/socket, 2 threads/core | 256 %%GB%% | 2x NVIDIA RTX A5000 | Rocky Linux 9.7 | | node05 | Intel Xeon\\ Gold 5418Y | 96 CPUs, 2 sockets,\\ 24 cores/socket, 2 threads/core | 256 %%GB%% | 1x NVIDIA GeForce RTX 2080 Ti\\ 2x NVIDIA GeForce RTX 3080 | Rocky Linux 9.7 | | node06 | Intel Xeon\\ E5-2630 v4 | 40 CPUs, 2 sockets,\\ 10 cores/socket, 2 threads/core | 448 %%GB%% | 1x NVIDIA RTX A4500 | Rocky Linux 9.7 | | node08 | Intel Xeon\\ E5-2630 v2 | 24 CPUs, 2 sockets,\\ 6 cores/socket, 2 threads/core | 96 %%GB%% | 2x NVIDIA GeForce RTX 2080 Ti | Rocky Linux 9.7 | | node09 | Intel Xeon\\ X5675 | 24 CPUs, 2 sockets,\\ 6 cores/socket, 2 threads/core | 32 %%GB%% | --- | Rocky Linux 9.7 | | node10 | Intel Xeon\\ X5675 | 24 CPUs, 2 sockets,\\ 6 cores/socket, 2 threads/core | 32 %%GB%% | --- | Rocky Linux 9.7 | | node11 | Intel Xeon\\ X5675 | 24 CPUs, 2 sockets,\\ 6 cores/socket, 2 threads/core | 32 %%GB%% | --- | Rocky Linux 9.7 | | node12 | Intel Xeon\\ X5675 | 24 CPUs, 2 sockets,\\ 6 cores/socket, 2 threads/core | 64 %%GB%% | --- | Rocky Linux 9.7 | | node14 | Intel Xeon\\ Gold 6526Y | 64 CPUs, 2 sockets,\\ 16 cores/socket, 2 threads/core | 512 %%GB%% | 2x NVIDIA RTX A5000\\ 1x NVIDIA RTX A6000 | Rocky Linux 9.7 | == Performance estimate == ~415.7 TFLOPS (FP32): 383.0 TFLOPS from GPUs + 32.7 TFLOPS from CPUs ==== Storage ==== ^ Storage ^ Purpose ^ Filesystem ^ Capacity ^ | 12x HDD (RAID 6) | User data | ext4 | 90.96 %%TiB%% | | SSD (NVMe) | Software | ext4 | 1.8 %%TB%% | | SSD (SATA) | System | XFS | 877 %%GB%% | ==== Networks ==== Approximate Darwin network architecture (scheme from [[https://docs.clustervision.com/install/preinstall/#network-requirements-and-configuration|trinityX documetation]]): {{ :cluster_ha.svg |}} The only differences: Darwin has 1 head node (controller) and the head node is also connected to IB network. == Ethernet == * **External (Public) Network:** gateway * **Cluster %%LAN%%:** internal cluster network for node communication and management * **IPMI Network:** dedicated out-of-band management network (Supermicro IPMI interfaces) == InfiniBand == Switch: 36-port Mellanox Technologies Infiniscale-IV. Speed: 40 Gb/s (4xQDR). Used for high-speed, low-latency communication between compute nodes