01Management infrastructure
Highly available virtualisation cluster based on Proxmox VE 8.3
- · 3 × HPE DL380 Gen10 servers, 192 GB RAM each
- · Shared enterprise storage: HPE MSA 2052
- · High-performance switching: Arista DCS-7060SX2
HA virtualisation layer
02CPU Cluster 1
4 × HPE BladeSystem c7000 Gen3 chassis, 16 compute nodes each
- · HPE BL460 Gen10
- · Intel Xeon Gold 6240 — 36 cores per node
- · 384 GB DDR4 RAM
- · 4.0 TB SSD storage
64 nodes / 2,304 CPU cores
03CPU Cluster 2
8 × HPE BladeSystem c7000 Gen2 chassis, 16 compute nodes each
- · HPE BL460 Gen8
- · 2 × Intel Xeon E5-2680 v2 — 20 cores per node
- · 256 GB DDR3 RAM
- · 3.2 TB SSD storage
128 nodes / 2,560 CPU cores
04GPU Cluster
6 × Supermicro SYS-1028GR-TR GPU servers
- · 2 × Intel Xeon E5-2697A v4 — 30 cores per node
- · 256 GB DDR4 RAM
- · 2 × NVIDIA V100S GPUs per node
61,440 CUDA cores / 7,680 Tensor cores
05Distributed storage (BeeGFS)
Parallel filesystem across dedicated storage nodes
- · 8 storage nodes with 14 storage targets
- · Dedicated metadata servers with NVMe-backed storage
- · Centralised management server
- · High-speed FDR InfiniBand storage network
over 1.5 PB usable
06Archival storage
Hybrid long-term data retention
- · NetApp FAS2620 with DS460C disk shelf — 344 TB
- · IBM 3592 tape library — E05, E07, E08 and LTO-6 formats
344 TB disk + tape