Hardware Config¶
Savio Hardware Configuration¶
The following tables detail the hardware configuration of each partition of nodes. Each partition corresponds to a combination of a generation and type of node. All nodes utilize an FDR Infiniband connection.
CPU Hardware¶
| Partition | # Nodes | Node Range | CPU Model | # Cores | RAM |
|---|---|---|---|---|---|
| savio4_htc | 108 | n0[000-027].savio4 n0[116-119].savio4 n0[146-165].savio4 n0[187-242].savio4 |
Intel Xeon Gold 6330 | 56 | 512 GB |
| savio4_htc | 104 | n0[028-059].savio4 n0[064-115].savio4 n0[166-185].savio4 |
Intel Xeon Gold 6330 | 56 | 256 GB |
| savio4_gpu | 26 | n0[120-145].savio4 | Intel Xeon Gold 6326 | 32 | 512 GB |
| savio4_gpu | 3 | n0[386-388].savio4 | AMD EPYC 9554 | 64 | 792 GB |
| savio3 | 112 | n0[010-029].savio3 n0[042-125].savio3 n0[146-149].savio3 |
Intel Xeon Skylake 6130 | 32 | 96 GB |
| savio3 | 80 | n0[126-133].savio3 n0[139-142].savio3 n0[150-157].savio3 n0[170-173].savio3 n0[193-208].savio3 n0[222-257].savio3 n0[265-272].savio3 |
Intel Xeon Skylake 6230 | 40 | 96 GB |
| savio3_bigmem | 16 | n0[006-009].savio3 n0[030-041].savio3 |
Intel Xeon Skylake 6130 | 32 | 384 GB |
| savio3_bigmem | 4 | n0[162-165].savio3 | Intel Xeon Gold 6230 | 40 | 384 GB |
| savio3_htc | 24 | n0[166-169].savio3 n0[177-192].savio3 n0[218-221].savio3 |
Intel Xeon Skylake 6230 | 40 | 384 GB |
| savio3_xlmem | 2 | n0[000-001].savio3 | Intel Xeon Skylake 6130 | 32 | 1.5 TB |
| savio3_xlmem | 2 | n0[002-003].savio3 | Intel Xeon Skylake 6130 | 52 | 1.5 TB |
| savio3_gpu | 9 | n0[134-138].savio3 n0[158-161].savio3 |
Intel Xeon Skylake 6130 | 8 | 96 GB |
| savio3_gpu | 6 | n0[143-145].savio3 n0[174-176].savio3 |
Intel Xeon Skylake 6130 | 32 | 384 GB |
| savio3_gpu | 1 | n0004.savio3 | Intel Xeon Silver 4208 | 16 | 192 GB |
| savio3_gpu | 1 | n0005.savio3 | Intel Xeon E5-2623 v3 | 8 | 64 GB |
| savio3_gpu | 14 | n0[209-216].savio3 n0[263-264].savio3 n0[273-276].savio3 |
AMD EPYC 7302P (or 7313P) | 16 | 250 GB |
| savio3_gpu | 2 | n0217.savio3 n0262.savio3 |
AMD EPYC 7443P | 24 | 250 GB |
| savio3_gpu | 4 | n0[277-281].savio3 | Intel Xeon Gold 6338 | 64 | 512 GB |
| savio2 | 124 | n0[027-150].savio2 | Intel Xeon E5-2670 v3 | 24 | 64 GB |
| savio2 | 4 | n0[290-293].savio2 | Intel Xeon E5-2650 v4 | 24 | 64 GB |
| savio2 | 35 | n0[187-210].savio2 n0[230-240].savio2 |
Intel Xeon E5-2680 v4 | 28 | 64 GB |
| savio2_bigmem | 36 | n0[151-182].savio2 | Intel Xeon E5-2670 v3 | 24 | 128 GB |
| savio2_bigmem | 8 | n0[282-289].savio2 | Intel Xeon E5-2650 v3 | 24 | 128 GB |
| savio2_htc | 20 | n0[000-011].savio2 n0[215-222].savio2 |
Intel Xeon E5-2643 v3 | 12 | 128 GB |
| savio2_1080ti | 8 | n0[227-229].savio2 n0[298-302].savio2 |
Intel Xeon E5-2623 v3 | 8 | 64 GB |
| savio2_knl | 28 | n0[254-281].savio2 | Intel Xeon Phi 7210 | 64 | 188 GB |
GPU Hardware¶
| Partition | # Nodes | Node Range | GPU Model | VRAM / GPU | CPU:GPU ratio |
|---|---|---|---|---|---|
| savio4_gpu | 26 | n0[120-145].savio4 | 8x RTX A5000 | 24 GB | 4:1 |
| savio4_gpu | 3 | n0[386-388].savio4 | 8x L40 | 46 GB | 8:1 |
| savio3_gpu | 1 | n0004.savio3 | 2x Tesla V100 | 32 GB | 8:1 |
| savio3_gpu | 1 | n0005.savio3 | 2x Tesla V100 | 32 GB | 4:1 |
| savio3_gpu | 9 | n0[134-138].savio3 n0[158-161].savio3 |
4x 2080Ti | 11 GB | 2:1 |
| savio3_gpu | 6 | n0[143-145].savio3 n0[174-176].savio3 |
8x TITAN RTX | 24 GB | 4:1 |
| savio3_gpu | 14 | n0[209-216].savio3 n0[263-264].savio3 n0[273-276].savio3 |
2x A40 | 48 GB | 4:1 |
| savio3_gpu | 2 | n0217.savio3 n0262.savio3 |
2x A40 | 48 GB | 8:1 |
| savio3_gpu | 4 | n0[277-281].savio3 | 2x A40 | 48 GB | 8:1 |
| savio2_1080ti | 8 | n0[227-229].savio2 n0[298-302].savio2 |
4x 1080Ti | 11 GB | 2:1 |
Retired hardware
| Partition | # of Nodes | Node Range | CPU Model | # Cores / Node | RAM / Node | GPU Model | VRAM / GPU |
|---|---|---|---|---|---|---|---|
| savio | 132 | n0[000-095].savio1 | Intel Xeon E5-2670 v2 | 20 | 64 GB | - | - |
| savio_bigmem | 4 | n0[096-099].savio1 | Intel Xeon E5-2670 v2 | 20 | 512 GB | - | - |
| savio2_gpu | 17 | n0[012-026].savio2 n0[223-224].savio2 |
Intel Xeon E5-2623 v3 | 8 | 64 GB | 4x Nvidia K80 | 12 GB |
CGRL Hardware Configuration¶
The CGRL hardware consists of the Vector cluster (a cluster separate from Savio) and the Rosalind condo within Savio. Vector and Rosalind are heterogeneous, with a mix of several different types of nodes. Please be aware of these various hardware configurations, along with their associated scheduler configurations, when specifying options for running your jobs.
| Cluster | Nodes | Node List | CPU | # Cores | RAM |
|---|---|---|---|---|---|
| Vector | 11 | n00[00-03].vector0 n0004.vector0 n00[05-08].vector0 n00[09,10].vector0 |
Intel Xeon X5650 AMD Opteron 6176 Intel Xeon E5-2670 Intel Xeon X5650 |
12 48 16 12 |
96 GB 256 GB 128 GB 48 Gb |
| Rosalind (savio2_htc) | 8 | - | Intel Xeon E5-2643 v3 | 12 | 128 GB |
| Rosalind (savio3_xlmem) | 2 | - | Intel Xeon Skylake 6130 | 32 | 1.5 TB |
| Rosalind (savio4_htc) | 8 | - | Intel Xeon Gold 6330 | 56 | 256 Gb |