Hardware Config¶
Savio Hardware Configuration¶
The following table details the hardware configuration of each partition of nodes. Each partition corresponds to a combination of a generation and type of node.
| Partition | Nodes | Node List | CPU Model | # Cores / Node | Memory / Node | Infiniband | Specialty | Scheduler Allocation |
|---|---|---|---|---|---|---|---|---|
| savio [Retired] | 132 | n0[000-095].savio1 | Intel Xeon E5-2670 v2 | 20 | 64 GB | FDR | - | By Node |
| savio_bigmem [Retired] | 4 | n0[096-099].savio1 | Intel Xeon E5-2670 v2 | 20 | 512 GB | FDR | BIGMEM | By Node |
| savio2 | 124 | n0[027-150].savio2 | Intel Xeon E5-2670 v3 | 24 | 64 GB | FDR | - | By Node |
| savio2 | 4 | n0[290-293].savio2 | Intel Xeon E5-2650 v4 | 24 | 64 GB | FDR | - | By Node |
| savio2 | 35 | n0[187-210].savio2 n0[230-240].savio2 |
Intel Xeon E5-2680 v4 | 28 | 64 GB | FDR | - | By Node |
| savio2_bigmem | 36 | n0[151-182].savio2 | Intel Xeon E5-2670 v3 | 24 | 128 GB | FDR | BIGMEM | By Node |
| savio2_bigmem | 8 | n0[282-289].savio2 | Intel Xeon E5-2650 v3 | 24 | 128 GB | FDR | BIGMEM | By Node |
| savio2_htc | 20 | n0[000-011].savio2 n0[215-222].savio2 |
Intel Xeon E5-2643 v3 | 12 | 128 GB | FDR | HTC | By Core |
| savio2_gpu [Retired (GPUs not available)] | 17 | n0[012-026].savio2 n0[223-224].savio2 |
Intel Xeon E5-2623 v3 | 8 | 64 GB | FDR | 4x Nvidia K80 (12 GB GPU memory per GPU) | By Core |
| savio2_1080ti | 8 | n0[227-229].savio2 n0[298-302] |
Intel Xeon E5-2623 v3 | 8 | 64 GB | FDR | 4x Nvidia 1080ti (11 GB GPU memory per GPU) | By Core |
| savio2_knl | 28 | n0[254-281].savio2 | Intel Xeon Phi 7210 | 64 | 188 GB | FDR | Intel Phi | By Node |
| savio3 | 112 | n0[010-029].savio3 n0[042-129].savio3 n0[146-149].savio3 |
Intel Xeon Skylake 6130 @ 2.1 GHz | 32 | 96 GB | FDR | By Node | |
| savio3 | 80 | n0[130-133].savio3 n0[139-142].savio3 n0[150-157] n0[170-173].savio3 n0[193-208].savio3 n0[222-257].savio3 n0[265-272].savio3 |
Intel Xeon Skylake 6230 @ 2.1 GHz | 40 | 96 GB | FDR | By Node | |
| savio3_bigmem | 16 | n0[006-009].savio3 n0[030-041].savio3 |
Intel Xeon Skylake 6130 @ 2.1 GHz | 32 | 384 GB | FDR | BIGMEM | By Node |
| savio3_bigmem | 4 | n0[162-165].savio3 | Intel Xeon Gold 6230 @ 2.1 GHz | 40 | 384 GB | FDR | BIGMEM | By Node |
| savio3_htc | 24 | n0[166-169].savio3 n0[177-192].savio3 n0[218-221].savio3 |
Intel Xeon Skylake 6230 @ 2.1 GHz | 40 | 384 GB | FDR | HTC | By Core |
| savio3_xlmem | 2 | n0[000-001].savio3 | Intel Xeon Skylake 6130 @ 2.1 GHz | 32 | 1.5 TB | FDR | XL Memory | By Node |
| savio3_xlmem | 2 | n0[002-003].savio3 | Intel Xeon Skylake 6130 @ 2.1 GHz | 52 | 1.5 TB | FDR | XL Memory | By Node |
| savio3_gpu | 9 | n0[134-138].savio3 n0[158-161].savio3 |
Intel Xeon Skylake 6130 @ 2.1 GHz | 8 | 96 GB | FDR | 4x GTX 2080ti GPU (11 GB GPU memory per GPU) | By Core |
| savio3_gpu | 6 | n0[143-145].savio3 n0[174-176].savio3 |
Intel Xeon Skylake 6130 @ 2.1 GHz | 32 | 384 GB | FDR | 8x TITAN RTX GPU (24 GB GPU memory per GPU) | By Core |
| savio3_gpu | 1 | n0004.savio3 | Intel Xeon Silver 4208 @ 2.1 GHz | 16 | 192 GB | FDR | 2x Tesla V100 GPU (32 GB GPU memory per GPU) | By Core |
| savio3_gpu | 1 | n0005.savio3 | Intel Xeon E5-2623 v3 @ 3.0 GHz | 8 | 64 GB | FDR | 2x Tesla V100 GPU (32 GB GPU memory per GPU) | By Core |
| savio3_gpu | 14 | n0[209-216].savio3 n0[263-264].savio3 n0[273-276].savio3 |
AMD EPYC 7302P (or 7313P) | 16 | 250 GB | FDR | 2x A40 GPU (48 GB GPU memory per GPU) | By Core |
| savio3_gpu | 2 | n0217.savio3 n0262.savio3 |
AMD EPYC 7443P | 24 | 250 GB | FDR | 2x A40 GPU (48 GB GPU memory per GPU) | By Core |
| savio3_gpu | 4 | n0[277-281].savio3 | Intel Xeon Gold 6338 | 64 | 512 GB | FDR | 4x A40 GPU (48 GB GPU memory per GPU) | By Core |
| savio3_gpu | 2 | n0[282-283].savio3 | AMD EPYC 7543P | 32 | 512 GB | FDR | 4x A40 GPU (48 GB GPU memory per GPU) | By Core |
| savio4_htc | 52 | n0[000-027].savio4 n0[116-119].savio4 n0[146-165].savio4 |
Intel Xeon Gold 6330 @ 2.0 GHz | 56 | 512 GB | FDR | By Core | |
| savio4_htc | 104 | n0[028-035].savio4 n0[040-115].savio4 n0[166-185].savio4 |
Intel Xeon Gold 6330 @ 2.0 GHz | 56 | 256 GB | FDR | By Core | |
| savio4_gpu | 26 | n0[120-145].savio4 | Intel Xeon Gold 6326 @ 2.9 GHz | 32 | 512 GB | FDR | 8x RTX A5000 (24 GB GPU memory per GPU) | By Core |
CGRL Hardware Configuration¶
The CGRL hardware consists of the Vector cluster (a cluster separate from Savio) and the Rosalind condo within Savio. Vector and Rosalind are heterogeneous, with a mix of several different types of nodes. Please be aware of these various hardware configurations, along with their associated scheduler configurations, when specifying options for running your jobs.
| Cluster | Nodes | Node List | CPU | Cores/Node | Memory/Node | Scheduler Allocation |
|---|---|---|---|---|---|---|
| Vector | 11 | n00[00-03].vector0 n0004.vector0 n00[05-08].vector0 n00[09]-n00[10].vector0 |
Intel Xeon X5650, 2.66 GHz AMD Opteron 6176, 2.3 GHz Intel Xeon E5-2670, 2.60 GHz Intel Xeon X5650, 2.66 GHz |
12 48 16 12 |
96 GB 256 GB 128 GB 48 |
By Core |
| Rosalind (savio2_htc) | 8 | floating condo within: n0[000-011].savio2, n0[215-222].savio2 |
Intel Xeon E5-2643 v3, 3.40 GHz | 12 | 128 GB | By Core |
| Rosalind (savio3_xlmem) | 2 | floating condo within: n0[000-003].savio3 |
Intel Xeon Skylake 6130 @ 2.1 GHz | 32 | 1.5 TB | By Node |