ISAAC-NG Cluster: System Overview
Overview
The High Performance and Scientific Computing (HPSC) group provides robust computational resources for supporting research across the UT campuses. The ISAAC Next Generation (ISAAC-NG) cluster, in production since January 2022, offers a diverse array of compute nodes appropriate for various computational needs.
Our infrastructure includes:
- High-Performance Compute Nodes: Compute nodes are available with modern Intel processors (Cascade Lake Refresh, Icelake, Sapphire Rapids, Sky Lake) and AMD processors (Bergamo, Genoa, Milan, Rome), totaling over 15,000 cores. These nodes offer a range of core counts per node (32 to 224) and memory configurations (128 GB to 2 TB RAM), ensuring ample capacity for computationally intensive analyses.
- GPU-Accelerated Computing: Dedicated nodes with NVIDIA Tesla V100S, T4, A40, A16, L40, and Hopper H100 GPUs with varying memory capacities (up to 80 GB) are available. These resources are critical for accelerating demanding artificial intelligence and machine learning applications.
- High-Speed Interconnect: All compute nodes are connected via a high-speed EDR InfiniBand network, facilitating efficient communication and parallel processing for large-scale workflows.
- Large Memory Nodes: Several “Bigmem” nodes with up to 2 TB of RAM are available for analyses requiring extensive memory for large-scale data integration.
- NVME Scratch Space: Certain GPU nodes are equipped with fast NVME scratch space (up to 47 TB), providing high-performance temporary storage for data-intensive computations.
The ISAAC-NG cluster’s substantial and diverse computational resources demonstrate OIT’s commitment to providing the necessary infrastructure to support cutting-edge research and education. The availability of a large number of CPU cores, powerful GPUs, high memory nodes, and high-speed interconnect ensures that our faculty, staff, and student researchers have the computational power required for advanced studies and research projects.
For Proposals
If you are working on a proposal and need the ISAAC facilities document it is available here (UT authentication required).
Detail
Node Type | CPU/GPU -GPU_memory | Nodes | Cores/Node | Mem/Node | Total Cores | Interconnect |
---|---|---|---|---|---|---|
Cascade Lake Refresh (University & private condos) | Intel Gold 6248R | 118 | 48 | 192 GB RAM | 5,664 | EDR |
Cascade Lake Refresh 2xNVIDIA Tesla V100S (University & private condos) | Intel Gold 6248R V100S GPU – 32 GB | 6 | 48 | 192 GB RAM | 288 | EDR |
Cascade Lake Refresh 4xNVIDIA Tesla T4 (University) | Intel Gold 6248R NVIDIA T4 GPU | 1 | 48 | 192 GB RAM | 48 | EDR |
Cascade Lake Refresh 2xNVIDIA Tesla V100S (University) | Intel Gold 6248R V100S GPU – 32 GB | 9 | 48 | 768 GB RAM | 432 | EDR |
Cascade Lake Refresh 1xNVIDIA Tesla V100S (Private Condo) | Intel Gold 6248R V100S GPU – 32 GB | 1 | 48 | 192 GB RAM | 48 | EDR |
Cascadelake Refresh Bigmem (University) | Intel Gold 6248R | 4 | 48 | 1.5 TB RAM | 192 | EDR |
Icelake (University & private condos) | Intel Gold 6348 | 38 | 56 | 256 GB RAM | 2,128 | EDR |
Icelake Platinum 4x NVIDIA Ampere A40 56 TB NVME scratch space in /tmp (University) | Intel Platinum 8358 A40 GPU – 48 GB | 1 | 64 | 1 TB RAM + 1.7 TB NVME swap | 64 | EDR |
Icelake Platinum (private condo) | Intel Platinum 8358 | 2 | 64 | 256 GB RAM | 128 | EDR |
Icelake 2xNVIDIA Ampere A16 (private condo) | Intel Gold 6348 A16 GPU – 16 GB | 3 | 56 | 256 GB RAM | 168 | EDR |
Icelake Bigmem (University & private condos) | Intel Gold 6348 | 3 | 56 | 2 TB RAM | 168 | EDR |
Sapphire Rapids (private condos) | Intel Gold 6438M | 5 | 64 | 512 GB RAM | 320 | EDR |
Sapphire Rapids 2xNVIDIA Lovelace L40 (private condo) | Intel Platinum 8462Y+ L40 GPU – 48 GB | 1 | 64 | 768 GB RAM | 64 | EDR |
Sapphire Rapids 4xNVIDIA Hopper H100 47 TB NVME scratch space in /tmp (University and private condo) | Intel Platinum 8462Y+ H100 GPU – 80 GB | 10 | 64 | 1 TB RAM | 640 | EDR |
Sky Lake (University) | Intel Gold 6148 | 8 | 40 | 192 GB RAM | 320 | EDR |
AMD Bergamo (University and private condo) | AMD EPYC 9734 | 17 | 224 | 1 TB RAM | 3,808 | EDR |
AMD Genoa (private condo) | AMD EPYC 9534 | 2 | 128 | 512 GB RAM | 256 | EDR |
AMD Genoa (private condo) | AMD EPYC 9534 | 1 | 128 | 1.5 TB RAM | 128 | EDR |
AMD Genoa (private condo) | AMD EPYC 9334 | 1 | 64 | 1 TB RAM | 64 | EDR |
AMD Milan (private condos) | AMD EPYC 7713 | 7 | 128 | 512 GB RAM | 896 | EDR |
AMD Milan (private condo) | AMD EPYC 7763 | 1 | 64 | 256 GB RAM | 64 | EDR |
AMD Rome | AMD EPYC 7542 | 1 | 32 | 128 | 32 | EDR |
Totals | 240 | 15,792 |