Nvidia DGX A100 Operation & User’s Manual
Read Online
Read the Nvidia DGX A100 Operation & User’s Manual online using the built-in PDF viewer.
Key Pages of Document
DU-09821-001_v06 | ii Table of Contents Chapter 1. Introduction............................................................................................ 1 1.1 Hardware Overview ............................................................................................................ 2 1.1.1 DGX A100 Models and Component Descriptions ...
DU-09821-001_v06 | iii Chapter 4. Quick Start and Basic Operation ......................................................... 23 4.1 Installation and Configuration ......................................................................................... 23 4.2 Registration .................................................................... ...
DU-09821-001_v06 | iv 6.11 Changing Disk Passwords, Adding Disks, or Replacing Disks ...................................... 40 6.12 Recovering From Lost Keys ............................................................................................. 40 Chapter 7. Network Configuration .................................................... ...
DU-09821-001_v06 | v 10.1.1 Connecting to the BMC .............................................................................................. 61 10.2 Overview of BMC Controls ............................................................................................... 62 10.3 Common BMC Tasks.......................................... ...
DU-09821-001_v06 | 1 Chapter 1. Introduction The NVIDIA DGX™ A100 system is the universal system purpose-built for all AI infrastructure and workloads, from analytics to training to inference. The system is built on eight NVIDIA A100 Tensor Core GPUs. This document is for users and administrators of the DGX A100 system. ...
DU-09821-001_v06 | 2 1.1 Hardware Overview 1.1.1 DGX A100 Models and Component Descriptions There are two models of the NVIDIA DGX A100 system: the NVIDIA DGX A100 640GB system and the NVIDIA DGX A100 320GB system. Table 1-1. Model Differentiation Component NVIDIA DGX A100 640GB NVIDIA DGX A100 320GB GPU Qty 8 NVIDIA A100 GPU ...
DU-09821-001_v06 | 3 Table 1-2. Component Description Component Description GPU NVIDIA A100 GPU CPU 2x AMD EPYC 7742 CPU w/64 cores NVSwitch 600 GB/s GPU-to-GPU bandwidth Storage (OS) 1.92 TB NVMe M.2 SSD (ea) in RAID 1 array Storage (Data Cache) 3.84 TB NVMe U.2 SED (ea) in RAID 0 array (Optional 7.68 TB NVMe U.2. SEDs) Netw ...
DU-09821-001_v06 | 4 1.1.3 Power Specifications The DGX A100 system contains six power supplies with balanced distribution of the power load. Table 1-4. Power Specifications Input Specification for Each Power Supply 200-240 volts AC 6.5 kW max. 3000 W @ 200-240 V, 16 A, 50-60 Hz 1.1.3.1 Support for N+N Redundancy The DGX A100 ...
DU-09821-001_v06 | 5 1.1.3.3 Using the Locking Power Cords Follow these instructions for using the locking power cords. 1.1.3.3.1 Locking/Unlocking the PDU Side Power Distribution Unit side To INSERT, push the cable into the PDU socket. To REMOVE, press the clips together and pull the cord out of the socket. 1.1.3.3.2 ...