Supero H8DGT-HLF Operation & User’s Manual

The vendor assumes no responsibility for any inaccuracies that may be contained in this document, makes no commitment to update or to keep current the information in this manual, or to notify any person or organization of the updates. Please Note: For the most up-to-date version of this manual, please see our web site at www.supermicro.com. Super Micro Computer, Inc. ("Supermicro") reserves the right to make changes to the product described in this manual at any time and without notice. This product, including software and documentation, is the property of Supermicro and/or its licensors, and is supplied only under a license. Any use or reproduction of this product is not allowed, except as expressly permitted by the terms of said license. IN NO EVENT WILL SUPERMICRO BE LIABLE FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL, SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE USE OR INABILITY TO USE THIS PRODUCT OR DOCUMENTATION, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. IN PARTICULAR, SUPERMICRO SHALL NOT HAVE LIABILITY FOR ANY HARDWARE, SOFTWARE, OR DATA STORED OR USED WITH THE PRODUCT, INCLUDING THE COSTS OF REPAIRING, REPLACING, INTEGRATING, INSTALLING OR RECOVERING SUCH HARDWARE, SOFTWARE, OR DATA. Any disputes arising between manufacturer and customer shall be governed by the laws of Santa Clara County in the State of California, USA. The State of California, County of Santa Clara shall be the exclusive venue for the resolution of any such disputes. Super Micro's total liability for all claims will not exceed the price paid for the hardware product. FCC Statement: This equipment has been tested and found to comply with the limits for a Class A digital device pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment. This equipment generates, uses, and can radiate radio frequency energy and, if not installed and used in accordance with the manufacturer’s instruction manual, may cause harmful interference with radio communications. Operation of this equipment in a residential area is likely to cause harmful interference, in which case you will be required to correct the interference at your own expense. California Best Management Practices Regulations for Perchlorate Materials: This Perchlorate warning applies only to products containing CR (Manganese Dioxide) Lithium coin cells. “Perchlorate Material-special handling may apply. See www.dtsc.ca.gov/hazardouswaste/perchlorate” WARNING: Handling of lead solder materials used in this product may expose you to lead, a chemical known to the State of California to cause birth defects and other reproductive harm. Manual Revision 1.0 Release Date: August 29, 2011 Unless you request and receive written permission from SUPER MICRO COMPUTER, you may not copy any part of this document. Information in this document is subject to change without notice. Other products and companies referred to herein are trademarks or registered trademarks of their respective companies or mark holders. Copyright © 2011 by SUPER MICRO COMPUTER INC. All rights reserved. Printed in the United States of America

This manual is written for system integrators, PC technicians and knowledgeable PC users. It provides information for the installation and use of the H8DGT-HLF/HLIBQF serverboards. The H8DGT-HLF/HLIBQF serverboard is based on the AMD® SR5690/ SP5100 chipset and supports dual AMD Socket G34 type processors with up to 32 GB of ECC/Non-ECC UDIMM or up to 128 GB of ECC RDIMM SDRAM in 8 DIMM slots. The only difference between the two serverboards is that the H8DGT-HLIBQF serverboard contains an Infi niBand® QSFP connector whereas the H8DGT-HLF does not. Please refer to the motherboard specifi cations pages on our web site for updates on supported processors (http://www.supermicro.com/aplus/). This product is intended to be professionally installed. Manual Organization Chapter 1 includes a checklist of what should be included in your motherboard box, describes the features, specifi cations and performance of the motherboard and provides detailed information about the chipset. Chapter 2 begins with instructions on handling static-sensitive devices. Read this chapter when installing the processor(s) and memory modules and when installing the motherboard in a chassis. Also refer to this chapter to connect the hard disk drives, the various ports, and the power and reset buttons and the system LEDs. If you encounter any problems, see Chapter 3, which describes troubleshooting procedures for the video, the memory and the setup confi guration stored in CMOS. For quick reference, a general FAQ (Frequently Asked Questions) section is pro- vided. Instructions are also included for contacting technical support. In addition, you can visit our web site for more detailed information. Chapter 4 includes an introduction to BIOS and provides detailed information on running the CMOS Setup utility. Appendix A provides BIOS Error Beep Code Messages. Appendix B lists BIOS POST Checkpoint Codes.

Chapter 1 Introduction 1-1 Overview ......................................................................................................... 1-1 Checklist .......................................................................................................... 1-1 1-2 Contacting Supermicro .................................................................................... 1-2 H8DGT-HLF/HLIBQF Quick Reference .......................................................... 1-6 1-3 Chipset Overview .......................................................................................... 1-10 AMD SR5690/SP5100 Processor ................................................................. 1-10 HyperTransport Technology .......................................................................... 1-10 1-4 PC Health Monitoring .................................................................................... 1-10 1-5 Power Confi guration Settings.........................................................................1-11 1-6 Power Supply ................................................................................................ 1-12 1-7 Super I/O ....................................................................................................... 1-12 Chapter 2 Installation 2-1 Static-Sensitive Devices .................................................................................. 2-1 Precautions ..................................................................................................... 2-1 Unpacking ....................................................................................................... 2-1 2-2 Processor and Heatsink Installation................................................................ 2-2 2-3 Mounting the Motherboard into a Chassis ...................................................... 2-4 2-4 Installing Memory ............................................................................................ 2-4 DIMM Module Population Confi guration .................................................... 2-6 2-5 PCI Expansion Cards ...................................................................................... 2-7 2-6 I/O Port and Control Panel Connections ........................................................ 2-8 2-7 Connector Defi nitions ...................................................................................... 2-9 LAN1/2 (Ethernet Ports) ............................................................................. 2-9 Universal Serial Bus Ports ......................................................................... 2-9 USB Headers ............................................................................................. 2-9 Serial Ports ................................................................................................. 2-9 Overheat LED ........................................................................................... 2-10 Unit Identifi er Button ................................................................................. 2-10 Video Connector ....................................................................................... 2-10 Trusted Platform Module Header ............................................................. 2-10 JP3 Adapter Card Connector ....................................................................2-11 SXB1 Adapter Card Slot/Connector ..........................................................2-11 2-8 Jumper Settings ............................................................................................ 2-12 Explanation of Jumpers ................................................................................ 2-12 CMOS Clear ............................................................................................. 2-12 Table of Contents

(H8DGT-HLIBQF only) ............................................................................. 2-12 I2C to PCI-Express Slot ........................................................................... 2-13 Watch Dog Enable/Disable ...................................................................... 2-13 VGA Enable/Disable ................................................................................. 2-13 BMC Jumper ............................................................................................ 2-13 LAN1/2 Enable/Disable ........................................................................... 2-13 2-9 Onboard Indicators ........................................................................................ 2-14 LAN1/LAN2 LEDs ..................................................................................... 2-14 Dedicated IPMI LAN LEDs ....................................................................... 2-14 IPMI LED .................................................................................................. 2-14 Power LED ............................................................................................... 2-14 Infi niBand LED Indicators ......................................................................... 2-15 UID LED (LE1) ........................................................................................ 2-15 2-11 Enabling SATA RAID ..................................................................................... 2-16 Serial ATA (SATA).......................................................................................... 2-16 Installing the OS/SATA Driver ....................................................................... 2-16 Building a Driver Diskette ......................................................................... 2-16 Enabling SATA RAID in the BIOS ................................................................. 2-17 Using the Adaptec RAID Utility ..................................................................... 2-18 Installing the RAID Driver During OS Installation ......................................... 2-18 2-12 Installing Drivers ............................................................................................ 2-19 Supero Doctor III ........................................................................................... 2-20 Chapter 3 Troubleshooting 3-1 Troubleshooting Procedures ........................................................................... 3-1 Before Power On ............................................................................................ 3-1 No Power ........................................................................................................ 3-1 No Video ......................................................................................................... 3-2 Memory Errors ............................................................................................... 3-2 Losing the System’s Setup Confi guration ....................................................... 3-2 3-2 Technical Support Procedures ........................................................................ 3-3 3-3 Frequently Asked Questions ........................................................................... 3-3 3-4 Returning Merchandise for Service................................................................. 3-4 Chapter 4 BIOS 4-1 Introduction ...................................................................................................... 4-1 4-2 Main Menu ...................................................................................................... 4-2 4-3 Advanced Settings Menu ................................................................................ 4-2 4-3 Security Menu ............................................................................................... 4-14 H8DGT-HLF/HLIBQF Serverboard User’s Manual

vii 4-4 Boot Menu ..................................................................................................... 4-14 4-5 Exit Menu ...................................................................................................... 4-15 Appendix A BIOS Error Beep Codes Appendix B BIOS POST Checkpoint Codes B-1 Uncompressed Initialization Codes .................................................................B-1 B-2 Bootblock Recovery Codes .............................................................................B-2 B-3 Uncompressed Initialization Codes .................................................................B-3

1-1 Chapter 1 Introduction 1-1 Overview Checklist Congratulations on purchasing your computer motherboard from an acknowledged leader in the industry. Supermicro boards are designed with the utmost attention to detail to provide you with the highest standards in quality and performance. Please check that the following items have all been included with your motherboard. If anything listed here is damaged or missing, contact your retailer. • One (1) H8DGT-HLF/HLIBQF serverboard • One (1) CD containing drivers and utilities

1-2 Contacting Supermicro Headquarters Address: Super Micro Computer, Inc. 980 Rock Ave. San Jose, CA 95131 U.S.A. Tel: +1 (408) 503-8000 Fax: +1 (408) 503-8008 Email: [email protected] (General Information) [email protected] (Technical Support) Web Site: www.supermicro.com Europe Address: Super Micro Computer B.V. Het Sterrenbeeld 28, 5215 ML 's-Hertogenbosch, The Netherlands Tel: +31 (0) 73-6400390 Fax: +31 (0) 73-6416525 Email: [email protected] (General Information) [email protected] (Technical Support) [email protected] (Customer Support) Asia-Pacifi c Address: Super Micro Computer, Inc. 4F, No. 232-1, Liancheng Rd. Chung-Ho 235, Taipei County Taiwan, R.O.C. Tel: +886-(2) 8226-3990 Fax: +886-(2) 8226-3991 Web Site: www.supermicro.com.tw Technical Support: Email: [email protected] Tel: +886-(2) 8226-5990

1-5 Notes: Jumpers not indicated are for test purposes only. Not all ports, jumpers or LED Indicators are available on all serverboards. Figure 1-3. H8DGT-HLF/HLIBQF Motherboard Layout (not drawn to scale) JP3 JTPM1 JWD1 JPB1 JPL1 JIB1 JPG1 JOH1 JI2C1 JI2C2 BATTERY JBT1 DP2 LE2 LE3 DP1 JB1 LE1 SXB1:PCI-E X8 UID VGA COM1 LAN2 LAN1 SXB2:PCI-E X16 P1-DIMM4A P1-DIMM3A P1-DIMM1A P1-DIMM2A USB4 USB2/3 COM2 IPMI_LAN USB0/1 P2-DIMM1A CPU1 P2-DIMM2A P2-DIMM3A P2-DIMM4A CPU2 AMD SP5100 AMD SR5690 QDR IB BMC NIC SPEAKER

H8DGT-HLF/HLIBQF Quick Reference Jumper Description Default Setting JBT1 CMOS Clear (See Section 2-7) JIB1 Infi niBand Enable/Disable (H8DGT-HLIBQF only) Pins 1-2 (Enabled) JI2C1/JI2C2 I2C to PCI-E Slot Enable/Disable Both Closed (Enabled) JPB1 BMC Enable/Disable Pins 1-2 (Enabled) JPG1 VGA Enable/Disable Pins 1-2 (Enabled) JPL1 LAN 1/2 Enable/Disable Pins 1-2 (Enabled) JWD1 Watch Dog Pins 1-2 (Reset) LED Description LAN Ports LEDs for the LAN Ethernet ports Dedicated IPMI LAN LEDs for the dedicated IPMI LAN Ethernet port LE1 LED for UID Button LE2 Infi niBand Physical Link LED (Red) (H8DGT-HLIBQF only) LE3 Infi niBand Logical Link LED (Yellow) (H8DGT-HLIBQF only) DP1 LED for IPMI activity DP2 LED for Serverboard Power-On Connector Description COM1/COM2 COM1 Serial Port/Header IPMI LAN Dedicated IPMI LAN Port JB1 Infi niBand QSFP Connector (H8DGT-HLIBQF only) JOH1 Overheat Warning Header JTPM1 Trusted Platform Module Header JP3 SMC Proprietary Slot for Power, FP Control & SATA connectors LAN1/2 Gigabit Ethernet (RJ45) Ports UID Unit Identifi er Button USB0/1, USB2/3, USB4 Universal Serial Bus (USB) ports, headers and Type-A ports VGA VGA Connector

1-7 Motherboard Features CPU • Dual AMD Opteron 6000 series (AMD Socket G34 type) processors Note: You must install at least two processors for full functions to be supported. Memory • Eight (8) single/dual/tri/quad channel DIMM slots supporting up to 32 GB of ECC/Non-ECC UDIMM or up to 128 GB of ECC RDIMM DDR3-1333/1066/800 SDRAM Note: Refer to Section 2-4 before installing memory and our web site for recommended DIMMs. Chipset • AMD SR5690 chipset and one SP5100 Southbridge chipset (RAID 0, 1 or 10 supported) Expansion Slots • One (1) PCI-Express x16 Gen. 2 • One (1) PCI-Express x8 in x4 Gen. 2 (for SAS adapter cards) BIOS • 16 Mb AMIBIOS® SPI Flash ROM • APM 1.2, DMI 2.3, PCI 2.2, ACPI 1.0 (ACPI 2.0 is BIOS supported), SMBIOS 2.3, Real Time Clock Wakeup, Plug and Play (PnP) and BIOS resume hot keys. PC Health Monitoring • Onboard voltage monitors • Fan status monitor with fi rmware/software on/off and speed control • Watch Dog • Environmental temperature monitoring via BIOS • Power-up mode control for recovery from AC power loss • System resource alert (via included utility program) • Auto-switching voltage regulator for the CPU core • CPU thermal trip support • I2C temperature sensing logic

ACPI Features • Microsoft OnNow • Slow blinking LED for suspend state indicator • BIOS support for USB keyboard • Wake-On-LAN (WOL) • Internal/external modem ring-on • Hardware BIOS Virus protection Onboard I/O • Two (2) Fast UART 16550 compatible serial port (one header and one port) • Five (5) USB (Universal Serial Bus 2.0) ports (2x rear, 2x header, 1x type A) • Two (2) LAN ports supported by an onboard Intel® 82576 dual port Ethernet controller for 10/100/1000Base-T • One (1) dedicated IPMI LAN port • One (1) VGA port supported by an onboard Matrox® G200e graphics controller (with 16 MB DDR2 memory) • One Mellonox Connect-X2 Infi niBand supporting a single QSFP connector (H8DGT-HLIBQF only) Other • Onboard power LED CD Utilities • BIOS fl ash upgrade utility • Super Doctor III • IPMI 2.0 Dimensions • Propriatory format: 6.78" x 16.64" (172 x 423 mm)

1-9 Figure 1-4. SR5690/SP5100 Chipset: System Block Diagram Note: This is a general block diagram and may not exactly represent the features on your motherboard. See the previous pages for the actual specifi cations of your motherboard. BMC WPCM450-R PCI DDR2 SDRAM 64Mb X16bit PSU I2C IPMB VGA FE PHY RTL8201N SIO W83527 LPC HWM W83795G COM2 COM1 Clock Gen SPI Flash INTEL KAWELA RJ45 RJ45 PCI-E GEN2 X16 Slot1 PCI-E GEN2 X8 Mellanox Connect-X2 Slot2 PCI-E GEN2 X4 RJ45 USB x5 SP5100 SMBus SATA x6 PCI-E GEN2 X8 SR5690 A-Link HT3 Link 16x16-5.2GT/s DIMM 1A DIMM 2A DIMM 3A DIMM 4A DIMM 1A DIMM 2A DIMM 3A DIMM 4A AMD Socket G34 CPU2 HT3 Link (8+8)x(8+8)-6.4GT/s HT3 Link 16x16-3.2GT/s HT3 Link 16x16-3.2GT/s AMD Socket G34 CPU1 RMII

1-3 Chipset Overview The H8DGT-HLF/HLIBQF serverboard is based on the SR5690/SP5100 chipset. This chipset functions as a Media and Communications Processor (MCP). Controllers for the system memory are integrated directly into AMD Opteron processors. AMD SR5690/SP5100 Processor The SR5690/SP5100 are each a single-chip, high-performance HyperTransport peripheral controller. It includes a 42-lane PCI Express interface, an AMD Opteron 16-bit Hyper Transport interface link, a six-port Serial ATA interface and a fi ve-port USB 2.0 interface. This hub connects directly to the CPU. HyperTransport Technology HyperTransport technology is a high-speed, low latency point to point link that was designed to increase the communication speed by a factor of up to 48x between integrated circuits. This is done partly by reducing the number of buses in the chipset to reduce bottlenecks and by enabling a more effi cient use of memory in multi-processor systems. The end result is a signifi cant increase in bandwidth within the chipset. 1-4 PC Health Monitoring This section describes the PC health monitoring features of the H8DGT-HLF/HLIBQF serverboard. The serverboard has an onboard System Hardware Monitor chip that supports PC health monitoring. Onboard Voltage Monitors The onboard voltage monitor will continuously scan crucial voltage levels. Once a voltage becomes unstable, it will give a warning or send an error message to the screen. Users can adjust the voltage thresholds to defi ne the sensitivity of the voltage monitor. Real time readings of these voltage levels are all displayed in BIOS. Fan Status Monitor with Firmware/Software Speed Control The PC health monitor can check the RPM status of the cooling fans. The onboard fans are controlled by thermal management via BIOS.

1-11 CPU Overheat/Fan Fail LED and Control This feature is available when the user enables the CPU overheat/Fan Fail warning function in the BIOS. This allows the user to defi ne an overheat temperature. When this temperature is exceeded or when a fan failure occurs, the Overheat/Fan Fail warning LED is triggered. Auto-Switching Voltage Regulator for the CPU Core The 6-phase-switching voltage regulator for the CPU core can support up to Opteron 6100SE series processors. This will allow the regulator to run cooler and thus make the system more stable. 1-5 Power Confi guration Settings This section describes the features of your motherboard that deal with power and power settings. Microsoft OnNow The OnNow design initiative is a comprehensive, system-wide approach to system and device power control. OnNow is a term for a PC that is always on but appears to be off and responds immediately to user or other requests. Slow Blinking LED for Suspend-State Indicator When the CPU goes into a suspend state, the chassis power LED will start blinking to indicate that the CPU is in suspend mode. When the user presses any key, the CPU will wake-up and the LED will automatically stop blinking and remain on. BIOS Support for USB Keyboard If a USB keyboard is the only keyboard in the system, it will function like a normal keyboard during system boot-up. Main Switch Override Mechanism The power button can function as a system suspend button. When the user depresses the power button, the system will enter a SoftOff state. The monitor will be suspended and the hard drive will spin down. Depressing the power button again will cause the whole system to wake-up. During the SoftOff state, the power supply provides power to keep the required circuitry in the system alive. In case the system malfunctions and you want to turn off the power, just depress and hold the power button for 4 seconds. The power will turn off and no power will be provided to the motherboard.

Wake-On-LAN (WOL) Wake-On-LAN is defi ned as the ability of a management application to remotely power up a computer that is powered off. Remote PC setup, up-dates and access tracking can occur after hours and on weekends so that daily LAN traffi c is kept to a minimum and users are not interrupted. The motherboard has a 3-pin header (WOL) to connect to the 3-pin header on a Network Interface Card (NIC) that has WOL capability. Wake-On-LAN must be enabled in BIOS. 1-6 Power Supply As with all computer products, a stable power source is necessary for proper and reliable operation. It is even more important for processors that have high CPU clock rates. The H8DGT-HLF/HLIBQF serverboard requires the use of proprietary power supplies. Please refer to the pinout information for the power connectors in Section 6 of Chapter 2 for detailed information on power requirements. In areas where noisy power transmission is present, you may choose to install a line fi lter to shield the computer from noise. It is recommended that you also install a power surge protector to help avoid problems caused by power surges. Warning: To prevent the possibility of explosion, do not use the wrong type of onboard CMOS battery or install it upside down. 1-7 Super I/O The Super I/O (Winbond® W83527 chip) includes a data separator, write pre- compensation circuitry, decode logic, data rate selection, a clock generator, drive interface control logic and interrupt and DMA logic. The wide range of functions integrated onto the Super I/O greatly reduces the number of components required for interfacing with fl oppy disk drives. The Super I/O provides two high-speed, 16550 compatible serial communication ports (UARTs), one of which supports serial infrared communication. Each UART includes a 16-byte send/receive FIFO, a programmable baud rate generator, complete modem control capability and a processor interrupt system. Both UARTs provide legacy speed with baud rate of up to 115.2 Kbps as well as an advanced speed with baud rates of 250 K, 500 K, or 1 Mb/s, which support higher speed modems. The Super I/O provides functions that comply with ACPI (Advanced Confi guration and Power Interface), which includes support of legacy and ACPI power management through a SMI or SCI function pin. It also features auto power management to reduce power consumption.

1-13 The IRQs, DMAs and I/O space resources of the Super I/O can be fl exibly adjusted to meet ISA PnP requirements, which support ACPI and APM (Advanced Power Management).

2-1 Chapter 2 Installation 2-1 Static-Sensitive Devices Electrostatic Discharge (ESD) can damage electronic com ponents. To prevent damage to your system board, it is important to handle it very carefully. The following measures are generally suffi cient to protect your equipment from ESD. Precautions • Use a grounded wrist strap designed to prevent static discharge. • Touch a grounded metal object before removing the board from the antistatic bag. • Handle the board by its edges only; do not touch its components, peripheral chips, memory modules or gold contacts. • When handling chips or modules, avoid touching their pins. • Put the motherboard and peripherals back into their antistatic bags when not in use. • For grounding purposes, make sure your computer chassis provides excellent conductivity between the power supply, the case, the mounting fasteners and the motherboard. • Use only the correct type of CMOS onboard battery as specifi ed by the manu- facturer. Do not install the CMOS onboard battery upside down, which may result in a possible explosion. Unpacking The motherboard is shipped in antistatic packaging to avoid static damage. When unpacking the board, make sure the person handling it is static protected.

2-2 ! 2-2 Processor and Heatsink Installation Exercise extreme caution when handling and installing the processor. Always connect the power cord last and always remove it before adding, removing or changing any hardware components. Installation Procedure Follow the procedures as listed below to install the motherboard into a chassis. 1. Install the processor(s) and the heatsink(s). 2. Install the motherboard in the chassis. 3. Install the memory and add-on cards. 4. Finally, connect the cables and install the drivers. Installing the Processors 1. Begin by removing the cover plate that protects the CPU. Lift the lever on the CPU socket until it points straight up. 2. With the lever raised, lift open the silver CPU retention plate.

2-3 Installing the Heatsinks We recommend the use of active type heatsinks (except for 1U systems). Use any onboard fan header for the CPU's heatsink fan. To install the heatsink, please follow the installation instructions included with your heatsink package (not included). Triangle 3. Use your thumb and your index fi nger to hold the CPU. Locate and align pin 1 of the CPU socket with pin 1 of the CPU. Both are marked with a triangle. 4. Align pin 1 of the CPU with pin 1 of the socket. Once aligned, carefully place the CPU into the socket. Do not drop the CPU on the socket, move the CPU horizontally or vertically or rub the CPU against the socket or against any pins of the socket, which may damage the CPU and/or the socket. 5. With the CPU inserted into the socket, inspect the four corners of the CPU to make sure that it is properly installed and fl ush with the socket. Then, gently lower the silver CPU retention plate into place. 6. Carefully press the CPU socket lever down until it locks into its retention tab. For a dual-CPU system, repeat these steps to install another CPU into the CPU#2 socket. Note: in single and dual-CPU confi gurations, memory must be installed in the DIMM slots associated with the installed CPU(s).

2-4 2-3 Mounting the Motherboard into a Chassis All motherboards have standard mounting holes to fi t different types of chassis. Make sure that the locations of all the mounting holes for both the motherboard and the chassis match. Although a chassis may have both plastic and metal mounting fasteners, metal ones are highly recommended because they ground the motherboard to the chassis. Make sure that the metal standoffs click in or are screwed in tightly. Check the Compatibility of the Motherboard Ports and the I/O Shield 1. The H8DGT-HLF/HLIBQF serverboard requires a chassis that can support a board of 16.64" x 6.8" in size. It was designed to be used in a Supermicro 2U Twin system. 2. Make sure that the I/O ports on the motherboard align with their respective holes in the I/O shield at the rear of the chassis. Mounting the Motherboard onto the Tray in the Chassis 1. Carefully mount the motherboard onto the motherboard tray by aligning the motherboard mounting holes with the raised metal standoffs in the tray. 2. Insert screws into all the mounting holes in the motherboard that line up with the standoffs. 3. Then use a screwdriver to secure the motherboard to the mainboard tray - tighten until just snug (if too tight you might strip the threads). Metal screws provide an electrical contact to the motherboard ground to provide a continuous ground for the system. Exercise extreme caution when installing or removing memory modules to prevent any possible damage. ! 2-4 Installing Memory Installing Memory 1. Insert each memory module vertically into its slot, paying attention to the notch along the bottom of the module to prevent inserting the module incorrectly (see Figure 2-1). 2. Install to slots CPU1: DIMM1A, DIMM2A, etc. Populate DIMMs in groups of four per channel (4 DIMMs/CPU). See support information below.

2-5 3. Gently press down on the memory module until it snaps into place. 4. With four DIMMs installed, repeat step 2 to populate the CPU2 DIMM slots. Always install four DIMMs to both CPU DIMM slots for more effi cient operation. Note: 1 GB, 2 GB, 4 GB, 8 GB and 16 GB memory modules are supported. It is highly recommended that you remove the power cord from the system before installing or changing memory modules. Please refer to our web site for memory that has been tested on the H8DGT-HLF/HLIBQF serverboard. Support The H8DGT-HLF/HLIBQF serverboard supports single/dual/tri/quad-channel, DDR3-1333/1066/800 registered ECC/Unbuffered ECC/non-ECC SDRAM. Populating four adjacent slots at a time with memory modules of the same size and type will result in interleaved (128-bit) memory, which is faster than non-interleaved (64-bit) memory. Maximum Memory T h e H 8 D G T - H L F / H L I B Q F s e r v e r b o a r d s u p p o r t s u p t o 32 GB of ECC/Non-ECC UDIMM or up to 128 GB of ECC RDIMM SDRAM in eight (8) DIMM slots. Figure 2-1. DIMM Installation To Install: Insert module vertically and press down until it snaps into place. Pay attention to the alignment notch at the bottom. To Remove: Use your thumbs to gently push the release tabs near both ends of the module. This should release it from the slot. Top View of DDR3 Slot Release Tab Release Tab Note: Notch should align with the receptive key point on the slot. Notch Notch Front View

2-6 Memory Population for Optimal Performance -For a Motherboard with One CPU (CPU1) Installed # DIMMS CPU Channel 1 Channel 2 Channel 3 Channel 4 4 DIMMs CPU1 P1-1A P1-2A P1-3A P1-4A Memory Population for Optimal Performance -For a Motherboard with Two CPUs (CPU1 & CPU2) Installed # DIMMS CPU Channel 1 Channel 2 Channel 3 Channel 4 8 DIMMs CPU1 P1-1A P1-2A P1-3A P1-4A CPU2 P2-1A P2-2A P2-3A P2-4A DIMM Module Population Confi guration For memory to work properly, follow the tables below for memory installation: Per Channel DIMM Populations Options DIMM Type DIMM A Max. MHz, 1.5V DIMMs Max. MHz, 1.35V DIMMs Max. GB/ Channel Unbuffered DIMM SR or DR 1333 MHz 1333 MHz 4 GB Registered DIMM SR or DR 1333 MHz 1333 MHz 16 GB QR 1333 MHz 1066 MHz 16 GB Note 1: Due to OS limitations, some operating systems may not show more than 4 GB of memory. Note 2: Due to memory allocation to system devices, the amount of memory that remains available for operational use will be reduced when 4 GB of RAM is used. The reduction in memory availability is disproportional. Possible System Memory Allocation & Availability System Device Size Physical Memory Available (4 GB Total System Memory) Firmware Hub fl ash memory (System BIOS) 1 MB 3.99 GB Local APIC 4 KB 3.99 GB Area Reserved for the chipset 2 MB 3.99 GB I/O APIC (4 Kbytes) 4 KB 3.99 GB PCI Enumeration Area 1 256 MB 3.76 GB PCI Express (256 MB) 256 MB 3.51 GB PCI Enumeration Area 2 (if needed) -Aligned on 256-M boundary- 512 MB 3.01 GB VGA Memory 16 MB 2.85 GB TSEG 1 MB 2.84 GB Memory available for the OS & other applications 2.84 GB

2-7 2-5 PCI Expansion Cards A riser card is used to support one low-profi le or standard PCI expansion card base on riser card type. Installing a PCI Expansion Card 1. Confi rm that you have the correct riser card for your chassis model and the add-on card includes a standard bracket. 2. Remove the chassis cover. 3. Install the riser card by sliding card into the appropriate riser card in the motherboard. 4. Choose the PCI slot shield in which to place the add-on card. 5. In that slot, open the PCI slot shield lever and slide the shield sideways. 6. From inside the chassis, remove the PCI slot shield. 7. Slide the add-on card into the riser card and attach the add-on card bracket in place of the PCI slot shield. 8. Secure the add-on card by closing the PCI slot shield lever. 9. Connect cables to the add-on card as necessary.

2-8 1 2 5 4 3 6 7 8 9 2-6 I/O Port and Control Panel Connections The I/O ports are color coded in conformance with the PC99 specifi cation to make setting up your system easier. See Figure 2-2 below for the colors and locations of the various I/O ports. Figure 2-2. I/O Port Locations and Defi nitions Rear I/O Ports 1. USB0 6. VGA Port 2. USB1 7. Infi niBand Port (H8DGT-HLIBQF only) 3. LAN1 8. UID 4. LAN2 9. IPMI LAN 5. COM1

2-9 2-7 Connector Defi nitions LAN1/2 (Ethernet Ports) Two Gigabit Ethernet ports (designated LAN1 and LAN2) are located beside the VGA port. Additionally, there is a dedicated LAN port for IPMI beside the two rear USB ports. These Ethernet ports accept RJ45 type cables. Universal Serial Bus Ports Two Universal Serial Bus ports (USB 2.0) and one additional Type A port (USB4) are included on the serverboard. See the table on the right for pin defi nitions. Universal Serial Bus Ports Pin Defi nitions (USB0/1, USB4) USB0 Pin # Defi nition USB1 Pin # Defi nition 1 +5V 1 +5V 2 PO- 2 PO- 3 PO+ 3 PO+ 4 Ground 4 Ground USB Headers Two USB 2.0 headers (USB2/3) are also included on the motherboard. These may be connected to provide front side access. A USB cable (not included) is needed for the connection. See the table on the right for pin defi nitions. Universal Serial Bus Headers Pin Defi nitions (USB2/3) USB2 Pin # Defi nition USB3 Pin # Defi nition 1 +5V 1 +5V 2 PO- 2 PO- 3 PO+ 3 PO+ 4 Ground 4 Ground 5 Key 5 NC Note: NC indicates no connection. Serial Ports The COM1 serial port is located beside the VGA port. Refer to the motherboard layout for the location of the COM2 header. See the table on the right for pin defi nitions. Note: NC indicates no connection. Serial Port Pin Defi nitions (COM1/COM2) Pin # Defi nition Pin # Defi nition 1 DCD 6 DSR 2 RXD 7 RTS 3 TXD 8 CTS 4 DTR 9 RI 5 Ground 10 NC

2-10 Overheat LED Connect an LED to the JOH1 header to provide warning of chassis overheating. See the table on the right for pin defi nitions. Overheat LED Pin Defi nitions (JOH1) Pin# Defi nition 1 3.3V 2 OH Active UID Button Pin Defi nitions Pin# Defi nition 1 Ground 2 Ground 3 Button In 4 Ground Unit Identifi er Button A Unit Identifi er (UID) button is located on the rear of the board. There is another UID button located on the control panel. When you push either UID button, both Rear UID and Front Panel UID Indicators will illuminate. Push either button again to turn off both indicators. These UID indicators provide easy identifi cation of a system unit that may be in need of service. Video Connector A Video (VGA) connector is located below the COM Port on the IO backplane. This connector is used to provide video and CRT display. Trusted Platform Module Header This header is used to connect a Trusted Platform Module (TPM), available separately from a third-party vendor. A TPM is a security device that allows encryption and authentication of hard drives, disallowing access if the TPM associated with it is not installed in the system. See the table on the right for pin defi nitions. Trusted Platform Module Header Pin Defi nitions (JTPM1) Pin# Defi nition Pin# Defi nition 1 LCLK GND 3 LFRAME No Pin 5 LRESET VCC5 7 LAD3 LAD2 9 VCC3 LAD1 11 LAD0 GND 13 RSV0 RSV1 15 SB3V SERIRQ 17 GND CLKRUN 19 LPCPD RSV2

2-11 JP3 Adapter Card Connector JP3 Adapter card connector slot provides front access to the power supply, serial ATA and Front Panel Control connections for the H8DGT series motherboards. Plug an Adapter card into this connector to use the functions indicated above. This connector is designed specifi cally for a Supermicro- proprietary adapter card. SXB1 Adapter Card Slot/Connector A PCI-Express 2.0 x8 (in x4) slot (SXB1) is located at JPCIE2 on the motherboard. This slot is used for an SMC proprietary SAS adapter card.

2-12 2-8 Jumper Settings Explanation of Jumpers To modify the operation of the motherboard, jumpers can be used to choose between optional settings. Jumpers create shorts between two pins to change the function of the connector. Pin 1 is identifi ed with a square solder pad on the printed circuit board. See the diagram at right for an example of jumping pins 1 and 2. Refer to the motherboard layout page for jumper locations. Note: On two-pin jumpers, "Closed" means the jumper is on and "Open" means the jumper is off the pins. Connector Pins Jumper Setting 3 2 1 3 2 1 CMOS Clear JBT1 is used to clear CMOS, which will also clear any passwords. Instead of pins, this jumper consists of contact pads to prevent accidentally clearing the contents of CMOS. To Clear CMOS 1. First power down the system and unplug the power cord(s). It is also recommended that you remove the onboard battery from the serverboard. 2. With the power disconnected, short the CMOS pads with a metal object such as a small screwdriver. 3. Remove the screwdriver (or shorting device). 4. Reconnect the power cord(s) and power on the system. Note: Do not use the PW_ON connector to clear CMOS. JBT1 contact pads Infi niBand Port Enable/Disable (H8DGT-HLIBQF only) JIB1 enables or disables the Infi niBand port on the H8DGT-HLIBQF serverboard. The default position is on pins 1 and 2 to enable the port. See the table below for jumper settings. Infi niBand Port Jumper Enable (JIB1) Jumper Settings Jumper Setting Defi nition Closed Enabled Open Disabled

2-13 VGA Enable/Disable JPG1 allows you to enable or disable the VGA port. The default position is on pins 1 and 2 to enable VGA. See the table on the right for jumper settings. VGA Enable/Disable Jumper Settings (JPG1) Jumper Setting Defi nition Pins 1-2 Enabled Pins 2-3 Disabled I2C to PCI-Express Slot JI2C1/JI2C2 allows you to enable the I2C bus to communicate with the PCI-Express slot. For the jumpers to work properly, please set both jumpers to the same setting. If enabled, both jumpers must be enabled. If disabled, both jumpers must be disabled. See the table on the right for jumper settings. I2C to PCI-Express Slot Jumper Settings (JI2C1/JI2C2) Jumper Setting Defi nition Closed Enabled Open Disabled Watch Dog Enable/Disable JWD1 enables the Watch Dog function, a system monitor that takes action when a software application freezes the system. Jumping pins 1-2 will have WD reboot the system if a program freezes. Jumping pins 2-3 will generate a non-maskable interrupt for the program that has frozen. See the table on the right for jumper settings. Watch Dog must also be enabled in BIOS. Note: when Watch Dog is enabled, the user must write their own application software to disable the Watch Dog Timer. Watch Dog Jumper Settings (JWD1) Jumper Setting Defi nition Pins 1-2 Reset Pins 2-3 NMI Open Disabled BMC Jumper JPB1 is used to enable or disable theBMC (Baseboard Management Control) Chip and the onboard IPMI connection.This jumper is used together with the IPMI settings in the BIOS. The default position is on pins 1 and 2 to Enable BMC. See the table on the right for jumper settings. BMC Jumper Enable (JPB1) Jumper Settings Jumper Setting Defi nition Pins 1-2 Enabled (default) Pins 2-3 Disabled LAN1/2 Enable/Disable Change the setting of jumper JPL1 to enable to enable or disable the LAN1 and LAN2 Ethernets ports. See the table on the right for jumper settings. The default setting is enabled. LAN1/2 En/Disable Jumper Settings (JPL1) Jumper Setting Defi nition Pins 1-2 Enabled Pins 2-3 Disabled

2-14 2-9 Onboard Indicators LAN1/LAN2 LEDs The Ethernet ports (located beside the VGA port) have two LEDs. On each Gb LAN port, one LED blinks to indicate activity while the other may be green, amber or off to indicate the speed of the connection. See the table on the right for the functions associated with the connection speed LED. LAN LED (Connection Speed Indicator) LED Color Defi nition Off 10 MHz Green 100 MHz Amber 1 GHz Dedicated IPMI LAN LEDs A dedicated IPMI LAN is also included on the H8DGT-HLF/HLIBQF serverboard. The amber LED on the right of the IPMI LAN port indicates activity, while the green LED on the left indicates the speed of the connection. See the table at right for more information. Power LED DP2 is an Onboard Power LED. When this LED is lit, it means power is present on the serverboard. Be sure to turn off the system and unplug the power cord(s) before removing or installing components. Power LED (DP2) State System Status On Standby power present on motherboard Off No power connected IPMI LED The serverboard contains an IPMI LED (DP1) located near the corner above the PCI-E slots. When this LED is lit, it means a connection is active for the built-in IPMI on the serverboard. Note: This LED is not installed on non-IPMI boards. IPMI LED (DP1) State System Status On Active connection Off No connection IPMI LAN Link LED (Left) & Activity LED (Right) Color Status Defi nition Green: Solid Link (Left) 100 Mb/s Amber: Blinking Activity (Right) Active

2-15 UID LED (LE1) A rear UID LED Indicator, located at LE1, works in conjunction with the rear UID switch to provide easy identifi cation for a unit that might be in need of service. Refer to Page 2-13 for further UID details. Infi niBand LED Indicators Two Infi niBand LED indicators (LE2/LE3) are located near the Infi niBand port of the H8DGT-HLIBQF serverboard. The green LED (LE2) is the Infi niBand link LED while the yellow LED (LE3) indicates activity. Refer to the tables at the right for details. Infi niBand LED (LE2) Activity LED Color Status Defi nition Green Solid Infi niBand Connected Off Off No Connection Infi niBand LED (LE3) Activity LED Color Status Defi nition Yellow Solid Infi niBand Active Yellow Dim Infi niBand Connected, Activity Idle Off Off No Connection

2-16 2-11 Enabling SATA RAID Now that the hardware is set up, you must install the operating system and the SATA RAID drivers, if you wish to use RAID with your SATA drives. The installation procedure differs depending on whether you wish to have the operating system installed on a RAID array or on a separate non-RAID drive. See the instructions below for details. Serial ATA (SATA) Serial ATA (SATA) is a physical storage interface that employs a single cable with a minimum of four wires to create a point-to-point connection between devices. This connection is a serial link that supports a SATA transfer rate from 150 MBps. The serial cables used in SATA are thinner than the traditional cables used in Parallel ATA (PATA) and can extend up to one meter in length, compared to only 40 cm for PATA cables. Overall, SATA provides better functionality than PATA. Installing the OS/SATA Driver Before installing the OS (operating system) and SATA RAID driver, you must decide if you wish to have the operating system installed as part of a bootable RAID array or installed to a separate non-RAID hard drive. If on a separate drive, you may install the driver either during or after the OS installation. If you wish to have the OS on a SATA RAID array, you must follow the procedure below and install the driver during the OS installation. Building a Driver Diskette You must fi rst build a driver diskette from the Supermicro CD-ROM that was included with the system. (You will have to create this disk on a computer that is already running and with the OS installed.) Building a Driver Diskette 1. Insert the CD into your CD-ROM drive and start the system. A display as shown in Figure 2-5 will appear. 2. Click on the icon labeled "Build Driver Diskettes and Manuals" and follow the instructions to create a fl oppy disk with the driver on it. 3. Once it's been created, remove the fl oppy and insert the installation CD for the Windows Operating System you wish to install into the CD-ROM drive of the new system you are about to confi gure.

2-17 Figure 2-3. BIOS Setup Screen Note: You need to have an external USB fl oppy when building the driver diskette. Window's Vista, Windows 2008 or later Windows OS systems can use a USB stick instead of a fl oppy. Enabling SATA RAID in the BIOS Before installing the Windows Operating System, you must change some settings in BIOS. Boot up the system and hit the key to enter the BIOS Setup Utlility. After the Setup Utility loads, 1. Use the arrow keys to move to the Exit menu. Scroll down with the arrow keys to the "Load Optimal Defaults setting and press . Select "OK" to confi rm, then to load the default settings. 2. Use the arrow keys to move to the "Advanced" menu, then scroll down to "IDE confi guration". Once in this submenu, scroll down to "OnChip SATA Type" and choose the "RAID" option (see Figure 2-3). 3. Hit the key twice and scroll to the Exit menu. Select "Save Changes and Exit" and hit , then hit again to verify.

2-18 4. After exiting the BIOS Setup Utility, the system will reboot. When prompted during the startup, press the key when prompted to run the Adaptec® RAID Utility program (see Figure 2-4). Using the Adaptec RAID Utility The Adaptec RAID Utility program is where you can defi ne the drives you want to include in the RAID array and the mode and type of RAID. Figure 2-4.Adaptec RAID Utility Program Screen Installing the RAID Driver During OS Installation You may also use the procedure below to install the RAID driver during the Window's OS installation: 5. With the Windows OS installation CD in the CD-ROM drive, restart the system. 6. When you see the prompt, hit the key to enter Windows setup. 7. Eventually a blue screen will appear with a message that begins "Windows could not determine the type of one or more storage devices . . ." When you see the screen, hit the key to "Specify Additional Device", then insert the driver diskette you just created into the fl oppy drive. 8. Highlight "Manufuacturer Supplied Hardware Support Disk" and hit the key.