Server Hardware Basics

Server Hardware Basics

Form factors, server-grade CPUs, ECC RAM, and remote management explained.

What Makes a Server Different?

Servers are designed for continuous, reliable operation rather than peak consumer performance. Key differences from desktop hardware:

  • ECC RAM ߀” Error-Correcting Code memory detects and corrects single-bit memory errors
  • Redundant PSUs ߀” two power supplies; if one fails the server keeps running
  • IPMI / iDRAC / iLO ߀” out-of-band management: remotely power on/off, access the console, view hardware sensors without an OS
  • Hot-swap drives and PSUs ߀” replace failed components without shutting down
  • Server-grade CPUs ߀” more cores, more PCIe lanes, support for more RAM channels

Form Factors

Form Factor Height Typical Use
1U Rack 44 mm Dense web/app servers, low-power nodes
2U Rack 88 mm General purpose, more drive bays
4U Rack 176 mm Storage servers, GPUs, large workloads
Tower Varies Small offices, standalone servers
Blade Modular High-density datacentres, shared infrastructure

Rack units (U) are standardised: 1U = 44.45 mm. A standard 42U rack is ~2 m tall.

Server CPUs

Platform CPUs Socket
Intel Xeon Scalable Bronze/Silver/Gold/Platinum LGA4189 (Gen4), LGA4677 (Gen5)
AMD EPYC 7xx3, 9xx4 series SP3, SP5

Server CPUs support:

  • More memory channels (6߀“12 vs 2 on desktop)
  • More PCIe lanes
  • Higher core counts (up to 96 cores on EPYC 9004)
  • Dual-socket configurations for SMP (symmetric multi-processing)

ECC RAM

ECC (Error-Correcting Code) RAM adds extra bits to detect and correct single-bit errors. Critical for databases, financial systems, and any workload where data integrity matters.

  • RDIMM (Registered): Standard server RAM, buffered for stability at high capacities
  • LRDIMM (Load-Reduced): Allows even higher capacities; slightly higher latency
  • UDIMM: Unbuffered ECC ߀” used in workstations, not supported by all server platforms

Standard desktop RAM will not work in most server motherboards, and vice versa.

Remote Management ߀” IPMI / iDRAC / iLO

Out-of-band management gives you a remote console even when the OS is down:

Vendor Remote Management Name
Generic / Supermicro IPMI (Intelligent Platform Management Interface)
Dell iDRAC (Integrated Dell Remote Access Controller)
HPE iLO (Integrated Lights-Out)
Lenovo XClarity Controller

Capabilities: power control, virtual KVM (keyboard/video/mouse), virtual media (mount an ISO remotely), hardware sensor monitoring, event logs.

Redundant Power Supplies

Most rack servers have two PSU bays. Both are active simultaneously in load-sharing mode. If one fails:

  • The server continues running on the remaining PSU
  • An alert is generated (via IPMI / iDRAC)
  • The failed PSU is hot-swapped without downtime

Always connect each PSU to a different power circuit or UPS for full redundancy.

Server Storage Options

Type Interface Typical Use
3.5" HDD SATA / SAS High-capacity bulk storage
2.5" HDD/SSD SATA / SAS General purpose
NVMe SSD PCIe / U.2 / M.2 High-performance databases, caching
NVMe EDSFF (E1.S/E3.S) PCIe Dense flash storage in modern servers

SAS (Serial Attached SCSI) drives are more expensive but support dual-porting (two paths to the drive) and higher sustained duty cycles than SATA.