|
|
All PC nodes have at least four ethernet ports connected to the switch
|
|
|
fabric. All of the over 2000 ports can be connected in arbitrary ways by
|
|
|
setting up VLANs on the switches via remote configuration tools. The
|
|
|
current PC and switch topology is shown below. One additional ethernet
|
|
|
port on each PC is connected to the core router, and is the public facing
|
|
|
interface. Thus each PC has a full duplex 1Gps or 10Gps connection to
|
|
|
the servers. These connections are for dumping data off of the nodes and
|
|
|
such, without interfering with the experimental interfaces. The only impact
|
|
|
on the node is processor and disk use, and bandwidth on the PCI bus.
|
|
|
|
|
|
A description of all of the current node types follows:
|
|
|
|
|
|
### d430s
|
|
|
|
|
|
There are 160 [d430](http://www.emulab.net/shownodetype.php3?node_type=d430) PC
|
|
|
nodes (**pc701-pc860**) consisting of:
|
|
|
|
|
|
* [Dell Poweredge R430](http://i.dell.com/sites/doccontent/shared-content/data-sheets/en/Documents/Dell-PowerEdge-R430-Spec-Sheet.pdf)
|
|
|
* Two 2.4 GHz 64-bit 8-Core Xeon E5-2630v3 processors, 8.0 GT/s, 20 MB
|
|
|
cache, VT-x, VT-d and EPT support
|
|
|
* 64 GB 2133 MT/s DDR4 RAM (8 x 8GB modules)
|
|
|
* 2-4 Intel i350 GbE NICs for experimental use
|
|
|
* 2-4 Intel X710 10 GbE NICs for experimental use
|
|
|
* 200 GB 6Gbps SATA SSD, 2 x 1 TB 7200 RPM 6 Gbps SATA disks.
|
|
|
|
|
|
[More details about the d430s.](d430s)
|
|
|
|
|
|
### d820s
|
|
|
|
|
|
There are 16 [d820](http://www.emulab.net/shownodetype.php3?node_type=d820)
|
|
|
PC nodes (**pc601-pc616**) consisting of:
|
|
|
|
|
|
* [Dell Poweredge R820](http://i.dell.com/sites/doccontent/shared-content/data-sheets/en/Documents/Dell_PowerEdge_R820_Spec_Sheet.pdf)
|
|
|
* Four 2.2 GHz 64-bit 8-Core Xeon "Sandy Bridge" processors, 7.20 GT/s
|
|
|
bus speed, 16 MB cache, VT-x and VT-d support
|
|
|
* 128 GB 1333 MHz DDR3 RAM (8 x 16GB modules)
|
|
|
* 4 Broadcom NetXtreme BCM5720C GbE NICs builtin to motherboard (only one in use)
|
|
|
* 2 dual-port Intel X520 PRO/10GbE PCI-Express NICs
|
|
|
* 250GB 7200 rpm SATA disk, 6 x 600GB 10000 rpm SAS disks
|
|
|
|
|
|
[More details about the d820s.](d820s)
|
|
|
|
|
|
### d710s
|
|
|
|
|
|
There are 160 [d710](http://www.emulab.net/shownodetype.php3?node_type=d710)
|
|
|
PC nodes (**pc401-pc560**) consisting of:
|
|
|
|
|
|
* [Dell Poweredge R710](http://www.dell.com/downloads/global/products/pedge/en/server-poweredge-r710-specs-en.pdf)
|
|
|
* 2.4 GHz 64-bit Quad Core Xeon E5530 "Nehalem" processor, 5.86 GT/s bus
|
|
|
speed, 8 MB L3 cache, VT support
|
|
|
* 12 GB 1066 MHz DDR2 RAM (6 x 2GB modules)
|
|
|
* 4 Broadcom NetXtreme II BCM5709 rev C GbE NICs builtin to motherboard
|
|
|
* 2 Broadcom NetXtreme II BCM5709 rev C GbE NICs in dual-port PCIe x4
|
|
|
expansion card (one NIC is the control net)
|
|
|
* 2x 250GB 7200 rpm SATA disks
|
|
|
|
|
|
[More details about the d710s.](d710s)
|
|
|
|
|
|
### pc3000s
|
|
|
|
|
|
There are 160
|
|
|
[pc3000](http://www.emulab.net/shownodetype.php3?node_type=pc3000) PC nodes
|
|
|
(**pc201-pc360**) consisting of:
|
|
|
|
|
|
* [Dell Poweredge 2850](http://www.dell.com/downloads/global/products/pedge/en/2850_specs.pdf)
|
|
|
* 3.0 GHz 64-bit Xeon processors, 800Mhz FSB
|
|
|
* 2GB 400Mhz DDR2 RAM
|
|
|
* Multiple PCI-X 64/133 and 64/100 busses
|
|
|
* 6 10/100/1000 Intel NICs spread across the busses (one NIC is the control net).
|
|
|
* 2 x 146GB 10,000 RPM SCSI disks
|
|
|
* CD-ROM drive (GCR-82840N.)[Important Notes about the pc3000s](../Emulab/wiki/pc3000)
|
|
|
|
|
|
[More details about the pc3000s.](pc3000s)
|
|
|
|
|
|
### Topology and Switch Fabric
|
|
|
|
|
|
![Core Topology](https://gitlab.flux.utah.edu/emulab/emulab-devel/blob/master/www/doc/topo.svg) |