hardware.html 6.26 KB
Newer Older
Leigh B. Stoller's avatar
Leigh B. Stoller committed
1 2
<!--
   EMULAB-COPYRIGHT
Mike Hibler's avatar
Mike Hibler committed
3
   Copyright (c) 2000-2003 University of Utah and the Flux Group.
Leigh B. Stoller's avatar
Leigh B. Stoller committed
4 5
   All rights reserved.
  -->
6 7
<center>
<h1>
8
    Hardware Overview, "Emulab Classic"
9 10 11
</h1>
</center>

Jay Lepreau's avatar
Jay Lepreau committed
12
<h3>Test Nodes</h3>
13
<ul>
14
<a name="tbpcs"></a>
15 16
<a name="tbpc850"></a>
<li>128 "pc850" PC nodes (<b>pc41-pc168</b>), consisting of:
17 18 19 20 21

<ul>
<li> 850MHz Intel Pentium III processors.
<li> Based on the
<a
Mike Hibler's avatar
Mike Hibler committed
22
href="http://www.intel.com/support/motherboards/server/isp1100/">
23
Intel ISP1100 </a> 1U server platform (old reliable BX chipset).
Jay Lepreau's avatar
Jay Lepreau committed
24
<li> 512MB PC133 ECC SDRAM.
25 26 27 28
<li> 5
<a
href="http://support.intel.com/support/network/adapter/pro100/index.htm">
Intel EtherExpress Pro</a> 10/100Mbps Ethernet ports:
29 30 31
<ul>
	<li>2 builtin on the motherboard
		(<code>eth2/eth3</code> in Linux, <code>fxp0/fxp1</code> in FreeBSD)</i>
32 33 34
	<li>2 on an
	    <a href = "http://www.intel.com/network/connectivity/resources/doc_library/tech_specs/pro100dport.htm">
	    Intel EtherExpress Pro 100+ Dual-Port Server Adapter</a>
35 36 37 38
		(<code>eth0/eth1</code> in Linux, <code>fxp2/fxp3</code> in FreeBSD)
	<li>1 on a single-port Intel EtherExpress Pro/100B Adapter
		(<code>eth4</code> in Linux, <code>fxp4</code> in FreeBSD)
</ul>
Chad Barb's avatar
Chad Barb committed
39 40
<li> 
40GB IBM 60GXP 7200RPM ATA/100 IDE hard drive.
41 42 43 44
<li> Floppy drive.
</ul>
<p>

45 46 47 48 49 50
<a name="tbpc600"></a>
<li>40 "pc600" PC nodes (<b>pc1-40</b>), consisting of:

<ul>
<li> 600MHz Intel Pentium III "Coppermine" processors.
<li> 
Chad Barb's avatar
Chad Barb committed
51
Asus P3B-F (6 PCI/1 ISA slot) motherboard (old reliable BX chipset).
52 53 54 55 56
<li> 256MB PC100 ECC SDRAM.
<li> 5
<a
href="http://support.intel.com/support/network/adapter/pro100/index.htm">
Intel EtherExpress Pro/100B</a> 10/100Mbps Ethernet cards.
Chad Barb's avatar
Chad Barb committed
57 58
<li>
13GB IBM 34GXP DPTA-371360 7200RPM IDE hard drive.
59 60 61
<li> Floppy drive
<li> Cheap video card (Jaton Riva 128ZX AGP w/4MB video RAM)
<li> All in a nice but overweight rackmount case on rails:
Chad Barb's avatar
Chad Barb committed
62
Antec IPC3480B, with 300W PS and extra fan.
63 64
</ul>
<p>
65

66
<a name="tbshark"></a>
67 68
<li><em>(Currently unavailable)</em><br>
	160 diskless <a href = "http://www.research.digital.com/SRC/iag/">
69 70
	Compaq DNARD "Sharks"</a> edge nodes (<b>sh[1-20]-[1-8]</b>),
	consisting of:
71

72 73 74 75 76 77
<ul>
<li> 233 Mhz StrongARM processors.
<li> 32MB RAM.
<li> 1 10Mbps ethernet interface.
</ul>
<p>
78

Jay Lepreau's avatar
Jay Lepreau committed
79 80 81 82 83
</ul>
<h3>Servers</h3>
<ul>

<li> a users, file, and serial line server (<b>users.emulab.net</b>), consisting of:
84 85

<ul>
86
<li> Dual 500MHz Intel Pentium III processors
Chad Barb's avatar
Chad Barb committed
87 88
<li> 
Intel L440GX+ motherboard (the GX+ chipset)
89 90
<li> 512MB PC100 ECC SDRAM
<li> 90 GB disk space: 5 
Chad Barb's avatar
Chad Barb committed
91
Quantum Atlas IV 18GB 7200RPM Wide LVD SCSI hard drives
92 93 94
<li> 3 64-port
<a href="http://www.cyclades.com/products/svrbas/zseries.htm">
Cyclades-Ze PCI Multiport Serial Boards</a> (model number SEZ0050).
95 96 97
</ul>
<p>

98
<li> a DB, web, DNS and operations server, consisting of:
99 100

<ul>
Chad Barb's avatar
Chad Barb committed
101 102
<li>
Dell PowerEdge 2550 Rack Mount Server
103
<li> Single 1000MHz Intel Pentium III processor
104 105 106 107 108 109 110 111
<li> 512MB PC133 ECC SDRAM
<li> Dual-Channel On-board RAID (5) Controller 128MB Cache (2-Int Channels)
<li> Five 18GB Ultra3 (Ultra160) SCSI 10K RPM Hot Plug Hard Drives
<li> Dual Redundant 330 Watt Power Supplies
<li> Integrated Broadcom Gigabit BaseT and Intel Pro/100+ NICs
</ul>
<p>

Jay Lepreau's avatar
Jay Lepreau committed
112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131
<li> a second serial line server, consisting of:
<ul>
<li> 1U box from <a href = "http://www.asacomputers.com/">ASA Computers</a>
<li> 1 64-port
	<a href="http://www.cyclades.com/products/svrbas/zseries.htm">
	Cyclades-Ze PCI Multiport Serial Board</a> (model number SEZ0050).
</ul>
<p>

<li> a serial line server for critical emulab machines, consisting of:
<ul>
<li> An ISP1100 box, like the "pc850" nodes above.
<li> a 4-port serial card.
</ul>
<p>

</ul>
<h3>Switches and Routers</h3>
<ul>

132
<li> 4 <a href = "http://www.cisco.com/warp/public/cc/pd/si/casi/ca6000/prodlit/c6000_ds.htm">
Jay Lepreau's avatar
Jay Lepreau committed
133
Cisco 6509 high-end switches</a>.
134
	Three function as the
135 136
	<a name="tbbackplane"></a>
	<em>testbed backplane</em> ("programmable patch panel"),
Jay Lepreau's avatar
Jay Lepreau committed
137
	each filled with a
138 139 140
	<a href = "http://www.cisco.com/warp/public/cc/pd/si/casi/ca6000/prodlit/6nam_ds.htm">
	Network Analysis Module</a>
	and seven 48-port 10/100 ethernet modules,
Jay Lepreau's avatar
Jay Lepreau committed
141
	giving 336 100Mbps ethernet ports on each.  They are linked with 2 Gbit interfaces.
142 143 144 145 146 147
	The final 6509 contains an MSFC router card and functions as the
	<a name="tbcorerouter"></a>
	<em>core router</em> for the testbed,
	providing "control" interfaces for the test nodes as well as
	regulating access to the testbed servers and the outside world.
	This switch is configured with full router software,
Jay Lepreau's avatar
Jay Lepreau committed
148
	Gigabit ethernet, OC-12 ATM (~600Mbps), and more 
149
	10/100 Ethernet ports.
150 151 152
        <!-- Another, but no pix: http://www.cisco.com/univercd/cc/td/doc/pcat/ca6000.htm -->
<p>

Jay Lepreau's avatar
Jay Lepreau committed
153 154 155 156
</ul>
<h3>Power Controllers</h3>
<ul>

157 158
<li>10 APC MasterSwitch AP9210 8 port power controllers.<br>
    (The AP9210 is discontinued; replaced in the product line by the
Chad Barb's avatar
Chad Barb committed
159
    AP9211.)
160 161
<p>

162 163 164 165
<li>7 <a href="http://www.baytechdcd.com/products/rpc27.shtml">
	BayTech RPC27</a> 20 port remote power controllers.<br>
<p>

Jay Lepreau's avatar
Jay Lepreau committed
166 167 168 169
</ul>
<h3>Racks</h3>
<ul>

Chad Barb's avatar
Chad Barb committed
170 171
<li>13
	Wrightline "Tech I" racks: 44U, 34" deep, 2 are
Jay Lepreau's avatar
Jay Lepreau committed
172 173
	24" wide with cable management; the rest are 19" wide.
	(Aug 2001: these appear to have been discontinued or renamed.)
174 175 176 177 178 179
<p>

</ul>

<p><h2>Layout</h2><p>

180 181 182 183 184 185 186 187
Four ethernet ports on each PC node are connected to the
      <a href="#tbbackplane">testbed backplane</a>.
      All 672 ports can be connected in arbitrary ways by setting up VLANs
      on the switches via remote configuration tools. 
      Cisco 6500 Switch backplane bandwidth is supposed to be near 50Gb/s,
      <!-- but we've heard rumors that it's worse. -->
      though between the testbed backplane switches,
      bandwidth is currently limited to 2Gb/s.
188 189
<p>

190 191 192 193
The fifth ethernet port on each PC is connected to the
      <a href="#tbcorerouter">core router</a>.
      Thus each PC has a full duplex 100Mbps connection to the servers.
      These connections are for dumping 
194 195 196 197 198
      data off of the nodes and such, without interfering with
      the experimental interfaces. The only impact on the node is
      processor and disk use, and bandwidth on the PCI bus.
<p>

199 200 201 202 203 204 205
The DNARD Sharks are arranged by "shelves."  A shelf holds 8 sharks
      each of which is connected by a 10Mbps link to an
      8+2 10/100 ethernet switch from Asante.  The Asante switches
      are connected via a 100Mbps link to the testbed backplane.
      Thus each shelf of 8 sharks
      is capable of generating up to 80Mbps to the backplane.

206