UPDATING 10.8 KB
Newer Older
1
2
3
4
5
6
7
8
Information necessary for keeping boss and ops node up-to-date. This
file contains updates that must be made outside of the database and
the intall tree (ie. /usr/testbed).

This file is in the same format at the FreeBSD UPDATING file, whis is
to say, in reverse chronological order, with the date of the change
in YYYYMMDD format.

9
10
11
12
13
14
15
16
17
18
19
20
21
After each date, you will find one of the following, which tells you
when the action needs to be performed.

Before build - before doing a 'gmake' in your testbed object tree on
	boss and/or ops	
After install - after doing a 'gmake boss-install' on boss or
    'gmake ops-install' on ops

Note that some instructions may have steps that need to occur at a few
different points in the install process - these are marked with the
earliest time one of the steps needs to occur.

20041029: Before build
22
23
24
25
26
27
28
29
30
31
32
	The ulsshxmlrpcpp package was updated to version 0.1.1:

	     http://boss.emulab.net/downloads/ulsshxmlrpcpp-0.1.1.tar.gz

             cd /someplace
	     tar zxf ulsshxmlrpcpp-0.1.1.tar.gz
	     cd ulsshxmlrpcpp-0.1.1
	     configure
	     gmake
	     sudo gmake install

33
34
35
36
37
38
39
40
41
42
43
44
45
20041027: After install (be sure to update sitevars):

	A new sitevariable was added to hold root's ssh public key.
	When nodes boot using the latest image, the public key is
	handed across via tmcd and statshed in /root/.ssh. This
	localizes the image (wrt the root pub key) to the local
	testbed.

	Using the web interface in red dot mode, go to the Edit Site
	Variables link and store boss:/root/.ssh/identity.pub into the
	"node/ssh_pubkey" site variable. Make sure there are no
	newlines when you paste it in.

46
20041025: After install
47
48
49

	Run sql/fixstats_swapmod.pl to fix up stats records.

50
51
52
53
54
	Run "/usr/testbed/etc/rc.d/and start" as root on ops to start
	up the auto nice daemon.  This daemon is not required,
	however, it can save you from greedy users that consume too
	much CPU and cause experiment swapin to fail.

55
20040901: Before build
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
	New SSL version of the XMLRPC server.

	* Install this port on both boss and ops:

		/usr/ports/security/py-m2crypto	

	* Reconfig, rebuild, and reinstall the testbed software on your
	  boss node. Be sure to pick up changes in sql/database-migrate.

	* Install some ssl files on boss:

		cd /usr/object/tree/ssl
		gmake usercert-install

        * Install new version of testbed startup script on boss
	  
		cd /usr/object/tree/rc.d
		sudo gmake install

        * Generate SSL certificates for existing emulab users

		cd /usr/src/tree/sql
		./initcerts.pl

	* Add the following lines to /etc/syslog.conf on boss

	  !sslxmlrpc
	  *.*                            /usr/testbed/log/sslxmlrpc.log

	* Add the following line to /etc/newsyslog.conf on boss

	  /usr/testbed/log/sslxmlrpc.log          640  7     1000 *     Z

        * Create the log file and restart syslog on boss
	
		sudo touch /usr/testbed/log/sslxmlrpc.log
		sudo kill -HUP `cat /var/run/syslog.pid`

        * Fire up the SSL XMLRPC server

		sudo /usr/testbed/sbin/sslxmlrpc_server.py


99
20040816: Before build
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
	The event system has moved to users.emulab.net.

	* Install the elvin libraries and daemon on users.emulab.net.

	* Pick up this package:

	     http://boss.emulab.net/downloads/ulsshxmlrpcpp-0.1.0.tar.gz

             cd /someplace
	     tar zxf ulsshxmlrpcpp-0.1.0.tar.gz
	     cd ulsshxmlrpcpp-0.1.0
	     configure
	     gmake
	     sudo gmake install

	* Reconfig, rebuild, and reinstall the testbed software on your
	  boss node.

	* Reconfig, rebuild, and reinstall the testbed software on your
          users node. 

		ssh users
		cd /your/object/tree/obj/
		gmake
124
		gmake ops-install
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162

        * Install the new elvind config file on boss and restart elvind
          Note that this is not done as part of toplevel install.

		cd /your/object/tree/obj/event/etc
		sudo gmake install
		sudo /usr/local/etc/rc.d/2.elvind.sh stop
		sudo /usr/local/etc/rc.d/2.elvind.sh start

	* Restart tmcd and stated on boss (note that if you plan to just
	  reboot boss, a lot of these steps can be skipped).

		sudo /usr/testbed/sbin/tmcd.restart
		sudo kill -USR1 `cat /var/run/stated.pid`

        * Install the elvind config file on users.
          Note that this is not done as part of toplevel install.

		ssh users
		cd /your/object/tree/obj/event/etc
		sudo gmake control-install

	* Install new rc.d file on boss.
          Note that this is not done as part of toplevel install.

		cd /your/object/tree/obj/rc.d
		sudo gmake install

        * Install the rc.d file that starts elvind on users.
          Note that this is not done as part of toplevel install.

		ssh users
		cd /your/object/tree/obj/rc.d
		sudo gmake control-install

        * Start the elvin server on users.emulab.net:

		ssh users
163
		sudo /usr/local/etc/rc.d/2.elvind.sh start
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214

	* Create the ops certificate (on boss) and copy it to your users node.

		cd /your/object/tree/obj/ssl
		gmake ctrlnode.pem
		sudo scp ctrlnode.pem users:/etc/emulab/client.pem
		sudo ssh users chmod 600 /etc/emulab/client.pem
		sudo scp emulab.pem users:/etc/emulab

        * Install the tmcd client stuff on users.emulab.net.

		ssh users.emulab.net
		cd /your/object/tree/obj/tmcd/freebsd
		sudo gmake control-install

        * Create the emulab-ops/opsnode experiment. Do this the same way
          that hwdown is created in setup-db.txt.

	* Create a node_types entry for ops. This is mostly just a stub
	  entry so that tmcd will recognize it and so that other parts of
	  the system are happy. Be sure that you get the interface correct,
	  and set the Default OSID to emulab-ops/OPSNODE-BSD. The type is
	  ops and the class is misc.

	* Create the ops node nodes table entry ...

	* Place the ops node into the above experiment:

		wap nalloc emulab-ops opsnode ops

	* Make sure that netcat is installed.

		cd /usr/ports/net/netcat
		sudo make
		sudo make install
		
	* Add entry to /etc/services for elvin:

		elvin		2917/tcp

	* Change the CNAME event-server to your zone file from boss to ops.

		event-server	IN	CNAME	ops

	* Start the alternate inetd service so that old images trying to
	  connect to the event server are redirected to users.emulab.net.
	  Be sure to replace boss.foo.bar with the right name.

		sudo inetd -a boss.foo.bar -p /var/run/testbed-inetd.pid \
			/usr/testbed/etc/inetd.conf

215
216
217
218
219
220
	* Stick boss's host keys onto ops so that users do not get
	  those silly questions about adding know hosts.

		sudo cat /etc/ssh/*.pub |
			ssh myops '(cat > /etc/ssh/ssh_known_hosts)'

221
20040815: After install
222
223
224
225
226
227
	After some changes to ptopgen, you'll need to run the following SQL
	command to keep vnodes working properly:

	update os_info set nextosid='FBSD-STD' \
	    where osid='emulab-ops-FBSD-JAIL';

228
20040809: After install
229
230
231
232
233
234
235
236
237
238
239
240
241
	New syslog file for logging requests to the XMLRPC server.

		sudo touch /usr/testbed/log/xmlrpcbag.log

	Add these two lines to /etc/syslog.conf and then HUP syslogd:

		!xmlrpcbag
		*.*                      /usr/testbed/log/xmlrpcbag.log

        Add this line to /etc/newsyslog.conf:

		/usr/testbed/log/xmlrpcbag.log      640  7     1000 *     Z

242
20040805: After install
243
244
245
246
	Add a new CNAME for boss to /etc/namedb/<OURDMAIN>.db.head -
	event-server . Re-run named_setup on boss to make this change
	take place. In the future, we may move this CNAME to ops.

247
20040713: After install
Leigh B. Stoller's avatar
Leigh B. Stoller committed
248
249
250
251
252
	For new distributed routing support, must first run this script as
        root to generate a data file for each existing experiment.

		sudo sql/gentopmaps.pl

253
20040625: After install
Leigh B. Stoller's avatar
Leigh B. Stoller committed
254
	After updating to revision 1.257 of sql/database-migrate.txt,
255
256
257
258
259
260
        run sql/devlnodes.pl to clear out all of the non reserved
        pcvm nodes. Be sure to do a current install of the software, and
        then:

		update node_types set isdynamic=1 where type='pcvm';

261
20040615: Before build
262
263
264
265
266
267
268
	If you update the ports on your boss node, you'll need to take
	into accout that FreeBSD is in the process of changing how its
	rc.d scripts work - add the following two lines to the bottom
	of your /etc/rc.conf on boss:
	  dhcpd_enable="YES"
	  apache_enable="YES"

269
20040601: Before build
270
271
	The p5-Time-HiRes port is now required on both boss and ops -
	install it from /usr/ports/devel/p5-Time-HiRes .
272

273
20040420: Before build
274
275
276
	Switched web search button backend from webglimpse to swish-e.
        Just need to go to /usr/ports/www/swish-e and install the port.

277
20040303: Before build
278
279
280
281
282
283
284
285
286
287
288
	Fixed the way we handle the certificate for capture with tiptunnel.
	We no longer hard-code the certificate digest in nodetipacl.php3 .
	However, as a result, we must place this fingerprint in a publically-
	readable file on boss. So, if you have serial lines that you're
	running with capture:
	1) Copy your /usr/testbed/etc/capture.pem file from your tipserver to
	boss, if it isn't there already.
	2) In /usr/testbed/etc/ on boss, run: 'openssl x509 -sha -noout
	-fingerprint -in capture.pem > capture.fingerprint', and make this
	file world-readable.

289
20040302: Before build
290
291
292
293
294
	Changed the length of the node_id columns from 10 to 32. Make sure
	you re-compile and restart all daemons written in C (such as
	tmcd, tevd, and the event schedulers) before putting any nodes in
	the database with names longer than 10 characters.

295
20040226: After install
296
297
298
299
300
301
302
303
	Re-worked the way named_setup handles virtual nodes and unroutable
	IP addresses - no point in handling the two differently. Thus, the
	'vnodes.<OURDOMAIN>.db' DNS zone file is no longer generated.
	Instead, if you have a mix of routable and unroutable IP addresses,
	you'll need to switch to using the '<OURDOMAIN>.internal.db' zone
	file - see Step 6 of doc/setup.txt for instructions on setting up
	this file.

304
20040121: After install
305
306
307
308
	Changed the 3.testbed.sh rc.d script to handle 'start' and 'stop'
	arguments properly. Install a fresh copy of rc.d/3.testbed.sh into
	/usr/local/etc/rc.d .

309
20040120: After install
310
311
312
313
314
315
316
	Bumped up the sizes on some buffers to help network performance.
	Add the following two lines to /etc/sysctl.conf:

	net.local.dgram.maxdgram=65536
	net.local.dgram.recvspace=65536


317
20040112: After install
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
       Big change to bootinfo sequence.

       * Update DB with new contents of sql/database-fill.sql *and
         sql/database-fill-suplement.sql.
       * Rebuild pxeboot kernel from source (src/sys/boot/i386/emuboot).
         Install emuboot to /tftpboot/pxeboot.emu
       * Install new version of dhcpd.conf file that has all the PXE
         crap removed and includes the single line:

		filename "/tftpboot/pxeboot.emu";

       * Restart dhcpd. 
       * Kill proxydhcp. Be sure to install new 3.testbed.sh from the
         rc.d directory to /usr/local/etc/rc.d, or just edit in place
       * Restart bootinfo.
       * Restart stated.
       * Reboot all non allocated nodes so that they go into pxewait mode.

336
20031215: Before build
337
338
339
340
	The mod_php4 port on boss should be recompiled with the
	'xmlrpc' option, in addition to the 'mhash' option already
	used. Apache on boss will need to be restarted after the new
	port is installed.
341