• Mike Hibler's avatar
    Rejiggered reload_daemon to enforce a max time. · b6d272a2
    Mike Hibler authored
    There are now some sitevars to control its behavior, the one of interest here
    is reload/failtime:
    
    The way the reload daemon is supposed to work now is that nodes will be
    started on their reloading adventure with an os_load. If they are still there
    after reload/retrytime minutes, then they will either be rebooted (if the
    os_load was successful) or os_load'ed again (if the first os_load failed
    outright). The logic for either of these is that there might have been some
    transient condition that caused the failure. If we do have to perform this
    "retry" then we will send email to testbed-ops if reload/warnonretry is set.
    If, after another reload/retrytime minutes, a node is still there, then the
    node will be sent to hwdown, possibly powering it off or booting it into the
    admin MFS depending on the setting of reload/hwdownaction.
    
    So really, reload/failtime should not be needed. All node should exit
    reloading in 2 * reload/retrytime minutes. But it is there as a backstop
    (and because I didn't understand the logic of the reload daemon at first!)
    Well, it also comes into play if the reload daemon is restarted after being
    down for a long period of time. In this case, all nodes in reloading will
    get moved to hwdown. May need to reconsider this...
    b6d272a2
Name
Last commit
Last update
..
checkpass Loading commit data...
checkup Loading commit data...
ipassign Loading commit data...
labels Loading commit data...
ns2ir Loading commit data...
nseparse Loading commit data...
nsverify Loading commit data...
plab Loading commit data...
snmpit_old Loading commit data...
snmpit_test Loading commit data...
template_cvsroot Loading commit data...
GNUmakefile.in Loading commit data...
README Loading commit data...
Template.pm.in Loading commit data...
archive_control.in Loading commit data...
arplockdown.in Loading commit data...
assign_prepass.in Loading commit data...
assign_wrapper.in Loading commit data...
assign_wrapper2.in Loading commit data...
batch_daemon.in Loading commit data...
batchexp.in Loading commit data...
bscheck.in Loading commit data...
bscontrol.in Loading commit data...
bwconfig.in Loading commit data...
checknodes_daemon.in Loading commit data...
checkports.in Loading commit data...
console_reset.in Loading commit data...
console_setup.in Loading commit data...
console_setup.proxy.in Loading commit data...
db2ns.in Loading commit data...
elabinelab.in Loading commit data...
endexp.in Loading commit data...
eventsys.proxy.in Loading commit data...
eventsys_control.in Loading commit data...
eventsys_start.in Loading commit data...
exitonwarn.pm Loading commit data...
exports_setup.in Loading commit data...
exports_setup.proxy.in Loading commit data...
fetchtar.proxy.in Loading commit data...
frisbeehelper.in Loading commit data...
gentopofile.in Loading commit data...
idlepower.in Loading commit data...
idleswap.in Loading commit data...
image_setup.in Loading commit data...
lease_daemon.in Loading commit data...
libArchive.pm.in Loading commit data...
libadminmfs.pm.in Loading commit data...
libaudit.pm.in Loading commit data...
libosload.pm.in Loading commit data...
libosload_new.pm.in Loading commit data...
libosload_switch.pm.in Loading commit data...
libossetup.pm.in Loading commit data...
libossetup_switch.pm.in Loading commit data...
libptop.pm.in Loading commit data...
libptop_new.pm.in Loading commit data...
libreboot.pm.in Loading commit data...
libtblog.pm.in Loading commit data...
libtblog_simple.pm Loading commit data...
libtbsetup.pm Loading commit data...
libtestbed.pm.in Loading commit data...
libtestbed.py.in Loading commit data...
libvtop.pm.in Loading commit data...
libvtop_stable.pm.in Loading commit data...
libvtop_test.pm.in Loading commit data...
mapper.in Loading commit data...
mkexpdir.in Loading commit data...
mkgroup.in Loading commit data...
mkproj.in Loading commit data...
modgroups.in Loading commit data...
named_setup.in Loading commit data...
newnode_reboot.in Loading commit data...
nfsmfs_setup.in Loading commit data...
nfsmfs_setup.proxy.in Loading commit data...
nfstrace.in Loading commit data...
node_attributes.in Loading commit data...
node_control.in Loading commit data...
node_history.in Loading commit data...
node_reboot.in Loading commit data...
node_update.in Loading commit data...
nscheck.in Loading commit data...
nseswap.in Loading commit data...
os_load.in Loading commit data...
os_select.in Loading commit data...
os_setup.in Loading commit data...
os_setup_old.in Loading commit data...
panic.in Loading commit data...
plabinelab.in Loading commit data...
pool_daemon.in Loading commit data...
portal_daemon.in Loading commit data...
portstats.in Loading commit data...
power.TODO Loading commit data...
power.in Loading commit data...
power_apc.pm Loading commit data...
power_icebox.pm Loading commit data...
power_ilo.pm.in Loading commit data...
power_ipmi.pm.in Loading commit data...
power_mail.pm.in Loading commit data...
power_racktivity.pm.in Loading commit data...
power_rmcp.pm.in Loading commit data...
power_rpc27.pm.in Loading commit data...
power_sgmote.pm.in Loading commit data...
power_ue.pm.in Loading commit data...
power_whol.pm.in Loading commit data...
ptopgen.in Loading commit data...
ptopgen_new.in Loading commit data...
pxe_select.in Loading commit data...
regression.in Loading commit data...
reload_daemon.in Loading commit data...
reportboot.in Loading commit data...
repos_daemon.in Loading commit data...
resetvlans.in Loading commit data...
rflinks.in Loading commit data...
rmgroup.in Loading commit data...
rmproj.in Loading commit data...
rmuser.in Loading commit data...
routecalc.cc Loading commit data...
savelogs.in Loading commit data...
savelogs.proxy.in Loading commit data...
sched_reload.in Loading commit data...
sched_reserve.in Loading commit data...
setgroups.in Loading commit data...
sfskey_update.in Loading commit data...
sfskey_update.proxy.in Loading commit data...
smbpasswd_setup.in Loading commit data...
smbpasswd_setup.proxy.in Loading commit data...
snmpit.in Loading commit data...
snmpit.proxy.in Loading commit data...
snmpit.proxynew.in Loading commit data...
snmpit.proxyv2.in Loading commit data...
snmpit.proxyv3.in Loading commit data...
spewlogfile.in Loading commit data...
spewrpmtar.in Loading commit data...
spewrpmtar_cgi.in Loading commit data...
spewrpmtar_verify.in Loading commit data...
staticroutes.in Loading commit data...
swapexp.in Loading commit data...
switchmac.in Loading commit data...
tarfiles_setup.in Loading commit data...
tbend.in Loading commit data...
tbprerun.in Loading commit data...
tbreport.in Loading commit data...
tbrestart.in Loading commit data...
tbrsync.in Loading commit data...
tbswap.in Loading commit data...
tcpp.in Loading commit data...
template_analyze.in Loading commit data...
template_checkout.in Loading commit data...
template_commit.in Loading commit data...
template_control.in Loading commit data...
template_create.in Loading commit data...
template_delete.in Loading commit data...
template_export.in Loading commit data...
template_exprun.in Loading commit data...
template_graph.in Loading commit data...
template_instantiate.in Loading commit data...
template_linkgraph.in Loading commit data...
template_metadata.in Loading commit data...
template_revise.in Loading commit data...
template_swapin.in Loading commit data...
template_swapout.in Loading commit data...
vnode_setup.in Loading commit data...
vtopgen.in Loading commit data...
wanassign.in Loading commit data...
wanlinkinfo.in Loading commit data...
wanlinksolve.cc Loading commit data...
webfrisbeekiller.in Loading commit data...