• David Johnson's avatar
    Parameterize hadoop wfas; change master flow setup; check master flows. · 73aca117
    David Johnson authored
    First, we add key-val parameters.  broker_name=foo sets the broker name
    to foo for registration and lookup (defaults to 'hadoop').
    runhadoop=False (or other False equivalents) will force the wfas to skip
    Hadoop config and run.
    
    We also separate out master<->slave flow setup and put it at the
    beginning of the allpairs flow mesh setup; this was for debugging.
    
    Finally, we also try and retry a simple parallel ssh task from the
    Hadoop master to all slaves, to "verify" and "wait" for them to all be
    up and reachable.  This helps us catch problems like when a VM can't
    fully boot because it failed to get its metadata, or whatever.
    73aca117
Name
Last commit
Last update
cloudlab Loading commit data...
compute_capnet Loading commit data...
etc Loading commit data...
lib/systemd/system Loading commit data...
networking_capnet Loading commit data...
.gitattributes Loading commit data...
.gitignore Loading commit data...
.gitlab-ci.yml Loading commit data...
DEVELOPING.rst Loading commit data...
README.rst Loading commit data...
requirements.txt Loading commit data...
setup.cfg Loading commit data...
setup.py Loading commit data...
tox.ini Loading commit data...