All new accounts created on Gitlab now require administrator approval. If you invite any collaborators, please let Flux staff know so they can approve the accounts.

Commit 73aca117 authored by David Johnson's avatar David Johnson

Parameterize hadoop wfas; change master flow setup; check master flows.

First, we add key-val parameters.  broker_name=foo sets the broker name
to foo for registration and lookup (defaults to 'hadoop').
runhadoop=False (or other False equivalents) will force the wfas to skip
Hadoop config and run.

We also separate out master<->slave flow setup and put it at the
beginning of the allpairs flow mesh setup; this was for debugging.

Finally, we also try and retry a simple parallel ssh task from the
Hadoop master to all slaves, to "verify" and "wait" for them to all be
up and reachable.  This helps us catch problems like when a VM can't
fully boot because it failed to get its metadata, or whatever.
parent 4703e6c2
Pipeline #1916 passed with stage
in 2 seconds