1. 10 Jan, 2007 1 commit
  2. 09 Jan, 2007 1 commit
  3. 21 Sep, 2006 1 commit
    • Kirk Webb's avatar
      · a6eedb84
      Kirk Webb authored
      Add BWLIMIT to the set of plab node attributes tracked by the Portal.
      Also, re-org and clean up a bunch of stuff to make the code more
  4. 13 Sep, 2006 1 commit
    • Kirk Webb's avatar
      · 77994483
      Kirk Webb authored
      Minor bug fix.
  5. 11 Sep, 2006 1 commit
    • Kirk Webb's avatar
      · aa446875
      Kirk Webb authored
      plab logging enhancements.
      timing information for various RPCs is now logged to
      /usr/testbed/log/plabtiming.log.  This info will be useful for extracting
      trends for the various plab nodes, and in calculating reliability and
      timing metrics.  These could be used, for e.g., to pick nodes that tend to
      come up more quickly.
      This update also squelches much of the python backtrace noise when plab nodes
      fail to setup correctly (can be turned on with debug flag).  Instead, failures
      are summarized on a single line.
      Oh, and pay no attention to the aspect behind the curtain!  Yes, you may
      groan and moan if you wish - I'm using aspects to help do the logging.  I
      find this to be a really slick way of wrapping several functions!
  6. 31 Aug, 2006 1 commit
    • Kirk Webb's avatar
      · 210d1a85
      Kirk Webb authored
      A node update bugfix and a change to the way nodes with more than two
      changed attributes are handled.  A single message is now sent detailing
      which nodes need to be looked at, and such nodes to not stop the rest from
      updating normally during that run.  Previously the nodes with multiple changes
      had to be handled first, then the update script had to be run after that to
      catch everything.
  7. 04 Aug, 2006 2 commits
    • Kirk Webb's avatar
      · 19616c33
      Kirk Webb authored
      bah, fix to the fix.
    • Kirk Webb's avatar
      · 4b477246
      Kirk Webb authored
      A few little things:
      * Minor bugfix to node_type_attributes mod.
      * When we don't recognize the gateway, set type to "*Unknown*".  Should
        have always been doing this.
      * Add NLR gateway - new nodes detected here will be set to pcplabinet2,
        but this could easily be changed.
  8. 20 Jul, 2006 2 commits
    • Kirk Webb's avatar
      · a6351f3c
      Kirk Webb authored
      Change user that receives slice email from the head of the experiment to
      the experiment swapper.
    • Kirk Webb's avatar
      · 42c70446
      Kirk Webb authored
      Users that create Planetlab experiments will now get email coming back via
      the emulabman@emulab.net alias.  The technique is simple:  stash away the
      experiment head uid in a file corresponding to the slice's name over in
      ops:/etc/mail/plab-slice-addrs.  The silly procmail config file I've committed
      here reads this file (if it exists) and forwards mail to the user's email addr
      contained therein if the incoming message contains the name of their slice.
      There is no install target for this procmail filter;
      I hand installed it and hooked it in.
  9. 18 Jul, 2006 1 commit
    • Leigh B. Stoller's avatar
      Changes necessary for moving most of the stuff in the node_types · 624a0364
      Leigh B. Stoller authored
      table, into a new table called node_type_attributes, which is intended
      to be a more extensible way of describing nodes.
      The only things left in the node_types table will be type,class and the
      various isXXX boolean flags, since we use those in numerous joins all over
      the system (ie: when discriminating amongst nodes).
      For the most part, all of that other stuff is rarely used, or used in
      contexts where the information is needed, but not for type descrimination.
      Still, it made for a lot of queries to change!
      Along the way I added a NodeType library module that represents the type
      info as a perl object. I also beefed up the existing Node module, and
      started using it in more places. I also added an Interfaces module, but I
      have not done much with that yet.
      I have not yet removed all the slots from the node_types table; I plan to
      run the new code for a few days and then remove the slots.
      Example using the new NodeType object:
      	use NodeType;
      	my $typeinfo = NodeType->Lookup($type);
              if ($typeinfo->control_interface(\$control_iface) ||
                  !$control_iface) {
        	    warn "No control interface for $type is defined in the DB!\n";
      or using the Node:
      	use Node;
              my $nodeobject = Node->Lookup($node_id);
              my $imageable  = $nodeobject->NodeTypeInfo()->imageable();
              my $rebootable = $nodeobject->isrebootable();
              $nodeobject->NodeTypeAttribute("control_interface", \$control_iface);
      Lots of way to accomplish the same thing, but the main point is that the
      Node is able to override the NodeType (if it wants to), which I think is
      necessary for flexibly describing one/two of a kind things like switches, etc.
  10. 14 Jul, 2006 1 commit
    • Kirk Webb's avatar
      · 04d35bee
      Kirk Webb authored
      Change interface_type for newly discovered plab nodes to plab_fake.  This
      was previously set to 'fxp'.
  11. 10 Jul, 2006 2 commits
  12. 26 Jun, 2006 1 commit
    • Robert Ricci's avatar
      Put the latitude and longitude for PlanetLab nodes into the · 676bfc55
      Robert Ricci authored
      widearea_nodeinfo table. This will be used to generate maps of the
      planetlab (and probably RON, by zip code) nodes.
      Also check for, and update in the case of, site chages.
      Took a while, since I don't know python well, but I learned a lot in
      the process.
  13. 25 Mar, 2006 1 commit
    • Kirk Webb's avatar
      · 623b9be0
      Kirk Webb authored
      Fix up plab renewal for current scheme.  We must now go out to each sliver
      individually and ask for it to be renewed.  I've added a new script to be
      run out of cron that will run through and attempt to renew all active slices.
      If a node cannot be renewed with its slice and comes sufficiently close to
      it's recorded expiration (currently two weeks out), mail will be sent to
      testbed ops warning about this situation.  Note that there will only be
      one email message per slice, containing a list of all nodes at risk for
      expiration.  The plab renewal daemon will no longer run as a result of
      this change.  Note that this is sort of a hack.  The better way would be
      to have the daemon perisistenly try to renew nodes that have failed until
      success, but that will take more work, and I might farm it off to the
      plab monitoring daemon anyway.
  14. 15 Mar, 2006 1 commit
    • Kirk Webb's avatar
      · 3b7a67ce
      Kirk Webb authored
      Pass experiment description through to Planetlab as the slice description
      when creating a slice.  Also mention the Planetlab AUP and importance of
      providing an accurate slice description in the documentation.  The ez
      interface also briefly mentions the importance of the slice description.
  15. 13 Mar, 2006 1 commit
    • Kirk Webb's avatar
      · 99a5bd48
      Kirk Webb authored
      Use a file to manage the list of ignored/allowed nodes instead of hard coding
      them into the source.  The files are:
  16. 28 Jan, 2006 1 commit
    • Kirk Webb's avatar
      · a781089f
      Kirk Webb authored
      Added code to insert mappings into the plab_site_mapping table.
  17. 22 Jan, 2006 3 commits
    • Kirk Webb's avatar
      · 0418a8ea
      Kirk Webb authored
      OK - really exit when I say so.  Note: sys.exit() _and_ sys._exit() throw
      exceptions.  Must use os._exit() to exit immediately.
    • Kirk Webb's avatar
      · 78d18be0
      Kirk Webb authored
      More info when exiting due to a signal.
    • Kirk Webb's avatar
      · c4d0c78a
      Kirk Webb authored
      Exit right away when signalled while trying to perform a remote command.
      More info when a timeout occurs, and reduce the execution spacing a little.
  18. 09 Jan, 2006 1 commit
    • Kirk Webb's avatar
      · 55268d31
      Kirk Webb authored
      More turd wrangling.  Be sure to kill off child processes when the parent
      receives a signal.  This should prevent the slow, but steady buildup of
      stuck ssh processes on boss resulting from the monitor daemon trying to
      bring back nodes.
  19. 05 Jan, 2006 1 commit
    • Kirk Webb's avatar
      · af1963ae
      Kirk Webb authored
      Avoid starting an intermediate shell when executing commands.
  20. 21 Dec, 2005 2 commits
    • Kirk Webb's avatar
      · afdc0742
      Kirk Webb authored
      Um, yeah, update the interfaces and widearea_nodeinfo tables too when a plab
      node's attributes change.  Duh..  DB fixed up.
    • Kirk Webb's avatar
      · 58a82518
      Kirk Webb authored
      Slice renewal updated to work with new PLC API.  Emulab-created plab slices
      are no longer in danger of falling out from under our users!
  21. 20 Dec, 2005 2 commits
    • Kirk Webb's avatar
      · d6ac9bcd
      Kirk Webb authored
      Ignore a couple of plab nodes with duplicate MAC addrs until they are fixed.
      These nodes won't be available for allocation in the meantime.
    • Kirk Webb's avatar
      · a0a39a39
      Kirk Webb authored
      A few fixes for plab.
      Assign unique sshd port numbers.  This was only being done for pcvms for some
      Make 'nobody' the contact uid for newly createed plab nodes (instead of
      Brent Chun).
      Create /local/logs inside plab vservers.
  22. 15 Dec, 2005 1 commit
    • Kirk Webb's avatar
      · 41c54939
      Kirk Webb authored
      The revived Plab interface is here!
      Lots of updates to the plab backend, including improved plab <-> elab node
      id translation and update handling.  Includes support for the current PLC
      API, and the new pl_conf node manager interface API.  Several more db library
      routines were ported from the perl library to the python one to support the
      new code (mostly the node_id tracking stuff).  Fixes to the client side and
      also a rootball creation cleanup (binaries removed from the CVS repo).
      There are also enhancements to the experiment view page for experiments
      including plab nodes: site and widearea hostname are now displayed along
      with the other node information.
      Note that the way setup timeout for vnodes is calculated has been changed a
      bit.  Instead of using a hardwired base timeout, the base timeout is now
      based on the reload_waittime database field, which comes from the 'OS'
      (e.g., FBSD-JAIL, RHL-PLAB) the vnode runs.
      The default max duration for a plab slice created through the plab_ez interface
      is set to 1 year, and linktest is currently disabled and hidden through
      the ez interface.
      There is still work to do, but this checkin brings with it a functional
      plab portal!
  23. 13 Sep, 2004 2 commits
    • Kirk Webb's avatar
      Enable polling mode node setup by default until we get v3 plab support · 4372ebac
      Kirk Webb authored
      finished up (waiting for resolution of the service slice bootstrapping
    • Kirk Webb's avatar
      A couple of minor fixups: · 2240b14e
      Kirk Webb authored
      * the python mysql client returns a datetime object rather than a string
        sequence - must convert it to string
      * PLAB moved the URL to their programmatic API - adjusted on our end.
      * PLAB changed format of expiration time in listSlices() RPC from a
        datetime string to seconds since the epoch in UTC.
      There is still an outstanding issue that I have mailed plab support about:
      The listSlices() RPC is only returning the first entry in the list of slices
      we have allocated at PLC (the same call used to grab all slice entries).
      This is causing us to fail on renewal for the unlisted slices.
  24. 19 Jul, 2004 1 commit
    • Kirk Webb's avatar
      · 03921d0e
      Kirk Webb authored
      A bunch of plab interface updates that I've worked on over the last while.
      Most significant is the revamped renewal code that tries to push the leases
      out to the policy defined maximum of two months during each iteration through
      the plabrenewd daemon loop.
      - added python lib code to get SiteVars
      - Fixed up comments to reflect current code operation
      - revamped renewal code (again)
        - changed all times to UTC for consistency
        - removed node-level renew invocation in favor of slice-level
          - if backend module requires node-level renewals, it must handle them
            itself in the slice-level function
          - better reporting
      - set admin bit if creating svc slice
        - other updates to ensure admin bit is preserved
      - update rootball handling function naming
      - updated tryXmlRpcCmd() to accept two new sets of strings, and a callback
        function.  The strings represent Faults that either 1) indicate success,
        or 2) indicate failure.  The callback is another optional error handling
        method, allowing the caller to decide how to treat individual faults as
        they see fit.
      - updated the backend module code to take advantage of the new string
        match status identifiers in tryXmlRpcCmd()
      - completely revamped slice renewal code in mod_PLC backend
        - compare against real lease expiration data gathered direct from PLC
        We used to just infer from our originally requested lease length
        - warn when our notion of expiration doesn't match PLC's
      - added agent caching and lease expiration info caching to mod_PLC
  25. 23 Jun, 2004 1 commit
    • Leigh B. Stoller's avatar
      Switch to "dynamic" creation of certain virtual nodes (jail/pcvm and · 4d5620c2
      Leigh B. Stoller authored
      vserver/pcplab). Rather then 10000s of fixed node entries in the DB,
      create node entries on the fly as needed (assign_wrapper), and then
      delete them when they are no longer used (nfree). When new nodes check
      in, no longer create all those nodes table entries (utils/newnode.in
      and tbsetup/plab/libplab.py.in).
      I've added a new library: db/Node.pm which is something I started a
      while back, and decided to commit, along with the support for creating
      and deleting virtual nodes. CreateVnodes() creates a new set of nodes,
      choosing non-conflicting names in the DB, and then immediately
      reserves them to the pid/eid specified. DeleteVnodes takes a list of
      vnodes and deletes them from nodes,reserved,etc. This library does a
      few other things which I am going to be playing with, so you might
      want to go read the comment at the top of the file. Feel free to speak
      up. CreateVnodes() is from called assign_wrapper when a node type has
      the "isdynamic" property. Otherwise does the existing avail/nalloc
      stuff. DeleteVnodes() is called from nfree when the node type has the
      isdynamic property.
      I've added a script (sql/delvnodes.pl) to run after updating the DB
      and software. All free pcvm and pcplab virtual nodes are deleted from
      the DB; reserved ones will get deleted whenever their experiment ends.
      I've noted all of this in doc/UPDATING, including setting the
      isdynamic property on pcvm in the node_types table.
      I've left tbsetup/plab/libplab.py.in to create a single pcplab node
      for the management sliver (still called -20). We can worry about this
      All this for modelnet?
  26. 23 Apr, 2004 1 commit
  27. 19 Apr, 2004 1 commit
  28. 25 Mar, 2004 1 commit
    • Kirk Webb's avatar
      · b6da3a51
      Kirk Webb authored
      * Node.__copy() now uses rsync instead of weird 'dd' pipe
        - can do since sudo now works from square one after sliver instantiation
      * Made fixsudo and addgroup operations in emulabify() non-fatal
        - setup sometimes works even if they don't (esp. on dirty sliver)
      * option parser fixes
      * Shutup stupid warning messages from remote commands (tcgetattr, sudo lecture)
  29. 24 Mar, 2004 1 commit
    • Kirk Webb's avatar
      · 97a59692
      Kirk Webb authored
      * add "slicename" arg to Slice() constructor
        - so it can be specified manually
      * pushed up vnode setup wait time in plabmonitord to 16 minutes.
  30. 23 Mar, 2004 2 commits
    • Kirk Webb's avatar
      Couple of items: · ed848fd5
      Kirk Webb authored
      * Small fix to DBQueryFatal in libdb.py: () is a valid return value,
        don't fail on it(insert/replace); do fail if DBQuery returns None though.
      * Fix up libplab.py to not choke on new plab_slices column.
    • Kirk Webb's avatar
      Snapshot. · fd6d8cc9
      Kirk Webb authored
      * incompatible option handling and use removed from gen purpose libs
      * Global PLC mutex implemented, but currently disabled
      * plabmonitord parallelization cut in half (for now)
      I'm still very frustrated with option handling/passing.  Needs more thought,
      but the primary issue is that there really isn't a global variable space in
      python (global to file, yes, but not global to interpreter invocation).
      I've learned that __builtin__ might work for this, but it seems hacky..
  31. 19 Mar, 2004 1 commit