1. 23 May, 2007 1 commit
    • Leigh Stoller's avatar
      First cut at template checkout and commit from a checkout. The interface · b674bc7b
      Leigh Stoller authored
      described is the one exported to ops via the XMLRPC interface. This is
      just playing aroundl no doubt this stuff is going to change.
      
      * template_checkout guid/vers
      
        Checkout a copy of the template to the current working directory.
      
      * template_commit
      
        Modify the previous template checkout, using the nsfile contained in
        the tbdata directory (subdir of the current directory). In other words,
        the current template is modified, creating a new template in the
        current working directory (the current directory refers to the new
        template).
      
        The datastore subdir is imported into the new template, but that is
        the only directory that is imported at present. Might change that.
      
      So this sounds much cooler then it really is. Why?
      
      * This only works from ops.
      
      * The "current directory" must be one of the standard approved directories
        (/proj, /users, /groups).
      
      * Cause, boss reads and writes that directory via NFS, as told to it
        by the xmlrpc client.
      
      At some point in the future it would be nice to support something
      fancier, using a custom transport, but lets see how this goes.
      b674bc7b
  2. 17 May, 2007 1 commit
  3. 15 May, 2007 2 commits
    • Leigh Stoller's avatar
      Symlink trick to deal with the fact that we switched to archiving the · d4bcc494
      Leigh Stoller authored
      entire experiment directory, which now that we zip files, was putting
      thinks in the wrong place.
      d4bcc494
    • Leigh Stoller's avatar
      Checkpoint changes that have been discussed in the last few weeks: · c4f53202
      Leigh Stoller authored
      * Records are now "help open" when a run is stopped. When the next run
        is started, a check is made to see if the files
        (/project/$pid/exp/$eid) have changed, and if so a new version of the
        archive is committed before the next run is started.
      
      * Change the way swapmod is handled within an instance. A new option
        on the ShowExp page called Modify Resources. The intent is to allow
        an instance to be modified without having to start and stop runs,
        which tends to clutter things up, according to our user base. So, if
        you are within a run, that run is reset (reused) after the swapmod is
        finished. You can do this as many times as you like. If you are
        between runs (last operation was a stoprun), do the swapmod and then
        "speculatively" start a new run. Subsequent modifies reuse the that
        run again, as above.
      
        I think this is what Kevin was after ... there are some UI issues
        that may need to be resolved, will wait to hear what people have to
        say.
      
      * Revising a record is now supported. Export, change in place, and
        then use the Revise link on the ShowRun page. Currently this has to
        happen from the export directory on ops, but eventually allow an
        upload (to correspond to downloaded exports)
      
      * Check to see if export already exists, and give warning. Added a
        checkbox that allows user to overwrite the export.
      
      * A bunch of minor UI changes to the various template pages.
      c4f53202
  4. 07 May, 2007 1 commit
    • Leigh Stoller's avatar
      Mostly this commit is the switch from SVN archives to ZIP archives. · 55d1bb6e
      Leigh Stoller authored
      Other stuff leaked in too ...
      
      I did separate out a lot of tbsetup/libArchive into db/Archive, and
      whats left in libArchive.pm will eventually move over into the
      Template library.
      
      Note that I have dropped archiving of plain experiments; this is not
      really owrth it outside the workbench context, and it just wastes
      space and makes a lot if stuff painful in the web interface.
      55d1bb6e
  5. 10 Apr, 2007 1 commit
    • Kevin Atkinson's avatar
      · 858319bd
      Kevin Atkinson authored
      Add needed method Template::gid_idx.
      858319bd
  6. 09 Apr, 2007 1 commit
  7. 07 Mar, 2007 1 commit
  8. 06 Mar, 2007 1 commit
  9. 21 Feb, 2007 1 commit
  10. 20 Feb, 2007 2 commits
  11. 16 Feb, 2007 1 commit
  12. 14 Feb, 2007 3 commits
  13. 22 Jan, 2007 1 commit
  14. 09 Jan, 2007 1 commit
  15. 05 Jan, 2007 1 commit
    • Kevin Atkinson's avatar
      · 43eac695
      Kevin Atkinson authored
      Location of datastore is not "exp/datastore" not "datastore"
      in exparchive.  Update Template::Instance::CopyDataStore to reflect this.
      43eac695
  16. 08 Dec, 2006 1 commit
    • Leigh Stoller's avatar
      As discussed in meetings and email ... this commit changes what is · b898a8cc
      Leigh Stoller authored
      archived.  Rather then a special "archive" directory in the experiment
      directory, we know archive the entire experiment directory.
      
      This change should be backwards compatable, but let me know if not.
      
      Note that the nsdata directory is gone; the nsfile comes from the
      tbdata, but I know place a copy in nsfile.ns so that the name is well
      known.
      b898a8cc
  17. 09 Nov, 2006 1 commit
  18. 06 Nov, 2006 1 commit
  19. 03 Nov, 2006 1 commit
  20. 20 Oct, 2006 1 commit
    • Leigh Stoller's avatar
      Add compression option to sync option of loghole. When turned on, any file · 4d4a27e1
      Leigh Stoller authored
      greater the 512K is automatically compressed with gzip. Might need to
      make this number bigger; we shall see.
      
      If you run emacs, put this in your .emacs file.
      
      	(load "jka-compr")
      	(jka-compr-install)
      
      and any time you visit a file that ends in one of the standard compression
      extensions, emacs will automatically do the uncompress for you on the data
      in the buffer (not the actual disk file of course). Very convenient.
      
      You can also get your browser to do the same, but I leave that as an
      exercise for the reader.
      4d4a27e1
  21. 18 Oct, 2006 1 commit
  22. 13 Oct, 2006 1 commit
  23. 12 Oct, 2006 1 commit
    • Leigh Stoller's avatar
      By popular demand, give user a choice of where to get the next set of · bb996961
      Leigh Stoller authored
      (initial) parameters for a new run. Three choices right now; from the
      template itself, from the instance, or from the previous run. On the
      web interface this is presented as three buttons. On ops, it is the
      the -y option, which takes one of template,instance,lastrun as its
      argument (you can of course combine the -y option with an XML file to
      override specific params).
      
      At present, there is no default. Lets give it a chance to sink in
      before I pick something that will annoy 50% of the people 75% of the
      time.
      bb996961
  24. 09 Oct, 2006 2 commits
  25. 08 Oct, 2006 3 commits
  26. 05 Oct, 2006 1 commit
    • Leigh Stoller's avatar
      More work on "recording" template events. · e9607a77
      Leigh Stoller authored
      * New version of template_record just for ops, since so much is
        different about ops, not bothering to maintain a single version.
      
      * Various fixes to how the recorded events are stored and reconstituted.
        The big fix is to wrap them in a sequence to that they get fired
        properly (waiting for completion of previous event in recording).
      
      * New buttons to Pause and Continue event time, which is used when
        adding recorded events. This allows users to pause time while they
        "think" so when an event is recorded, the thinking time is not actually
        in the timeline. Eventually hope to figure this out automatically, but
        that will take some real, uh, thinking.
      
      * Add a new event editor (linked off the template page) that allows
        you to delete and change the recordings. Note that you can only edit
        the events at the template level; you cannot edit the events of an
        instance (swapped in experiment), and you can only edit the recorded
        events, not any other events. Not sure its useful to be able to do
        either of these yet, but probably not too hard to add at some point.
      e9607a77
  27. 03 Oct, 2006 1 commit
    • Leigh Stoller's avatar
      Two small changes. · 89c9208b
      Leigh Stoller authored
      * Copy template datastore to instance "datastore" directory, instead of
        "template_datastore" ... avoid mass confusion.
      
      * Change xxx:// mappping from template datastore to the instance datastore.
      89c9208b
  28. 29 Sep, 2006 2 commits
  29. 27 Sep, 2006 1 commit
  30. 26 Sep, 2006 3 commits
    • Leigh Stoller's avatar
      4b6d1df5
    • Leigh Stoller's avatar
      Fix minor typo. · b98aa4ec
      Leigh Stoller authored
      b98aa4ec
    • Leigh Stoller's avatar
      * A bit more support for swapmod from Start Run. Mostly bookkeeping · a8631011
      Leigh Stoller authored
        info so we have a record of it.
      
      * First attempt at dealing with nodes that do not respond to the
        synchronous events that are sent from start and stop run. Rather
        then failing, attempt to figure out which nodes are actually dead,
        and save some state in the DB associated with the run. The current
        method for figuring out which nodes are dead is the node_status
        table, since the event scheduler is the only thing that knows what
        nodes did not respond. Will probably revisit this very soon.
      
      * Bug fixes of course.
      
      * Start implementing a Run object so replace some of the code in the
        Instance object.
      a8631011