• Leigh B. Stoller's avatar
    Support for capturing the trace data that is stored in the pcal files · 4ce9c421
    Leigh B. Stoller authored
    into per-experiment databases on ops. Additional support for reconsituting
    those databases back into temporary databases on ops, for post processing.
    
    * This revision relies on the "snort" port (/usr/ports/security/snort)
      to read the pcap files and load them into a database. The schema is
      probably not ideal, but its better then nothing. See the file
      ops:/usr/local/share/examples/snort/create_mysql for the schema.
    
    * For simplicity, I have hooked into loghole, which already had all
      the code for downloading the trace data. I added some new methods to
      the XMLRPC server for loghole to use, to get the users DB password
      and the name of the per-experiment database. There is a new slot in
      the traces table that indicates that the trace should be snorted to
      its DB. In case you forgot, at the end of a run or when the instance
      is swapped out, loghole is run to download the trace data.
    
    * For reconsituting, there are lots of additions to opsdb_control and
      opsdb_control.proxy to create "temporary" databases and load them
      from a dump file that is stored in the archive. I've added a button
      to the Template Record page, inappropriately called "Analyze" since
      right now all it does is reconsitute the trace data into a DB on
      ops.
    
      Currently, the only indication of what has been done (the name of
      the DBs created on ops) is the log email that the user gets. A
      future project is tell the user this info in the web interface.
    
    * To turn on database capturing of trace data, do this in your NS
      file:
    
    	set link0 ...
    	$link0 trace
    	$link0 trace_snaplen 128
    	$link0 trace_db 1
    
       the increase in snaplen is optional, but a good idea if you want
       snort to undertand more then just ip headers.
    
    * Also some changes to the parser to allow plain experiments to take
      advantage of all this stuff. To simple get yourself a per-experiment
      DB, put this in your NS file:
    
    	tb-set-dpdb 1
    
      however, anytime you turn trace_db on for a link or lan, you
      automatically get a per-experiment DB.
    
    * To capture the trace data to the DB, you can run loghole by hand:
    
    	loghole sync -s
    
      the -s option turns on the "post-process" phase of loghole.
    4ce9c421
Name
Last commit
Last update
..
checkpass Loading commit data...
checkup Loading commit data...
ipassign Loading commit data...
labels Loading commit data...
ns2ir Loading commit data...
nseparse Loading commit data...
nsverify Loading commit data...
plab Loading commit data...
GNUmakefile.in Loading commit data...
README Loading commit data...
Template.pm.in Loading commit data...
archive_control.in Loading commit data...
assign_prepass.in Loading commit data...
assign_wrapper.in Loading commit data...
assign_wrapper2.in Loading commit data...
batch_daemon.in Loading commit data...
batchexp.in Loading commit data...
bwconfig.in Loading commit data...
checkports.in Loading commit data...
console_reset.in Loading commit data...
console_setup.in Loading commit data...
console_setup.proxy.in Loading commit data...
db2ns.in Loading commit data...
elabinelab.in Loading commit data...
endexp.in Loading commit data...
eventsys.proxy.in Loading commit data...
eventsys_control.in Loading commit data...
eventsys_start.in Loading commit data...
exitonwarn.pm Loading commit data...
exports_setup.in Loading commit data...
exports_setup.proxy.in Loading commit data...
fetchtar.proxy.in Loading commit data...
frisbeeimage.in Loading commit data...
frisbeelauncher.in Loading commit data...
gentopofile.in Loading commit data...
idleswap.in Loading commit data...
libArchive.pm.in Loading commit data...
libadminmfs.pm.in Loading commit data...
libaudit.pm.in Loading commit data...
libosload.pm.in Loading commit data...
libreboot.pm.in Loading commit data...
libtblog.pm.in Loading commit data...
libtblog_simple.pm Loading commit data...
libtbsetup.pm Loading commit data...
libtestbed.pm.in Loading commit data...
libtestbed.py.in Loading commit data...
mkexpdir.in Loading commit data...
mkgroup.in Loading commit data...
mkproj.in Loading commit data...
modgroups.in Loading commit data...
named_setup.in Loading commit data...
newnode_reboot.in Loading commit data...
nfstrace.in Loading commit data...
node_attributes.in Loading commit data...
node_control.in Loading commit data...
node_history.in Loading commit data...
node_reboot.in Loading commit data...
node_update.in Loading commit data...
nscheck.in Loading commit data...
nseswap.in Loading commit data...
os_load.in Loading commit data...
os_select.in Loading commit data...
os_setup.in Loading commit data...
panic.in Loading commit data...
plabinelab.in Loading commit data...
portstats.in Loading commit data...
power.in Loading commit data...
power_mail.pm.in Loading commit data...
power_rpc27.pm.in Loading commit data...
power_sgmote.pm.in Loading commit data...
power_whol.pm.in Loading commit data...
ptopgen.in Loading commit data...
reload_daemon.in Loading commit data...
repos_daemon.in Loading commit data...
resetvlans.in Loading commit data...
rmgroup.in Loading commit data...
rmproj.in Loading commit data...
rmuser.in Loading commit data...
routecalc.cc Loading commit data...
savelogs.in Loading commit data...
savelogs.proxy.in Loading commit data...
sched_reload.in Loading commit data...
sched_reserve.in Loading commit data...
setgroups.in Loading commit data...
sfskey_update.in Loading commit data...
sfskey_update.proxy.in Loading commit data...
smbpasswd_setup.in Loading commit data...
smbpasswd_setup.proxy.in Loading commit data...
snmpit.in Loading commit data...
snmpit.proxy.in Loading commit data...
snmpit.proxynew.in Loading commit data...
snmpit_apc.pm Loading commit data...
snmpit_cisco.pm Loading commit data...
snmpit_cisco_stack.pm Loading commit data...
snmpit_foundry.pm Loading commit data...
snmpit_intel.pm Loading commit data...
snmpit_intel_stack.pm Loading commit data...
snmpit_lib.pm Loading commit data...
snmpit_nortel.pm Loading commit data...
snmpit_remote.pm.in Loading commit data...
snmpit_stack.pm Loading commit data...
spewlogfile.in Loading commit data...
spewrpmtar.in Loading commit data...
staticroutes.in Loading commit data...
swapexp.in Loading commit data...
switchmac.in Loading commit data...
tarfiles_setup.in Loading commit data...
tbend.in Loading commit data...
tbprerun.in Loading commit data...
tbreport.in Loading commit data...
tbrestart.in Loading commit data...
tbrsync.in Loading commit data...
tbswap.in Loading commit data...
template_analyze.in Loading commit data...
template_commit.in Loading commit data...
template_control.in Loading commit data...
template_create.in Loading commit data...
template_delete.in Loading commit data...
template_export.in Loading commit data...
template_exprun.in Loading commit data...
template_graph.in Loading commit data...
template_instantiate.in Loading commit data...
template_metadata.in Loading commit data...
template_swapin.in Loading commit data...
template_swapout.in Loading commit data...
vnode_setup.in Loading commit data...
wanassign.in Loading commit data...
wanlinkinfo.in Loading commit data...
wanlinksolve.cc Loading commit data...
webarchive_control.in Loading commit data...
webbatchexp.in Loading commit data...
webdelay_config.in Loading commit data...
webendexp.in Loading commit data...
webeventsys_control.in Loading commit data...
webfrisbeekiller.in Loading commit data...
webidleswap.in Loading commit data...
webmkgroup.in Loading commit data...
webmkproj.in Loading commit data...
webmodgroups.in Loading commit data...
webnodeattributes.in Loading commit data...
webnodecontrol.in Loading commit data...
webnodehistory.in Loading commit data...
webnodereboot.in Loading commit data...
webnodeupdate.in Loading commit data...
webnscheck.in Loading commit data...
webpanic.in Loading commit data...
webreport.in Loading commit data...
webrmgroup.in Loading commit data...
webrmuser.in Loading commit data...
websetgroups.in Loading commit data...
webswapexp.in Loading commit data...
webtarfiles_setup.in Loading commit data...
webtemplate_analyze.in Loading commit data...
webtemplate_commit.in Loading commit data...
webtemplate_control.in Loading commit data...
webtemplate_create.in Loading commit data...
webtemplate_export.in Loading commit data...
webtemplate_exprun.in Loading commit data...
webtemplate_graph.in Loading commit data...
webtemplate_metadata.in Loading commit data...
webtemplate_swapin.in Loading commit data...
webtemplate_swapout.in Loading commit data...