Skip to content
GitLab
Projects
Groups
Snippets
Help
Loading...
Help
What's new
10
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Open sidebar
Robert Ricci
Evaluating Networked Systems
Commits
92551bb6
Commit
92551bb6
authored
Jan 08, 2014
by
Robert Ricci
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
Italics, not underline
parent
cfda6060
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
11 additions
and
11 deletions
+11
-11
lectures/lecture2/lecturenotes.tex
lectures/lecture2/lecturenotes.tex
+11
-11
No files found.
lectures/lecture2/lecturenotes.tex
View file @
92551bb6
...
...
@@ -31,14 +31,14 @@
\2
Start with two questions:
\3
What is the problem I'm solving?
\3
How will I know if I solved it?
\3
\
emph
{
Students: answer this question for your own work
}
\3
\
textit
{
Students: answer this question for your own work
}
\1
\
emph
{
First things to select?
}
\1
\
textit
{
First things to select?
}
\2
Right measures of performance
\2
Right measurement environments
\2
Right techniques
\1
\
emph
{
What kinds of problems are there to solve?
}
\1
\
textit
{
What kinds of problems are there to solve?
}
\2
Performance tuning (parameter optimization)
\2
Bottleneck identification
\2
Workload characterization
...
...
@@ -47,22 +47,22 @@
\1
Goals of the book (subset of course goals) - select appropriate:
\2
Evaluation techniques
\3
\
emph
{
Measurement
}
(real system, emulation)
\3
\
emph
{
Simulation
}
(eg. NS2, NS3, purpose-built simulators)
\3
\
emph
{
Analytic modeling
}
\3
\
textit
{
Measurement
}
(real system, emulation)
\3
\
textit
{
Simulation
}
(eg. NS2, NS3, purpose-built simulators)
\3
\
textit
{
Analytic modeling
}
\2
Performance metrics
\3
\
emph
{
Examples
}
(tput, latency (response time), simultaneous connections)
\3
\
emph
{
Examples of non-performance metrics
}
(security, simplicity, ease of use)
\3
\
textit
{
Examples
}
(tput, latency (response time), simultaneous connections)
\3
\
textit
{
Examples of non-performance metrics
}
(security, simplicity, ease of use)
\2
Workloads
\2
I would add: criteria for ``success''---too often, not defined well in papers
\2
Proper statistic techniques
\3
Not just eyeballing graphs
\3
\
emph
{
How do you know when you've run enough experiments?
}
\3
\
textit
{
How do you know when you've run enough experiments?
}
\2
Design experiments to give the most information with the least effort
\1
Go through example 1.7 from book
\2
\
emph
{
How do you compare them
}
\2
\
emph
{
Convince me each system is better
}
\2
\
textit
{
How do you compare them
}
\2
\
textit
{
Convince me each system is better
}
\1
+ Methodical approach to evaluation
\2
Always know how you got to where you are
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment