Commit a4859d19 authored by Robert Ricci's avatar Robert Ricci

Merge branch 's15'

parents 9aec555a 92f7575a
SUBDIRS=syllabus schedule assignments lectures SUBDIRS=syllabus schedule assignments lectures handouts
include Makerules include Makerules
......
DOCUMENTS=final-report-format
include ../../Makerules
\documentclass{article}[10pt]
\input{../../texstuff/fonts.sty}
\usepackage[margin=1.25in]{geometry}
\usepackage{url}
\newcommand{\mytitle}{
\begin{center}%
\LARGE\titlefont%
\title
\end{center}
\vspace{0.75in}
}
\renewcommand{\title}{CS 6963 Final Project---Final Report Format}
\begin{document}
\mytitle
Your report should be thorough, and reflect the level of effort you put into
the project.
While length is not directly a criterion, it will likely require
several pages will be required to adequately cover everything.
Reports should be carefully edited and nicely formatted.
Produce a document you can be proud of.
Your report must contain the following elements:
\begin{enumerate}
\item \textbf{Paper:} State the title of the paper, authors, where and
when it appeared. If possible, provide a link to the conference
proceedings, journal or digital library (ACM DL, IEEE Xplore, ArXiv,
etc.) where the paper appeared.
\item \textbf{Introduction:} Provide a 1--2 paragraph summary, in your
own words, of the paper.
\item \textbf{Goals:} Concretely, what are the major problems that the
original paper is trying to solve? What are its major claims?
\item \textbf{Results achieved by original authors:} What are the key
results that the original authors achieved in service of their goals
and support of their claims?
\item \textbf{Reproduction goal:} Which figure(s) or other results from the
original paper did you attempt to reproduce? Include the figure,
table, etc.
\item \textbf{Reproduction motivation:} Why did you choose to target
these specific results to reproduce?
\item \textbf{Reproduction results:} Present the results of your
reproduction study, including your versions of any charts, graphs, etc.
Do your results match those of the original paper? If not, is there an
explanation for the difference, and do your results still support
the original paper's claims?
\item \textbf{Extensions to the original results:} What improvements
did you make to the original experiments, or what additional
experiments did you run? What was the scientific goal of these
extensions? Do they help to support or refute the claims of the
original paper, or do they help shed light on an issue that was
not originally identified as a goal?
\item \textbf{Challenges:} What challenges did you encounter in attempting
to reproduce the results of the original paper, and what did you have
to do in order to overcome them?
\item \textbf{Critique:} Provide a high-level analysis of the main thesis
that you explored-–-does it hold up, does it depend on assumptions not
stated in the original paper?
\item \textbf{CloudLab profile:} Provide a link to the profile you made on
CloudLab to help others run the same experiments.
\end{enumerate}
You can find good examples of reports here: \url{https://reproducingnetworkresearch.wordpress.com/}
\end{document}
Final Project Score:
XX / 10 : Paper summary - summary of the paper, results acheived by the original
authors, etc.
XX / 15 : Reproduction - description of motivation, goals, results obtained,
extension to the original results
XX / 10 : Challenges and critique - critical discussion of challenges faced,
and analysis of whether the orginal result holds up
XX / 15 : Reproducability - is it possible, given the profile, instructions,
and other materials checked in, to reproduce your experiments
======
Total score: XX / YY
...@@ -26,8 +26,8 @@ ...@@ -26,8 +26,8 @@
} }
\renewcommand{\title}{CS 6963 Homework \#1} \renewcommand{\title}{CS 6963 Homework \#1}
\newcommand{\assigned}{January 07} \newcommand{\assigned}{January 13}
\newcommand{\due}{January 09 2:00 PM} \newcommand{\due}{January 15 midnight}
\newcommand{\turnin}{branch \texttt{hw1-submit} -- file \texttt{submit.pdf}} \newcommand{\turnin}{branch \texttt{hw1-submit} -- file \texttt{submit.pdf}}
\begin{document} \begin{document}
...@@ -55,7 +55,7 @@ git config --global user.email "YOUR EMAIL" ...@@ -55,7 +55,7 @@ git config --global user.email "YOUR EMAIL"
\item Make a repository for this assignment \item Make a repository for this assignment
\begin{enumerate} \begin{enumerate}
\item Fork the assignment repository: \url{http://gitlab.flux.utah.edu/cs6963-s14/cs6963-hw1} \item Fork the assignment repository: \url{http://gitlab.flux.utah.edu/cs6963-s15/cs6963-hw1}
\item On your local machine, clone your fork with \texttt{`git clone \ldots'} \item On your local machine, clone your fork with \texttt{`git clone \ldots'}
\end{enumerate} \end{enumerate}
...@@ -75,7 +75,7 @@ git push ...@@ -75,7 +75,7 @@ git push
\item Add your grading repository as a remote (replacing \item Add your grading repository as a remote (replacing
\texttt{USERNAME} with your GitLab username): \texttt{USERNAME} with your GitLab username):
\begin{verbatim} \begin{verbatim}
git remote add grading git@gitlab.flux.utah.edu:cs6963-s14-grading/USERNAME.git git remote add grading git@gitlab.flux.utah.edu:cs6963-s15-grading/USERNAME.git
\end{verbatim} \end{verbatim}
\item Push your master branch to the grading repository with \item Push your master branch to the grading repository with
the name \texttt{hw1-submit} to complete the submission: the name \texttt{hw1-submit} to complete the submission:
......
\documentclass{article}[10pt] \documentclass{article}[10pt]
\usepackage[no-math]{fontspec} \input{../../texstuff/fonts.sty}
\usepackage{sectsty} \usepackage{sectsty}
\usepackage{paralist} \usepackage{paralist}
\usepackage{ragged2e} \usepackage{ragged2e}
...@@ -11,11 +11,6 @@ ...@@ -11,11 +11,6 @@
\newcommand*{\git}{\texttt{git}} \newcommand*{\git}{\texttt{git}}
\setmainfont[Numbers=OldStyle,Ligatures=TeX]{Equity Text A}
\setmonofont{Inconsolata}
\newfontfamily\titlefont[Numbers=OldStyle,Ligatures=TeX]{Equity Caps A}
\allsectionsfont{\titlefont}
\newcommand{\mytitle}{ \newcommand{\mytitle}{
\begin{center}% \begin{center}%
\LARGE\titlefont% \LARGE\titlefont%
...@@ -24,15 +19,15 @@ ...@@ -24,15 +19,15 @@
\vspace{5pt} \vspace{5pt}
\begin{center}% \begin{center}%
\large \large
{\titlefont Assigned:} \assigned \hspace{2em} {\titlefont Due:} \due~2:00 PM \\[3pt] {\titlefont Assigned:} \assigned \hspace{2em} {\titlefont Due:} \due~5:00 PM \\[3pt]
{\titlefont Submission:} \turnin {\titlefont Submission:} \turnin
\end{center} \end{center}
\vspace{3pt} \vspace{3pt}
} }
\renewcommand{\title}{CS 6963 Homework \#2} \renewcommand{\title}{CS 6963 Homework \#2}
\newcommand{\assigned}{January 09} \newcommand{\assigned}{January 15}
\newcommand{\due}{January 16} \newcommand{\due}{January 23}
\newcommand{\turnin}{branch \texttt{hw2-submit} -- file \texttt{submit.pdf}} \newcommand{\turnin}{branch \texttt{hw2-submit} -- file \texttt{submit.pdf}}
\begin{document} \begin{document}
......
...@@ -3,14 +3,14 @@ HW #2 Score: ...@@ -3,14 +3,14 @@ HW #2 Score:
XX / 3 : Question 1 XX / 3 : Question 1
One point for each table One point for each table
One point for explaning the "trick" One point for explaining the "trick"
XX / 7 : Question 2 XX / 7 : Question 2
One point for project description, including an evaluatable goal One point for project description, including an evaluatable goal
One point for comprehesnive list of services, including outcomes One point for comprehensive list of services, including outcomes
One point for comprehensive list of metrics; must be measurable One point for comprehensive list of metrics; must be measurable
One point list of system paramters and workload parameters One point list of system parameters and workload parameters
One point for comprehensive list of factors and their ranges One point for comprehensive list of factors and their ranges
One point for choice of evaluation technique One point for choice of evaluation technique
One point for description of workload One point for description of workload
......
\documentclass{article}[10pt] \documentclass{article}[10pt]
\usepackage[no-math]{fontspec} \input{../../texstuff/fonts.sty}
\usepackage{sectsty} \usepackage{sectsty}
\usepackage{paralist} \usepackage{paralist}
\usepackage{ragged2e} \usepackage{ragged2e}
...@@ -9,13 +9,6 @@ ...@@ -9,13 +9,6 @@
\usepackage{url} \usepackage{url}
\usepackage[margin=1.25in]{geometry} \usepackage[margin=1.25in]{geometry}
\newcommand*{\git}{\texttt{git}}
\setmainfont[Numbers=OldStyle,Ligatures=TeX]{Equity Text A}
\setmonofont{Inconsolata}
\newfontfamily\titlefont[Numbers=OldStyle,Ligatures=TeX]{Equity Caps A}
\allsectionsfont{\titlefont}
\newcommand{\mytitle}{ \newcommand{\mytitle}{
\begin{center}% \begin{center}%
\LARGE\titlefont% \LARGE\titlefont%
...@@ -24,15 +17,15 @@ ...@@ -24,15 +17,15 @@
\vspace{5pt} \vspace{5pt}
\begin{center}% \begin{center}%
\large \large
{\titlefont Assigned:} \assigned \hspace{2em} {\titlefont Due:} \due~2:00 PM\\[3pt] {\titlefont Assigned:} \assigned \hspace{2em} {\titlefont Due:} \due~5:00 PM\\[3pt]
{\titlefont Submission:} \turnin {\titlefont Submission:} \turnin
\end{center} \end{center}
\vspace{3pt} \vspace{3pt}
} }
\renewcommand{\title}{CS 6963 Homework \#3} \renewcommand{\title}{CS 6963 Homework \#3}
\newcommand{\assigned}{January 16} \newcommand{\assigned}{January 22}
\newcommand{\due}{January 23} \newcommand{\due}{January 30}
\newcommand{\turnin}{branch \texttt{hw3-submit} -- file \texttt{submit.pdf}} \newcommand{\turnin}{branch \texttt{hw3-submit} -- file \texttt{submit.pdf}}
\begin{document} \begin{document}
...@@ -44,25 +37,33 @@ ...@@ -44,25 +37,33 @@
\item What metrics might you use to compare the following systems? Don't limit \item What metrics might you use to compare the following systems? Don't limit
yourself to the metrics discussed in the textbook, and you may consult any yourself to the metrics discussed in the textbook, and you may consult any
sources you wish to familiarize yourself with these systems. Your response sources you wish to familiarize yourself with these systems. Your response
should be clear about the types of higher-level questions the metrics would must state the types of higher-level questions the metrics would help you
help you to answer. to answer.
\begin{enumerate} \begin{enumerate}
\item Two routing protocols \item Two key-value storage systems
\item Two wireless MAC layers (eg. 802.11, E-UTRAN, etc.) \item Two database systems
\item Two block-level network storage systems (SANs) \item Two application-layer protocols for a game
\item Two network intrusion detection systems (NIDS) \item Two intrusion detection systems (IDSes)
\end{enumerate} \end{enumerate}
\item You are tasked with creating a synthetic workload to evaluate a proposed \item You are tasked with creating a synthetic workload to evaluate a proposed
improvement to a mobile wireless network (such as LTE/EPC). Your goal is improvement to a network. Your goal is to answer the question “how many
to answer the question “how many additional users could the network support additional users could the network support with \textit{change~X}, assuming
with \textit{change~X}, assuming that all other properties of the network that all other properties of the network remain the same?” Pretend that you
remain the same?” Pretend that you are allowed to ask the operators of the are allowed to ask the operators of the network for any data you wish about
network for any data you wish about the network's current workload the network's current workload (including both aggregate statistics and
(including both aggregate statistics and full traces). What data would you full traces). Answer the following questions (you do not need to actually
ask for, and what properties of the current workload would you study “design” the workload):
in order to begin designing your synthetic workload? State explicitly any
assumptions you make about the nature of \emph{change~X}. \begin{enumerate}
\item What data would you ask for?
\item What properties of the current workload would you study to begin
designing your synthetic workload?
\end{enumerate}
State explicitly any assumptions you make about the nature of the network
or of change \emph{change~X} (such as the type of network, what layer of
the network the change is at, etc.)
\end{enumerate} \end{enumerate}
......
HW #3 Score: HW #3 Score:
XX / 4 : Question 1 XX / 4 : Question 1
One point for part (a); examples include messages sent, convergence One point for part (a); examples include read and write throughput,
time, stretch, percentage of packets that end up in routing loops read and write latency, overhead spent on index structures, etc.
One point for part (b); examples include throughput, latency, loss rate, One point for part (b); examples include query throughput (for reads,
overhead due to headers or signaling, energy use, fairness inserts, and updates), query latency, and resource consumption
One point for part (c); examples include througput, IOPS, size, latency, (eg. CPU and RAM)
fairness, durability One point for part (c); examples include bandwidth consumed, latency (how
One point for part (d); examples include throughput, false positive rate, long do updates take to reach other clients), and accuracy (how
false negative rate inconsistent is state between clients)
One point for part (d); examples include true and false positive rate,
true and false negative rate, throughput
One half point may be deducted per part for failing to explain the types of One half point may be deducted per part for failing to explain the types of
questions the metric would help answer questions the metric would help answer
XX / 6 : Question 2 XX / 6 : Question 2
Two points for discussion of data to request; good examples include Two points for discussion of data to request; examples include traces
traces of connection/disconnection events, traces of calls, traces of packets or session, number of users over time, etc., and/or
of data sessions, traces of geographical locations, or aggregate aggregate statistics covering the above
statistics covering any of the properties listed below
Three points for discussion of properties to study; good examples include Three points for discussion of properties to study; good examples include
peak number of users, variations at different timescales (seconds, average and peak number of users, variations at different timescales
minutes, hours, days, weeks), distribution of users across access (seconds, minutes, hours, days, weeks), resources consumed per user,
points, data behavior including number of connections, rate of etc.
connections, amount of data transfered per connection
One point for stating assumptions about the change, or being One point for stating assumptions about the change, or being
sufficiently general that no assumptions seem to be needed sufficiently general that no assumptions seem to be needed
......
\documentclass{article}[10pt] \documentclass{article}[10pt]
\usepackage[no-math]{fontspec} \input{../../texstuff/fonts.sty}
\usepackage{sectsty} \usepackage{sectsty}
\usepackage{paralist} \usepackage{paralist}
\usepackage{ragged2e} \usepackage{ragged2e}
...@@ -9,13 +9,6 @@ ...@@ -9,13 +9,6 @@
\usepackage{url} \usepackage{url}
\usepackage[margin=1.25in]{geometry} \usepackage[margin=1.25in]{geometry}
\newcommand*{\git}{\texttt{git}}
\setmainfont[Numbers=OldStyle,Ligatures=TeX]{Equity Text A}
\setmonofont{Inconsolata}
\newfontfamily\titlefont[Numbers=OldStyle,Ligatures=TeX]{Equity Caps A}
\allsectionsfont{\titlefont}
\newcommand{\mytitle}{ \newcommand{\mytitle}{
\begin{center}% \begin{center}%
\LARGE\titlefont% \LARGE\titlefont%
...@@ -24,15 +17,15 @@ ...@@ -24,15 +17,15 @@
\vspace{5pt} \vspace{5pt}
\begin{center}% \begin{center}%
\large \large
{\titlefont Assigned:} \assigned \hspace{2em} {\titlefont Due:} \due~2:00 PM\\[3pt] {\titlefont Assigned:} \assigned \hspace{2em} {\titlefont Due:} \due~5:00 PM\\[3pt]
{\titlefont Submission:} \turnin {\titlefont Submission:} \turnin
\end{center} \end{center}
\vspace{3pt} \vspace{3pt}
} }
\renewcommand{\title}{CS 6963 Homework \#4} \renewcommand{\title}{CS 6963 Homework \#4}
\newcommand{\assigned}{January 23} \newcommand{\assigned}{January 29}
\newcommand{\due}{January 30} \newcommand{\due}{February 6}
\newcommand{\turnin}{branch \texttt{hw4-submit} -- file \texttt{submit.pdf}} \newcommand{\turnin}{branch \texttt{hw4-submit} -- file \texttt{submit.pdf}}
\begin{document} \begin{document}
......
\documentclass{article}[10pt] \documentclass{article}[10pt]
\usepackage[no-math]{fontspec} \input{../../texstuff/fonts.sty}
\usepackage{sectsty}
\usepackage{paralist} \usepackage{paralist}
\usepackage{ragged2e} \usepackage{ragged2e}
\usepackage{MnSymbol} \usepackage{MnSymbol}
...@@ -9,13 +8,6 @@ ...@@ -9,13 +8,6 @@
\usepackage{url} \usepackage{url}
\usepackage[margin=1.25in]{geometry} \usepackage[margin=1.25in]{geometry}
\newcommand*{\git}{\texttt{git}}
\setmainfont[Numbers=OldStyle,Ligatures=TeX]{Equity Text A}
\setmonofont{Inconsolata}
\newfontfamily\titlefont[Numbers=OldStyle,Ligatures=TeX]{Equity Caps A}
\allsectionsfont{\titlefont}
\newcommand{\mytitle}{ \newcommand{\mytitle}{
\begin{center}% \begin{center}%
\LARGE\titlefont% \LARGE\titlefont%
...@@ -31,8 +23,8 @@ ...@@ -31,8 +23,8 @@
} }
\renewcommand{\title}{CS 6963 Homework \#5} \renewcommand{\title}{CS 6963 Homework \#5}
\newcommand{\assigned}{January 30} \newcommand{\assigned}{February 12}
\newcommand{\due}{February 11} \newcommand{\due}{February 20}
\newcommand{\turnin}{branch \texttt{hw5-submit} -- file \texttt{submit.pdf}} \newcommand{\turnin}{branch \texttt{hw5-submit} -- file \texttt{submit.pdf}}
\begin{document} \begin{document}
...@@ -45,14 +37,11 @@ ...@@ -45,14 +37,11 @@
\item Do Exercise 12.7 from the textbook \item Do Exercise 12.7 from the textbook
\item Do Exercise 12.10 from the textbook
\item Do Exercise 12.11 from the textbook \item Do Exercise 12.11 from the textbook
\item Do Exercise 12.13 from the textbook \item Do Exercise 12.13 from the textbook
\item Do Exercise~13.2 from the textbook
\item Do Exercise 12.14 from the textbook \item Do Exercise~13.3 from the textbook (note: Table~11.2 can be found on
page~167)
\end{enumerate} \end{enumerate}
\end{document} \end{document}
HW #5 Score: HW #5 Score:
XX / 3 : Exercise 12.1 XX / 2 : Exercise 12.1
One half point for correct answer to each sub-question One third point for correct answer to each sub-question
XX / 2 : Exercise 12.7 XX / 2 : Exercise 12.7
One half point for correct answer to each sub-question One half point for correct answer to each sub-question
XX / 1 : Exercise 12.10
One point for picking correct index of central tendency; justification
required to get the point
XX / 1 : Exercise 12.11 XX / 1 : Exercise 12.11
One point for picking correct index of central tendency; justification One point for picking correct index of central tendency; justification
required to get the point required to get the point
...@@ -18,9 +14,13 @@ XX / 1 : Exercise 12.13 ...@@ -18,9 +14,13 @@ XX / 1 : Exercise 12.13
One point for picking correct index of dispersion; justification required One point for picking correct index of dispersion; justification required
to get the point to get the point
XX / 2 : Exercise 12.14 XX / 2 : Exercise 13.2
One point for correct index of dispersion and justification, one point for One third point for the correct answer to each of the first three
computing range, variance/stddev, 90 percentiles, SIQR (MAD not required) sub-questions, one half point for the correct answer to each of the
second two
XX / 2 : Exercise 13.3
One point for the correct answer to each sub-question
====== ======
Total score: XX / YY Total score: XX / YY
\documentclass{article}[10pt] \documentclass{article}[10pt]
\usepackage[no-math]{fontspec} \input{../../texstuff/fonts.sty}
\usepackage{sectsty}
\usepackage{paralist} \usepackage{paralist}
\usepackage{ragged2e} \usepackage{ragged2e}
\usepackage{MnSymbol} \usepackage{MnSymbol}
...@@ -9,13 +8,6 @@ ...@@ -9,13 +8,6 @@
\usepackage{url} \usepackage{url}
\usepackage[margin=1.25in]{geometry} \usepackage[margin=1.25in]{geometry}
\newcommand*{\git}{\texttt{git}}
\setmainfont[Numbers=OldStyle,Ligatures=TeX]{Equity Text A}
\setmonofont{Inconsolata}
\newfontfamily\titlefont[Numbers=OldStyle,Ligatures=TeX]{Equity Caps A}
\allsectionsfont{\titlefont}
\newcommand{\mytitle}{ \newcommand{\mytitle}{
\begin{center}% \begin{center}%
\LARGE\titlefont% \LARGE\titlefont%
...@@ -24,37 +16,44 @@ ...@@ -24,37 +16,44 @@