Commit 80c38ae52809962173d3c635ced9249ba0c9110b

Authored by Anudipa Maiti
2 parents c9307b5e 61fa30d3

minor edits

figures/tables/tableALL.tex
... ... @@ -142,7 +142,7 @@
142 142  
143 143 \caption{\small \textbf{Evaluating Components of a Value Measure.}
144 144 \PhoneLab{} data is used to weight overall app energy usage in a variety of
145   -different ways. Ommitted results are caused by Android reporting energy
  145 +different ways. Omitted results are caused by Android reporting energy
146 146 consumption for non-apps such as the Android System.}
147 147  
148 148 \label{table-results}
... ...
introduction.tex
... ... @@ -64,13 +64,12 @@ smartphones~\cite{jdpowerbatterylife-url}, we believe this effort is
64 64 worthwhile.
65 65  
66 66 In this paper we motivate the idea of a value measure and describe an early
67   -failure at developing one based on measuring content delivery. We begin in
68   -Section~\ref{sec-usage} by describing how useful such a measure would be and
69   -the results of being able to answer questions like those posed above, as well
70   -as formulating design requirements for the value measure itself.
71   -Section~\ref{sec-measure} presents an overview of possible inputs into such a
72   -measure and discussion of how each could be measured and how useful it might
73   -be. In Section~\ref{sec-results} we present at formulating a value measure
74   -based on content delivered through the video display and audio output---an
75   -attempt that we consider a failure based on the result of a user survey, but
76   -one that we hope sheds light on how difficult this challenge may be.
  67 +failure at developing one. We begin in Section~\ref{sec-usage} by describing
  68 +how useful such a measure would be while also formulating design requirements
  69 +for the value measure itself. Section~\ref{sec-measure} presents an overview
  70 +of possible inputs into such a measure and discussion of how each could be
  71 +measured and how useful it might be. In Section~\ref{sec-results} we present
  72 +at formulating a value measure based on content delivered through the video
  73 +display and audio output---an attempt that we consider a failure based on the
  74 +result of a user survey, but a failure that we hope sheds some light on this
  75 +difficult challenge.
... ...
metric.tex
... ... @@ -26,7 +26,7 @@ foreground information---such as a pedometer app.
26 26  
27 27 Patterns of interaction may also be useful to observe, and inputs such as
28 28 keystrokes and touchscreen events are simple to track. However, there is more
29   -obvious differentation between app interaction patterns between
  29 +obvious differentiation between app interaction patterns between
30 30 categories---users deliver far more keystrokes to a chat client than to a
31 31 video player---so it is clear that interaction statistics will have to be
32 32 used in conjunction with complementary value measure components that offset
... ...
results.tex
... ... @@ -112,7 +112,7 @@ redraws.
112 112 \centering
113 113 \includegraphics[width=\textwidth]{./figures/survey.pdf}
114 114  
115   -\caption{\textbf{Participant responses to energy inefficient app sugestions.} The height of each bar
  115 +\caption{\textbf{Participant responses to energy inefficient app suggestions.} The height of each bar
116 116 demonstrates how many of the suggested apps the user is willing to remove for better battery life. }
117 117  
118 118 \label{fig-survey}
... ... @@ -122,7 +122,7 @@ redraws.
122 122 To continue the evaluation of our simple content-based value measure, we
123 123 prepared a survey for the 107~\PhoneLab{} participants who contributed data
124 124 to our experiment. Our goal was to determine if users would be more willing
125   -to remove inefficienct apps, as defined using our content-based measure. As a
  125 +to remove inefficient apps, as defined using our content-based measure. As a
126 126 baseline, we also asked users about the apps that consumed the most energy.
127 127 We used each participants data to generate a custom survey containing
128 128 questions about 9 apps: the 3 least efficient apps as computed by our
... ...
usage.tex
... ... @@ -2,33 +2,17 @@
2 2 \label{sec-usage}
3 3  
4 4 To motivate the need for a value measure, we return to the questions posed in
5   -the introduction. We explore each in more depth, providing a more detailed
6   -description of how a value measure could be used. These use cases also help
7   -us develop requirements for our metric, which are summarized at the end of
8   -this section. We begin by exploring the basic question at the heart of the
9   -problem: what is the value delivered by an app?
  5 +the introduction and explore each in more depth. These use cases also help us
  6 +develop requirements for our measure, which are summarized at the end of this
  7 +section. We begin by exploring the basic question at the heart of the
  8 +problem: what is the value of an app?
10 9  
11   -\subsection{What is Value?}
12   -
13   -\begin{comment}
14   -
15   -\begin{quote}
16   -I shall not today attempt further to define the kinds of material I
17   -understand to be embraced within that shorthand description; and perhaps I
18   -could never succeed in intelligibly doing so. But I know it when I see it,
19   -and the motion picture involved in this case is not that.\\
20   ----Justice Potter Stewart~\cite{jacobellisvohio}.
21   -\end{quote}
22   -
23   -\end{comment}
  10 +\subsection{What is App Value?}
24 11  
25 12 All smartphone users intuitively realize that smartphone apps differ in
26 13 value---an email client, for example, is probably more valuable than a app
27   -that makes farting sounds, and a chat client is probably more valuable than a
28   -chat client that only sends the message ``yo''. In Supreme Court Justice
29   -Potter Steward's famous formulation, they know value when they see it. But is
30   -it possible to quantify these subjective distinctions and produce a value
31   -measure?
  14 +that makes farting sounds. But is it possible to quantify these subjective
  15 +distinctions and produce a value measure?
32 16  
33 17 To argue that this is possible we present two experiments that elucidate
34 18 smartphone app value in the form of both ordinal and cardinal utilities,
... ... @@ -36,12 +20,12 @@ respectively:
36 20 %
37 21 \begin{enumerate}
38 22  
39   -\item An advisory will require you to remove some number of apps from your
  23 +\item An adversary will require you to remove some number of apps from your
40 24 smartphone. Order the apps you are currently using from least important to
41 25 most important. The N least important apps will be removed.
42 26  
43 27 \item Your smartphone will require you to create an energy budget for the
44   -apps you use. During any discharging cycle, once an app runs out of energy quota
  28 +apps you use. During any discharging cycle, once an app runs out of energy
45 29 you will not be able to use it until you plug in your smartphone. Allocate
46 30 battery percentages to each app you use.
47 31  
... ... @@ -49,19 +33,15 @@ battery percentages to each app you use.
49 33 %
50 34 We plan to engage smartphone users in studies to explore in more detail which
51 35 of these approaches is more effective, comparing them by comparing users'
52   -levels of satisfaction under each scenario. As an alternate formulation of
53   -the second experiment to make it more similar to the first, the adversary
54   -could remove the apps consuming the least energy up to a given target.
55   -
56   -For our value measure we are hopeful that users will prove capable of
57   -assigning cardinal utilities to apps---as in the second experiment---since
58   -this matches most directly with our proposed value measure and could provide
59   -ground truth for a value measure computed automatically. The second
60   -experiment also engages users directly in the task of allocating energy,
61   -which is one way that a value measure could be used. However, if ordinal
62   -utilities prove more intuitive we can still compare the ordering generated by
63   -our value metric with the ordering generated by users, although the specific
64   -values of the measure will still require justification.
  36 +levels of satisfaction under each scenario. For our value measure we are
  37 +hopeful that users will prove capable of assigning cardinal utilities to
  38 +apps---as in the second experiment---since this matches most directly with
  39 +our proposed value measure and could provide ground truth for a value measure
  40 +computed automatically. The second experiment also engages users directly in
  41 +the task of allocating energy, which is one way that a value measure could be
  42 +used. However, if ordinal utilities prove more intuitive we can still compare
  43 +the ordering generated by our measure with the ordering generated by users,
  44 +although the values of the measure will still require justification.
65 45  
66 46 In either case, we believe that these experiments do suggest the existence of
67 47 quantifiable value for smartphone apps. We are not claiming, however, that
... ... @@ -85,20 +65,19 @@ The most powerful use of a value measure would be to compare apps by
85 65 comparing their energy efficiency, therefore overcoming the most critical
86 66 flaw in current attempts to compare or categorize apps by their energy
87 67 consumption alone~\cite{carat-sensys13}. Consider attempting to compare a
88   -chat client and video-conferencing app by only measuring their energy
  68 +chat client and videoconferencing app by only measuring their energy
89 69 consumption. Unless it is terribly written, the chat client will consume less
90 70 energy. But this does not mean that it is efficient, or that the
91   -video-conferencing app is not. Ultimately, all the energy consumption
  71 +videoconferencing app is not. Ultimately, all the energy consumption
92 72 comparison truly reveals is that the two apps do different things---which we
93   -knew.
  73 +already knew.
94 74  
95 75 Using energy consumption alone even makes apples-to-apples comparison of the same app
96 76 difficult. Given an app that consumes twice as much energy on Alice's
97 77 smartphone than on Bob's, the question of why is left unanswered by pure
98 78 energy measures. Even if usage time can be used to normalize the comparison
99 79 to the power consumed, power consumption alone cannot incorporate differences
100   -due to the different app features used by Alice and Bob or the different ways
101   -that they have configured the app.
  80 +due to the different app features or configurations used by Alice and Bob.
102 81  
103 82 By computing value and, thus, energy efficiency, we can overcome these
104 83 weaknesses. A value measure should allow us to compare the efficiency of two
... ... @@ -108,10 +87,10 @@ video players. Comparisons within the same app category should allow users to
108 87 select the most efficient email client or web browser. Aggregating results
109 88 over all users, differences in app energy efficiency should reflect how well
110 89 the app is written and how well it predicts and adapts to users, not just
111   -differences in the core features it provides. And when comparing two users
112   -using the same app, differences in energy efficiency should reflect different
  90 +differences in the core features it provides. When comparing two users using
  91 +the same app, differences in efficiency should reflect different
113 92 configurations or differences in how efficiently the app provides certain
114   -features, not just that one user is using one feature and another is not.
  93 +features.
115 94  
116 95 \subsection{Evaluating App Changes}
117 96  
... ... @@ -132,7 +111,7 @@ defer work on everything else.
132 111 A measure of app value makes it possible to produce a rigorous definition of
133 112 the term \textit{energy virus}: an app that produces little to no value per
134 113 joule. The choice of threshold will require some study, as it is unlikely
135   -impossible to produce a single efficiency cut-off that cleanly separates
  114 +impossible to produce a single efficiency cutoff that cleanly separates
136 115 malicious apps from ones that are merely poorly-written. Note also that this
137 116 definition of energy virus can be made on a per-user basis. This is important
138 117 since a non-malicious but poorly-written app that continues to consume energy
... ... @@ -150,9 +129,9 @@ allocates a rate to each app and enforces that rate by slowing or stopping
150 129 the app when it exceeds its
151 130 allocation~\cite{odyssey-osr99,cinder-eurosys11,Zeng:2003,pixie-sensys08}.
152 131 However, all of these previous efforts have ignored the critical question of
153   -\textbf{how rates should be set}. No matter how effective the enforcement
154   -mechanisms are, systems that rely on rates will fail if they provide the same
155   -rate to Skype and Snapchat, or to a very efficient app and an energy virus.
  132 +how rates should be set. No matter how effective the enforcement mechanisms
  133 +are, systems that rely on rates will fail if they provide the same rate to
  134 +Skype and Snapchat, or to a very efficient app and an energy virus.
156 135  
157 136 A measure of value can be used alone or in conjunction with energy consumption
158 137 to help prioritize limited energy resources. The simplest approach is to
... ... @@ -186,10 +165,8 @@ inputs, requiring that it be calculable given data from a single user.
186 165 app generate value and what parts do not.
187 166  
188 167 \item It should be able to be efficiently computed to not overly consume the
189   -very resource that it is designed to help manage.
  168 +resources that it is designed to help manage.
190 169  
191 170 \item It should be derived with little to no input from the user.
192 171  
193 172 \end{itemize}
194   -%
195   -We continue by discussing possible inputs to such a metric.
... ...