IEEE Power & Energy Magazine - May/June 2018 - 21

Tuesday

Wednesday

Thursday

Friday

Saturday

Sunday

1.0

1881

Demand (kWh)

Monday

0.5
0.0
0 6 12 18 24 0 6 12 18 24 0 6 12 18 24 0 6 12 18 24 0 6 12 18 24 0 6 12 18 24 0 6 12 18 24
Time of Day
Percentile

10

25

50

75

90

figure 3. The demand distribution of the least typical household out of the 500 smart meters included in the analysis.

Typical and Anomalous Households
to study the whole group of household demand distributions, we will first compute the differences in electricity consumption patterns between pairs of households. statistically
speaking, we call these differences distances. note that the
distance used here refers to the distance between two probability distributions rather than the physical distance between
two houses. one way to measure the distance between two
distributions is the Jensen-shannon divergence. We have 336
probability distributions per household, one for each half-hour
period of the week, so we have 336 Jensen-shannon distance
measures for each pair of households. We can measure the
overall distance between the distributions from two households by summing these 336 Jensen-shannon distance measures. in this way, we can find the distance between each pair
of households in the data set.
from these pairwise distances, we can compute a measure
of the typicality of a specific household by seeing how many
similar houses are nearby according to the Jensen-shannon divergence. if there are many households with similar
probability distributions, the typicality measure will be
high. But if there are few similar households, the typicality
measure will be low. this gives us a way to find anomalies in the data set, which are the smart meters corresponding to the least typical households. the most anomalous
(i.e., least typical) household is shown in figure 3. this is
may/june 2018

clearly a very strange demand distribution, with extremely
low demand almost all of the time, reflected by almost
overlapping percentiles.

Visualization via Embedding
the pairwise distances between households can also be used to
create a plot of all households together. if we compute 99 percentiles for 48 half hours per day and seven days a week, each
of the household distributions can be thought of as a vector
in K -dimensional space where K = 99 # 48 # 7 = 33, 264.
to easily visualize these, we need to project them onto a 2-D
space. there are several ways of doing this, such as principal component analysis (pca) and multidimensional scaling.
We have used a laplacian eigenmap method to keep the most
similar points in K-dimensional space as close as possible in
the 2-D space.
figure 4 shows a 2-D embedding of the 500 households in
this data set. the colors are taken from the measure of typicality, with the most typical 1% of points shown in red and the

Laplacian Embedding of Smart-Meter Distributions
2
Component 2

distribution) because the data set contains a large number of
zeros, making the distribution a mixture of discrete and continuous components. the high skewness of the data, and the
nonnegative nature of demand, makes it problematic to use
kernel density estimates.
there are several advantages to working with percentiles
rather than the data directly. problems with missing observations and the specific timing of household events (e.g.,
parties) are avoided, and attention is focused on the typical
behavior of a household throughout the week. although only
five percentiles are shown in figure 2, we actually compute
percentiles for probabilities 1, 2, ..., 99%.

0
4

−2

−4

5
3

2

1
−2

HDRs
50
1
99 >99
−1
0
Component 1

1

2

figure 4. A 2-D representation of the data from all 500
households. The most typical points are shown in red,
and the most unusual are shown in black. HDR: high
density region.
ieee power & energy magazine

21



Table of Contents for the Digital Edition of IEEE Power & Energy Magazine - May/June 2018

Contents
IEEE Power & Energy Magazine - May/June 2018 - Cover1
IEEE Power & Energy Magazine - May/June 2018 - Cover2
IEEE Power & Energy Magazine - May/June 2018 - Contents
IEEE Power & Energy Magazine - May/June 2018 - 2
IEEE Power & Energy Magazine - May/June 2018 - 3
IEEE Power & Energy Magazine - May/June 2018 - 4
IEEE Power & Energy Magazine - May/June 2018 - 5
IEEE Power & Energy Magazine - May/June 2018 - 6
IEEE Power & Energy Magazine - May/June 2018 - 7
IEEE Power & Energy Magazine - May/June 2018 - 8
IEEE Power & Energy Magazine - May/June 2018 - 9
IEEE Power & Energy Magazine - May/June 2018 - 10
IEEE Power & Energy Magazine - May/June 2018 - 11
IEEE Power & Energy Magazine - May/June 2018 - 12
IEEE Power & Energy Magazine - May/June 2018 - 13
IEEE Power & Energy Magazine - May/June 2018 - 14
IEEE Power & Energy Magazine - May/June 2018 - 15
IEEE Power & Energy Magazine - May/June 2018 - 16
IEEE Power & Energy Magazine - May/June 2018 - 17
IEEE Power & Energy Magazine - May/June 2018 - 18
IEEE Power & Energy Magazine - May/June 2018 - 19
IEEE Power & Energy Magazine - May/June 2018 - 20
IEEE Power & Energy Magazine - May/June 2018 - 21
IEEE Power & Energy Magazine - May/June 2018 - 22
IEEE Power & Energy Magazine - May/June 2018 - 23
IEEE Power & Energy Magazine - May/June 2018 - 24
IEEE Power & Energy Magazine - May/June 2018 - 25
IEEE Power & Energy Magazine - May/June 2018 - 26
IEEE Power & Energy Magazine - May/June 2018 - 27
IEEE Power & Energy Magazine - May/June 2018 - 28
IEEE Power & Energy Magazine - May/June 2018 - 29
IEEE Power & Energy Magazine - May/June 2018 - 30
IEEE Power & Energy Magazine - May/June 2018 - 31
IEEE Power & Energy Magazine - May/June 2018 - 32
IEEE Power & Energy Magazine - May/June 2018 - 33
IEEE Power & Energy Magazine - May/June 2018 - 34
IEEE Power & Energy Magazine - May/June 2018 - 35
IEEE Power & Energy Magazine - May/June 2018 - 36
IEEE Power & Energy Magazine - May/June 2018 - 37
IEEE Power & Energy Magazine - May/June 2018 - 38
IEEE Power & Energy Magazine - May/June 2018 - 39
IEEE Power & Energy Magazine - May/June 2018 - 40
IEEE Power & Energy Magazine - May/June 2018 - 41
IEEE Power & Energy Magazine - May/June 2018 - 42
IEEE Power & Energy Magazine - May/June 2018 - 43
IEEE Power & Energy Magazine - May/June 2018 - 44
IEEE Power & Energy Magazine - May/June 2018 - 45
IEEE Power & Energy Magazine - May/June 2018 - 46
IEEE Power & Energy Magazine - May/June 2018 - 47
IEEE Power & Energy Magazine - May/June 2018 - 48
IEEE Power & Energy Magazine - May/June 2018 - 49
IEEE Power & Energy Magazine - May/June 2018 - 50
IEEE Power & Energy Magazine - May/June 2018 - 51
IEEE Power & Energy Magazine - May/June 2018 - 52
IEEE Power & Energy Magazine - May/June 2018 - 53
IEEE Power & Energy Magazine - May/June 2018 - 54
IEEE Power & Energy Magazine - May/June 2018 - 55
IEEE Power & Energy Magazine - May/June 2018 - 56
IEEE Power & Energy Magazine - May/June 2018 - 57
IEEE Power & Energy Magazine - May/June 2018 - 58
IEEE Power & Energy Magazine - May/June 2018 - 59
IEEE Power & Energy Magazine - May/June 2018 - 60
IEEE Power & Energy Magazine - May/June 2018 - 61
IEEE Power & Energy Magazine - May/June 2018 - 62
IEEE Power & Energy Magazine - May/June 2018 - 63
IEEE Power & Energy Magazine - May/June 2018 - 64
IEEE Power & Energy Magazine - May/June 2018 - 65
IEEE Power & Energy Magazine - May/June 2018 - 66
IEEE Power & Energy Magazine - May/June 2018 - 67
IEEE Power & Energy Magazine - May/June 2018 - 68
IEEE Power & Energy Magazine - May/June 2018 - 69
IEEE Power & Energy Magazine - May/June 2018 - 70
IEEE Power & Energy Magazine - May/June 2018 - 71
IEEE Power & Energy Magazine - May/June 2018 - 72
IEEE Power & Energy Magazine - May/June 2018 - 73
IEEE Power & Energy Magazine - May/June 2018 - 74
IEEE Power & Energy Magazine - May/June 2018 - 75
IEEE Power & Energy Magazine - May/June 2018 - 76
IEEE Power & Energy Magazine - May/June 2018 - 77
IEEE Power & Energy Magazine - May/June 2018 - 78
IEEE Power & Energy Magazine - May/June 2018 - 79
IEEE Power & Energy Magazine - May/June 2018 - 80
IEEE Power & Energy Magazine - May/June 2018 - 81
IEEE Power & Energy Magazine - May/June 2018 - 82
IEEE Power & Energy Magazine - May/June 2018 - 83
IEEE Power & Energy Magazine - May/June 2018 - 84
IEEE Power & Energy Magazine - May/June 2018 - 85
IEEE Power & Energy Magazine - May/June 2018 - 86
IEEE Power & Energy Magazine - May/June 2018 - 87
IEEE Power & Energy Magazine - May/June 2018 - 88
IEEE Power & Energy Magazine - May/June 2018 - 89
IEEE Power & Energy Magazine - May/June 2018 - 90
IEEE Power & Energy Magazine - May/June 2018 - 91
IEEE Power & Energy Magazine - May/June 2018 - 92
IEEE Power & Energy Magazine - May/June 2018 - 93
IEEE Power & Energy Magazine - May/June 2018 - 94
IEEE Power & Energy Magazine - May/June 2018 - 95
IEEE Power & Energy Magazine - May/June 2018 - 96
IEEE Power & Energy Magazine - May/June 2018 - 97
IEEE Power & Energy Magazine - May/June 2018 - 98
IEEE Power & Energy Magazine - May/June 2018 - 99
IEEE Power & Energy Magazine - May/June 2018 - 100
IEEE Power & Energy Magazine - May/June 2018 - 101
IEEE Power & Energy Magazine - May/June 2018 - 102
IEEE Power & Energy Magazine - May/June 2018 - 103
IEEE Power & Energy Magazine - May/June 2018 - 104
IEEE Power & Energy Magazine - May/June 2018 - 105
IEEE Power & Energy Magazine - May/June 2018 - 106
IEEE Power & Energy Magazine - May/June 2018 - 107
IEEE Power & Energy Magazine - May/June 2018 - 108
IEEE Power & Energy Magazine - May/June 2018 - Cover3
IEEE Power & Energy Magazine - May/June 2018 - Cover4
https://www.nxtbook.com/nxtbooks/pes/powerenergy_111220
https://www.nxtbook.com/nxtbooks/pes/powerenergy_091020
https://www.nxtbook.com/nxtbooks/pes/powerenergy_070820
https://www.nxtbook.com/nxtbooks/pes/powerenergy_050620
https://www.nxtbook.com/nxtbooks/pes/powerenergy_030420
https://www.nxtbook.com/nxtbooks/pes/powerenergy_010220
https://www.nxtbook.com/nxtbooks/pes/powerenergy_111219
https://www.nxtbook.com/nxtbooks/pes/powerenergy_091019
https://www.nxtbook.com/nxtbooks/pes/powerenergy_070819
https://www.nxtbook.com/nxtbooks/pes/powerenergy_050619
https://www.nxtbook.com/nxtbooks/pes/powerenergy_030419
https://www.nxtbook.com/nxtbooks/pes/powerenergy_010219
https://www.nxtbook.com/nxtbooks/pes/powerenergy_111218
https://www.nxtbook.com/nxtbooks/pes/powerenergy_091018
https://www.nxtbook.com/nxtbooks/pes/powerenergy_070818
https://www.nxtbook.com/nxtbooks/pes/powerenergy_050618
https://www.nxtbook.com/nxtbooks/pes/powerenergy_030418
https://www.nxtbook.com/nxtbooks/pes/powerenergy_010218
https://www.nxtbook.com/nxtbooks/pes/powerenergy_111217
https://www.nxtbook.com/nxtbooks/pes/powerenergy_091017
https://www.nxtbook.com/nxtbooks/pes/powerenergy_070817
https://www.nxtbook.com/nxtbooks/pes/powerenergy_050617
https://www.nxtbook.com/nxtbooks/pes/powerenergy_030417
https://www.nxtbook.com/nxtbooks/pes/powerenergy_010217
https://www.nxtbook.com/nxtbooks/pes/powerenergy_111216
https://www.nxtbook.com/nxtbooks/pes/powerenergy_091016
https://www.nxtbook.com/nxtbooks/pes/powerenergy_070816
https://www.nxtbook.com/nxtbooks/pes/powerenergy_050616
https://www.nxtbook.com/nxtbooks/pes/powerenergy_030416
https://www.nxtbook.com/nxtbooks/pes/powerenergy_010216
https://www.nxtbook.com/nxtbooks/ieee/powerenergy_010216
https://www.nxtbook.com/nxtbooks/pes/powerenergy_111215
https://www.nxtbook.com/nxtbooks/pes/powerenergy_091015
https://www.nxtbook.com/nxtbooks/pes/powerenergy_070815
https://www.nxtbook.com/nxtbooks/pes/powerenergy_050615
https://www.nxtbook.com/nxtbooks/pes/powerenergy_030415
https://www.nxtbook.com/nxtbooks/pes/powerenergy_010215
https://www.nxtbook.com/nxtbooks/pes/powerenergy_111214
https://www.nxtbook.com/nxtbooks/pes/powerenergy_091014
https://www.nxtbook.com/nxtbooks/pes/powerenergy_070814
https://www.nxtbook.com/nxtbooks/pes/powerenergy_050614
https://www.nxtbook.com/nxtbooks/pes/powerenergy_030414
https://www.nxtbook.com/nxtbooks/pes/powerenergy_010214
https://www.nxtbookmedia.com