IEEE Power & Energy Magazine - March/April 2018 - 77

What Engineers Can Learn
from Solving the Most
Complex Board Game

chess is merely 10 47 in state space or 3580 in game tree. Such searching space makes
any brute-force exhaustive searching algorithm, which is possible for ai for other board
games, such as deepBlue for chess (mainly an exhaustive search with some clever selections), impossible for the Go ai algorithms even with the computing capability
expected in future decades. Before 2016, the past effort of ai made very
little progress for computer Go programs against human Go players. For instance, the best Go software did not even have a
decent chance against average amateur players, let alone
any professional Go player.
however, in 2016, alphaGo, the Google deepmind's computer Go program, made a huge
impact on both the ai and the Go communities by defeating lee Sedol, a multiple
world championship winner, with four
wins against one loss. later, in the
spring of 2017, alphaGo beat the
latest Go prodigy and the world's
number-one-ranked player, Ke
Jie, 3-0. an article was published
in Nature in 2016 documenting
the algorithm of alphaGo as
the featured cover article (see
Figure 2), which evidenced
this epic achievement and
milestone in ai.

AlphaGo Algorithm:
Deep Neural
Networks and Monte
Carlo Tree Search

©istockphoto.com/hakule

march/april 2018

the algorithm of alphaGo can
be decomposed into three sequential parts: policy network, value network, and a monte carlo tree search
(mctS). note, the "net work " her e
means neural network. additionally, the
former two networks are also referred to as
the deep neural network (dnn) in this discussion. these three steps mimic the logical reasoning
of a human player to make a decision.
in the policy network, there are two stages. in the first
stage, alphaGo takes supervised learning to train the policy
network in learning what the human experts will play under certain
patterns. in the second stage, alphaGo takes reinforcement learning (rl)
ieee power & energy magazine

77


http://www.istockphoto.com/hakule

Table of Contents for the Digital Edition of IEEE Power & Energy Magazine - March/April 2018

Contents
IEEE Power & Energy Magazine - March/April 2018 - Cover1
IEEE Power & Energy Magazine - March/April 2018 - Cover2
IEEE Power & Energy Magazine - March/April 2018 - Contents
IEEE Power & Energy Magazine - March/April 2018 - 2
IEEE Power & Energy Magazine - March/April 2018 - 3
IEEE Power & Energy Magazine - March/April 2018 - 4
IEEE Power & Energy Magazine - March/April 2018 - 5
IEEE Power & Energy Magazine - March/April 2018 - 6
IEEE Power & Energy Magazine - March/April 2018 - 7
IEEE Power & Energy Magazine - March/April 2018 - 8
IEEE Power & Energy Magazine - March/April 2018 - 9
IEEE Power & Energy Magazine - March/April 2018 - 10
IEEE Power & Energy Magazine - March/April 2018 - 11
IEEE Power & Energy Magazine - March/April 2018 - 12
IEEE Power & Energy Magazine - March/April 2018 - 13
IEEE Power & Energy Magazine - March/April 2018 - 14
IEEE Power & Energy Magazine - March/April 2018 - 15
IEEE Power & Energy Magazine - March/April 2018 - 16
IEEE Power & Energy Magazine - March/April 2018 - 17
IEEE Power & Energy Magazine - March/April 2018 - 18
IEEE Power & Energy Magazine - March/April 2018 - 19
IEEE Power & Energy Magazine - March/April 2018 - 20
IEEE Power & Energy Magazine - March/April 2018 - 21
IEEE Power & Energy Magazine - March/April 2018 - 22
IEEE Power & Energy Magazine - March/April 2018 - 23
IEEE Power & Energy Magazine - March/April 2018 - 24
IEEE Power & Energy Magazine - March/April 2018 - 25
IEEE Power & Energy Magazine - March/April 2018 - 26
IEEE Power & Energy Magazine - March/April 2018 - 27
IEEE Power & Energy Magazine - March/April 2018 - 28
IEEE Power & Energy Magazine - March/April 2018 - 29
IEEE Power & Energy Magazine - March/April 2018 - 30
IEEE Power & Energy Magazine - March/April 2018 - 31
IEEE Power & Energy Magazine - March/April 2018 - 32
IEEE Power & Energy Magazine - March/April 2018 - 33
IEEE Power & Energy Magazine - March/April 2018 - 34
IEEE Power & Energy Magazine - March/April 2018 - 35
IEEE Power & Energy Magazine - March/April 2018 - 36
IEEE Power & Energy Magazine - March/April 2018 - 37
IEEE Power & Energy Magazine - March/April 2018 - 38
IEEE Power & Energy Magazine - March/April 2018 - 39
IEEE Power & Energy Magazine - March/April 2018 - 40
IEEE Power & Energy Magazine - March/April 2018 - 41
IEEE Power & Energy Magazine - March/April 2018 - 42
IEEE Power & Energy Magazine - March/April 2018 - 43
IEEE Power & Energy Magazine - March/April 2018 - 44
IEEE Power & Energy Magazine - March/April 2018 - 45
IEEE Power & Energy Magazine - March/April 2018 - 46
IEEE Power & Energy Magazine - March/April 2018 - 47
IEEE Power & Energy Magazine - March/April 2018 - 48
IEEE Power & Energy Magazine - March/April 2018 - 49
IEEE Power & Energy Magazine - March/April 2018 - 50
IEEE Power & Energy Magazine - March/April 2018 - 51
IEEE Power & Energy Magazine - March/April 2018 - 52
IEEE Power & Energy Magazine - March/April 2018 - 53
IEEE Power & Energy Magazine - March/April 2018 - 54
IEEE Power & Energy Magazine - March/April 2018 - 55
IEEE Power & Energy Magazine - March/April 2018 - 56
IEEE Power & Energy Magazine - March/April 2018 - 57
IEEE Power & Energy Magazine - March/April 2018 - 58
IEEE Power & Energy Magazine - March/April 2018 - 59
IEEE Power & Energy Magazine - March/April 2018 - 60
IEEE Power & Energy Magazine - March/April 2018 - 61
IEEE Power & Energy Magazine - March/April 2018 - 62
IEEE Power & Energy Magazine - March/April 2018 - 63
IEEE Power & Energy Magazine - March/April 2018 - 64
IEEE Power & Energy Magazine - March/April 2018 - 65
IEEE Power & Energy Magazine - March/April 2018 - 66
IEEE Power & Energy Magazine - March/April 2018 - 67
IEEE Power & Energy Magazine - March/April 2018 - 68
IEEE Power & Energy Magazine - March/April 2018 - 69
IEEE Power & Energy Magazine - March/April 2018 - 70
IEEE Power & Energy Magazine - March/April 2018 - 71
IEEE Power & Energy Magazine - March/April 2018 - 72
IEEE Power & Energy Magazine - March/April 2018 - 73
IEEE Power & Energy Magazine - March/April 2018 - 74
IEEE Power & Energy Magazine - March/April 2018 - 75
IEEE Power & Energy Magazine - March/April 2018 - 76
IEEE Power & Energy Magazine - March/April 2018 - 77
IEEE Power & Energy Magazine - March/April 2018 - 78
IEEE Power & Energy Magazine - March/April 2018 - 79
IEEE Power & Energy Magazine - March/April 2018 - 80
IEEE Power & Energy Magazine - March/April 2018 - 81
IEEE Power & Energy Magazine - March/April 2018 - 82
IEEE Power & Energy Magazine - March/April 2018 - 83
IEEE Power & Energy Magazine - March/April 2018 - 84
IEEE Power & Energy Magazine - March/April 2018 - 85
IEEE Power & Energy Magazine - March/April 2018 - 86
IEEE Power & Energy Magazine - March/April 2018 - 87
IEEE Power & Energy Magazine - March/April 2018 - 88
IEEE Power & Energy Magazine - March/April 2018 - 89
IEEE Power & Energy Magazine - March/April 2018 - 90
IEEE Power & Energy Magazine - March/April 2018 - 91
IEEE Power & Energy Magazine - March/April 2018 - 92
IEEE Power & Energy Magazine - March/April 2018 - 93
IEEE Power & Energy Magazine - March/April 2018 - 94
IEEE Power & Energy Magazine - March/April 2018 - 95
IEEE Power & Energy Magazine - March/April 2018 - 96
IEEE Power & Energy Magazine - March/April 2018 - 97
IEEE Power & Energy Magazine - March/April 2018 - 98
IEEE Power & Energy Magazine - March/April 2018 - 99
IEEE Power & Energy Magazine - March/April 2018 - 100
IEEE Power & Energy Magazine - March/April 2018 - 101
IEEE Power & Energy Magazine - March/April 2018 - 102
IEEE Power & Energy Magazine - March/April 2018 - 103
IEEE Power & Energy Magazine - March/April 2018 - 104
IEEE Power & Energy Magazine - March/April 2018 - 105
IEEE Power & Energy Magazine - March/April 2018 - 106
IEEE Power & Energy Magazine - March/April 2018 - 107
IEEE Power & Energy Magazine - March/April 2018 - 108
IEEE Power & Energy Magazine - March/April 2018 - Cover3
IEEE Power & Energy Magazine - March/April 2018 - Cover4
https://www.nxtbook.com/nxtbooks/pes/powerenergy_091020
https://www.nxtbook.com/nxtbooks/pes/powerenergy_070820
https://www.nxtbook.com/nxtbooks/pes/powerenergy_050620
https://www.nxtbook.com/nxtbooks/pes/powerenergy_030420
https://www.nxtbook.com/nxtbooks/pes/powerenergy_010220
https://www.nxtbook.com/nxtbooks/pes/powerenergy_111219
https://www.nxtbook.com/nxtbooks/pes/powerenergy_091019
https://www.nxtbook.com/nxtbooks/pes/powerenergy_070819
https://www.nxtbook.com/nxtbooks/pes/powerenergy_050619
https://www.nxtbook.com/nxtbooks/pes/powerenergy_030419
https://www.nxtbook.com/nxtbooks/pes/powerenergy_010219
https://www.nxtbook.com/nxtbooks/pes/powerenergy_111218
https://www.nxtbook.com/nxtbooks/pes/powerenergy_091018
https://www.nxtbook.com/nxtbooks/pes/powerenergy_070818
https://www.nxtbook.com/nxtbooks/pes/powerenergy_050618
https://www.nxtbook.com/nxtbooks/pes/powerenergy_030418
https://www.nxtbook.com/nxtbooks/pes/powerenergy_010218
https://www.nxtbook.com/nxtbooks/pes/powerenergy_111217
https://www.nxtbook.com/nxtbooks/pes/powerenergy_091017
https://www.nxtbook.com/nxtbooks/pes/powerenergy_070817
https://www.nxtbook.com/nxtbooks/pes/powerenergy_050617
https://www.nxtbook.com/nxtbooks/pes/powerenergy_030417
https://www.nxtbook.com/nxtbooks/pes/powerenergy_010217
https://www.nxtbook.com/nxtbooks/pes/powerenergy_111216
https://www.nxtbook.com/nxtbooks/pes/powerenergy_091016
https://www.nxtbook.com/nxtbooks/pes/powerenergy_070816
https://www.nxtbook.com/nxtbooks/pes/powerenergy_050616
https://www.nxtbook.com/nxtbooks/pes/powerenergy_030416
https://www.nxtbook.com/nxtbooks/pes/powerenergy_010216
https://www.nxtbook.com/nxtbooks/ieee/powerenergy_010216
https://www.nxtbook.com/nxtbooks/pes/powerenergy_111215
https://www.nxtbook.com/nxtbooks/pes/powerenergy_091015
https://www.nxtbook.com/nxtbooks/pes/powerenergy_070815
https://www.nxtbook.com/nxtbooks/pes/powerenergy_050615
https://www.nxtbook.com/nxtbooks/pes/powerenergy_030415
https://www.nxtbook.com/nxtbooks/pes/powerenergy_010215
https://www.nxtbook.com/nxtbooks/pes/powerenergy_111214
https://www.nxtbook.com/nxtbooks/pes/powerenergy_091014
https://www.nxtbook.com/nxtbooks/pes/powerenergy_070814
https://www.nxtbook.com/nxtbooks/pes/powerenergy_050614
https://www.nxtbook.com/nxtbooks/pes/powerenergy_030414
https://www.nxtbook.com/nxtbooks/pes/powerenergy_010214
https://www.nxtbookmedia.com