IEEE Solid-States Circuits Magazine - Winter 2022 - 68

Low-Level
Benchmark
Energy/
Operation
Operations/s
7 nm 12 nm 28 nm 40 nm 65 nm . . .
Silicon Technology
Inference
Accuracy at
(Task, Data Set)
FIGURE 25: The various parameters impacting low- and system-level benchmarking metrics.
Digital
Computing
Analog
Computing
Off-Memory
Computing
* Digital Processors
* Systolic Arrays
* In-Sensor Processing
* Analog Convolutions
* Analog Spiking
Implementations
spiking processor enabled taskagnostic
online learning in seconds
by using a recurrent neural
network and applied this to navigation,
gesture recognition, and
keyword spotting tasks.
In-Memory
Computing
* Digital In-Memory
Computing
* Analog In-Memory
Computing
6) ISSCC 2022 shows machine learning
processors implemented
across a wide variety of technology
nodes, ranging from test chips,
where novel ideas are carefully
evaluated using older technology
nodes (65 and 180 nm), to industry
chips, from 40-nm Flash chips to
22-nm recommender chips, and a
4-nm NPU supporting a variety of
precision formats.
Since various chipsets are often
FIGURE 26: A taxonomy of digital versus analog and OFF-memory versus
IN-memory computing.
1.E+4
1.E+3
1.E+2
1.E+1
1.E+0
1.E-1
1.E+0 1.E+1 1.E+2 1.E+3 1.E+4 1.E+5 1.E+6
Throughput (GOPS)
FIGURE 27: The deep learning processor energy efficiency and throughput. GOPS: giga
operations per second.
68 WINTER 2022
IEEE SOLID-STATE CIRCUITS MAGAZINE
(2016-2018) 16 Bit
(2019) 16 Bit
(2021) 8 Bit
(2022) 8 Bit
(2016-2018) 8 Bit
(2019) 8 Bit
(2021) 4 Bit
(2022) 4 Bit
(2016-2018) 4 Bit
(2019) 1 Bit
(2021) 1 Bit
(2022) 2 Bit
(2016-2018) 1 Bit
(2020) 8 Bit
(2022) 12 Bit
characterized on a different set of
tasks, network topologies, and accuracy
levels, a direct comparison of the
true system-level benchmarking metrics-such
as energy/inference and
inference/s-is not always straightforward.
It is therefore instructive to
look at the reported low-level metrics
of operations/s and energy/operation
within a neural network. Figure 27
displays the energy efficiency-versusthroughput
operating points demonstrated
by the accelerators presented
at ISSCC 2022 (in yellow) compared
to the state of the art in 2016-2018
(blue), 2019 (black), 2020 (green), and
2021 (red). Figure 28 plots the evolution
of energy and area efficiency (the
throughput per unit area) over the
past few years.
From these graphs, the improvement
in terms of the low-level metrics
System-Level
Benchmark
INT1 INT2 INT4 INT8 FP8 FP16
Adaptive Precision
Sparse
Input/Output/Weight Sparsity
Adaptive Sparsity
Dense
Energy/
Inference
Accuracy in ...
Inference/s
* ImageNet (Top-1, Top-5)
* Pose Estimation (mAP)
* Object Location (mAP)
* Keyword Recognition
* Gesture Recognition
* Question Answering
* Recommendations
Energy Efficiency (TOPS/W)
Strongly Dependent On

IEEE Solid-States Circuits Magazine - Winter 2022

Table of Contents for the Digital Edition of IEEE Solid-States Circuits Magazine - Winter 2022

Contents
IEEE Solid-States Circuits Magazine - Winter 2022 - Cover1
IEEE Solid-States Circuits Magazine - Winter 2022 - Cover2
IEEE Solid-States Circuits Magazine - Winter 2022 - Contents
IEEE Solid-States Circuits Magazine - Winter 2022 - 2
IEEE Solid-States Circuits Magazine - Winter 2022 - 3
IEEE Solid-States Circuits Magazine - Winter 2022 - 4
IEEE Solid-States Circuits Magazine - Winter 2022 - 5
IEEE Solid-States Circuits Magazine - Winter 2022 - 6
IEEE Solid-States Circuits Magazine - Winter 2022 - 7
IEEE Solid-States Circuits Magazine - Winter 2022 - 8
IEEE Solid-States Circuits Magazine - Winter 2022 - 9
IEEE Solid-States Circuits Magazine - Winter 2022 - 10
IEEE Solid-States Circuits Magazine - Winter 2022 - 11
IEEE Solid-States Circuits Magazine - Winter 2022 - 12
IEEE Solid-States Circuits Magazine - Winter 2022 - 13
IEEE Solid-States Circuits Magazine - Winter 2022 - 14
IEEE Solid-States Circuits Magazine - Winter 2022 - 15
IEEE Solid-States Circuits Magazine - Winter 2022 - 16
IEEE Solid-States Circuits Magazine - Winter 2022 - 17
IEEE Solid-States Circuits Magazine - Winter 2022 - 18
IEEE Solid-States Circuits Magazine - Winter 2022 - 19
IEEE Solid-States Circuits Magazine - Winter 2022 - 20
IEEE Solid-States Circuits Magazine - Winter 2022 - 21
IEEE Solid-States Circuits Magazine - Winter 2022 - 22
IEEE Solid-States Circuits Magazine - Winter 2022 - 23
IEEE Solid-States Circuits Magazine - Winter 2022 - 24
IEEE Solid-States Circuits Magazine - Winter 2022 - 25
IEEE Solid-States Circuits Magazine - Winter 2022 - 26
IEEE Solid-States Circuits Magazine - Winter 2022 - 27
IEEE Solid-States Circuits Magazine - Winter 2022 - 28
IEEE Solid-States Circuits Magazine - Winter 2022 - 29
IEEE Solid-States Circuits Magazine - Winter 2022 - 30
IEEE Solid-States Circuits Magazine - Winter 2022 - 31
IEEE Solid-States Circuits Magazine - Winter 2022 - 32
IEEE Solid-States Circuits Magazine - Winter 2022 - 33
IEEE Solid-States Circuits Magazine - Winter 2022 - 34
IEEE Solid-States Circuits Magazine - Winter 2022 - 35
IEEE Solid-States Circuits Magazine - Winter 2022 - 36
IEEE Solid-States Circuits Magazine - Winter 2022 - 37
IEEE Solid-States Circuits Magazine - Winter 2022 - 38
IEEE Solid-States Circuits Magazine - Winter 2022 - 39
IEEE Solid-States Circuits Magazine - Winter 2022 - 40
IEEE Solid-States Circuits Magazine - Winter 2022 - 41
IEEE Solid-States Circuits Magazine - Winter 2022 - 42
IEEE Solid-States Circuits Magazine - Winter 2022 - 43
IEEE Solid-States Circuits Magazine - Winter 2022 - 44
IEEE Solid-States Circuits Magazine - Winter 2022 - 45
IEEE Solid-States Circuits Magazine - Winter 2022 - 46
IEEE Solid-States Circuits Magazine - Winter 2022 - 47
IEEE Solid-States Circuits Magazine - Winter 2022 - 48
IEEE Solid-States Circuits Magazine - Winter 2022 - 49
IEEE Solid-States Circuits Magazine - Winter 2022 - 50
IEEE Solid-States Circuits Magazine - Winter 2022 - 51
IEEE Solid-States Circuits Magazine - Winter 2022 - 52
IEEE Solid-States Circuits Magazine - Winter 2022 - 53
IEEE Solid-States Circuits Magazine - Winter 2022 - 54
IEEE Solid-States Circuits Magazine - Winter 2022 - 55
IEEE Solid-States Circuits Magazine - Winter 2022 - 56
IEEE Solid-States Circuits Magazine - Winter 2022 - 57
IEEE Solid-States Circuits Magazine - Winter 2022 - 58
IEEE Solid-States Circuits Magazine - Winter 2022 - 59
IEEE Solid-States Circuits Magazine - Winter 2022 - 60
IEEE Solid-States Circuits Magazine - Winter 2022 - 61
IEEE Solid-States Circuits Magazine - Winter 2022 - 62
IEEE Solid-States Circuits Magazine - Winter 2022 - 63
IEEE Solid-States Circuits Magazine - Winter 2022 - 64
IEEE Solid-States Circuits Magazine - Winter 2022 - 65
IEEE Solid-States Circuits Magazine - Winter 2022 - 66
IEEE Solid-States Circuits Magazine - Winter 2022 - 67
IEEE Solid-States Circuits Magazine - Winter 2022 - 68
IEEE Solid-States Circuits Magazine - Winter 2022 - 69
IEEE Solid-States Circuits Magazine - Winter 2022 - 70
IEEE Solid-States Circuits Magazine - Winter 2022 - 71
IEEE Solid-States Circuits Magazine - Winter 2022 - 72
IEEE Solid-States Circuits Magazine - Winter 2022 - 73
IEEE Solid-States Circuits Magazine - Winter 2022 - 74
IEEE Solid-States Circuits Magazine - Winter 2022 - 75
IEEE Solid-States Circuits Magazine - Winter 2022 - 76
IEEE Solid-States Circuits Magazine - Winter 2022 - 77
IEEE Solid-States Circuits Magazine - Winter 2022 - 78
IEEE Solid-States Circuits Magazine - Winter 2022 - 79
IEEE Solid-States Circuits Magazine - Winter 2022 - 80
IEEE Solid-States Circuits Magazine - Winter 2022 - 81
IEEE Solid-States Circuits Magazine - Winter 2022 - 82
IEEE Solid-States Circuits Magazine - Winter 2022 - 83
IEEE Solid-States Circuits Magazine - Winter 2022 - 84
IEEE Solid-States Circuits Magazine - Winter 2022 - 85
IEEE Solid-States Circuits Magazine - Winter 2022 - 86
IEEE Solid-States Circuits Magazine - Winter 2022 - 87
IEEE Solid-States Circuits Magazine - Winter 2022 - 88
IEEE Solid-States Circuits Magazine - Winter 2022 - 89
IEEE Solid-States Circuits Magazine - Winter 2022 - 90
IEEE Solid-States Circuits Magazine - Winter 2022 - 91
IEEE Solid-States Circuits Magazine - Winter 2022 - 92
IEEE Solid-States Circuits Magazine - Winter 2022 - 93
IEEE Solid-States Circuits Magazine - Winter 2022 - 94
IEEE Solid-States Circuits Magazine - Winter 2022 - 95
IEEE Solid-States Circuits Magazine - Winter 2022 - 96
IEEE Solid-States Circuits Magazine - Winter 2022 - 97
IEEE Solid-States Circuits Magazine - Winter 2022 - 98
IEEE Solid-States Circuits Magazine - Winter 2022 - 99
IEEE Solid-States Circuits Magazine - Winter 2022 - 100
IEEE Solid-States Circuits Magazine - Winter 2022 - 101
IEEE Solid-States Circuits Magazine - Winter 2022 - 102
IEEE Solid-States Circuits Magazine - Winter 2022 - 103
IEEE Solid-States Circuits Magazine - Winter 2022 - 104
IEEE Solid-States Circuits Magazine - Winter 2022 - 105
IEEE Solid-States Circuits Magazine - Winter 2022 - 106
IEEE Solid-States Circuits Magazine - Winter 2022 - 107
IEEE Solid-States Circuits Magazine - Winter 2022 - 108
IEEE Solid-States Circuits Magazine - Winter 2022 - 109
IEEE Solid-States Circuits Magazine - Winter 2022 - 110
IEEE Solid-States Circuits Magazine - Winter 2022 - 111
IEEE Solid-States Circuits Magazine - Winter 2022 - 112
IEEE Solid-States Circuits Magazine - Winter 2022 - Cover3
IEEE Solid-States Circuits Magazine - Winter 2022 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/mssc_fall2023
https://www.nxtbook.com/nxtbooks/ieee/mssc_summer2023
https://www.nxtbook.com/nxtbooks/ieee/mssc_spring2023
https://www.nxtbook.com/nxtbooks/ieee/mssc_winter2023
https://www.nxtbook.com/nxtbooks/ieee/mssc_fall2022
https://www.nxtbook.com/nxtbooks/ieee/mssc_summer2022
https://www.nxtbook.com/nxtbooks/ieee/mssc_spring2022
https://www.nxtbook.com/nxtbooks/ieee/mssc_winter2022
https://www.nxtbook.com/nxtbooks/ieee/mssc_fall2021
https://www.nxtbook.com/nxtbooks/ieee/mssc_summer2021
https://www.nxtbook.com/nxtbooks/ieee/mssc_spring2021
https://www.nxtbook.com/nxtbooks/ieee/mssc_winter2021
https://www.nxtbook.com/nxtbooks/ieee/mssc_fall2020
https://www.nxtbook.com/nxtbooks/ieee/mssc_summer2020
https://www.nxtbook.com/nxtbooks/ieee/mssc_spring2020
https://www.nxtbook.com/nxtbooks/ieee/mssc_winter2020
https://www.nxtbook.com/nxtbooks/ieee/mssc_fall2019
https://www.nxtbook.com/nxtbooks/ieee/mssc_summer2019
https://www.nxtbook.com/nxtbooks/ieee/mssc_2019summer
https://www.nxtbook.com/nxtbooks/ieee/mssc_2019winter
https://www.nxtbook.com/nxtbooks/ieee/mssc_2018fall
https://www.nxtbook.com/nxtbooks/ieee/mssc_2018summer
https://www.nxtbook.com/nxtbooks/ieee/mssc_2018spring
https://www.nxtbook.com/nxtbooks/ieee/mssc_2018winter
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_winter2017
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_fall2017
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_summer2017
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_spring2017
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_winter2016
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_fall2016
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_summer2016
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_spring2016
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_winter2015
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_fall2015
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_summer2015
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_spring2015
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_winter2014
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_fall2014
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_summer2014
https://www.nxtbook.com/nxtbooks/ieee/solidstatecircuits_spring2014
https://www.nxtbookmedia.com