Quality Progress - September 2017 - 28

F E AT U R E

BIG DATA

The challenge for quality practitioners is to recognize
this shift and secure the training and understanding necessary to take full advantage of the opportunities.

What's the big deal?

What exactly is big data? You've probably noticed that
big data often is associated with transactional data
sets (for example, American Express and Amazon),
social media (for example, Facebook and Twitter) and,
of course, search engines (for example, Google). Most
formal definitions of big data involve some variant of the
four V's:
+ Volume: Data set size.
+ Variety: Diverse data types residing in multiple
locations.
+ Velocity: Speed of generation and transmission of
data.

+ Variability: Nonconstancy of volume, variety and
velocity.
This set of V's is attributable originally to Gartner Inc.,
a research and advisory company,1 and documented
by the National Institute of Standards and Technology
(NIST) in the first volume of a set of seven documents. 2
Big data clearly is the order of the day when the quality
practitioner is confronted with a data set that exceeds
the laptop's memory, which may be by orders of
magnitude.
In this article, we'll reveal the big data era to the quality practitioner and describe the strategy being taken by
standardization bodies to streamline their entry into the
exciting and emerging field of big data analytics. This is
all done with an eye on preserving the inherently useful
quality principles that underlie the core competencies of
these standardization bodies.

FIGURE 1

NIST big data reference architecture
Information value chain

Collection

Preparation/
curation

Analytics

Visualization

Access

Processing frameworks: Computing and analytic frameworks
Messaging/
Resource
Streaming
communications Batch
management
Platforms: Data organization and distribution
Indexed storage
File systems
Infrastructures: Networking, computing and storage
Virtual resources

Security and privacy
Management

Big data framework provider

Physical resources
LEGEND

Big data information flow
Service use
Software tools and algorithms transfer

28 QP

September 2017 ❘ qualityprogress.com

NIST = National Institute of
Standards and Technology

IT value chain

Data provider

Big data application provider

Data consumer

System orchestrator


http://www.qualityprogress.com

Table of Contents for the Digital Edition of Quality Progress - September 2017

Seen and Heard
Progress Report
Mr. Pareto Head
Career Coach
Expert Answers
Field Notes
Data Disruption
The Deal With Big Data
Better Intelligence
A Study in Measurement
Innovation Imperative
Statistics Spotlight
Standard Issues
ASQ's 2017 Quality Resource Guide
Marketplace
Footnotes
Back to Basics
Quality Progress - September 2017 - Intro
Quality Progress - September 2017 - cover1
Quality Progress - September 2017 - cover2
Quality Progress - September 2017 - 1
Quality Progress - September 2017 - 2
Quality Progress - September 2017 - 3
Quality Progress - September 2017 - 4
Quality Progress - September 2017 - 5
Quality Progress - September 2017 - Seen and Heard
Quality Progress - September 2017 - 7
Quality Progress - September 2017 - Progress Report
Quality Progress - September 2017 - 9
Quality Progress - September 2017 - Mr. Pareto Head
Quality Progress - September 2017 - 11
Quality Progress - September 2017 - Career Coach
Quality Progress - September 2017 - 13
Quality Progress - September 2017 - 14
Quality Progress - September 2017 - Expert Answers
Quality Progress - September 2017 - Field Notes
Quality Progress - September 2017 - 17
Quality Progress - September 2017 - 18
Quality Progress - September 2017 - 19
Quality Progress - September 2017 - Data Disruption
Quality Progress - September 2017 - 21
Quality Progress - September 2017 - 22
Quality Progress - September 2017 - 23
Quality Progress - September 2017 - 24
Quality Progress - September 2017 - 25
Quality Progress - September 2017 - The Deal With Big Data
Quality Progress - September 2017 - 27
Quality Progress - September 2017 - 28
Quality Progress - September 2017 - 29
Quality Progress - September 2017 - 30
Quality Progress - September 2017 - 31
Quality Progress - September 2017 - 32
Quality Progress - September 2017 - 33
Quality Progress - September 2017 - Better Intelligence
Quality Progress - September 2017 - 35
Quality Progress - September 2017 - 36
Quality Progress - September 2017 - 37
Quality Progress - September 2017 - 38
Quality Progress - September 2017 - 39
Quality Progress - September 2017 - 40
Quality Progress - September 2017 - 41
Quality Progress - September 2017 - A Study in Measurement
Quality Progress - September 2017 - 43
Quality Progress - September 2017 - 44
Quality Progress - September 2017 - 45
Quality Progress - September 2017 - 46
Quality Progress - September 2017 - 47
Quality Progress - September 2017 - Innovation Imperative
Quality Progress - September 2017 - 49
Quality Progress - September 2017 - 50
Quality Progress - September 2017 - Statistics Spotlight
Quality Progress - September 2017 - 52
Quality Progress - September 2017 - 53
Quality Progress - September 2017 - Standard Issues
Quality Progress - September 2017 - 55
Quality Progress - September 2017 - 56
Quality Progress - September 2017 - 57
Quality Progress - September 2017 - ASQ's 2017 Quality Resource Guide
Quality Progress - September 2017 - 59
Quality Progress - September 2017 - 60
Quality Progress - September 2017 - 61
Quality Progress - September 2017 - 62
Quality Progress - September 2017 - 63
Quality Progress - September 2017 - 64
Quality Progress - September 2017 - 65
Quality Progress - September 2017 - 66
Quality Progress - September 2017 - 67
Quality Progress - September 2017 - Marketplace
Quality Progress - September 2017 - 69
Quality Progress - September 2017 - Footnotes
Quality Progress - September 2017 - 71
Quality Progress - September 2017 - Back to Basics
Quality Progress - September 2017 - cover3
Quality Progress - September 2017 - cover4
https://www.nxtbook.com/naylor/ASQM/ASQM0719
https://www.nxtbook.com/naylor/ASQM/ASQM0619
https://www.nxtbook.com/naylor/ASQM/ASQM0519
https://www.nxtbook.com/naylor/ASQM/ASQM0419
https://www.nxtbook.com/naylor/ASQM/ASQM0319
https://www.nxtbook.com/naylor/ASQM/ASQM0219
https://www.nxtbook.com/naylor/ASQM/ASQM0119
https://www.nxtbook.com/naylor/ASQM/ASQM1218
https://www.nxtbook.com/naylor/ASQM/ASQM1118
https://www.nxtbook.com/naylor/ASQM/ASQM1018
https://www.nxtbook.com/naylor/ASQM/ASQM0918
https://www.nxtbook.com/naylor/ASQM/ASQM0818
https://www.nxtbook.com/naylor/ASQM/ASQM0718
https://www.nxtbook.com/naylor/ASQM/ASQM0618
https://www.nxtbook.com/naylor/ASQM/ASQM0518
https://www.nxtbook.com/naylor/ASQM/ASQM0418
https://www.nxtbook.com/naylor/ASQM/ASQM0318
https://www.nxtbook.com/naylor/ASQM/ASQM0218
https://www.nxtbook.com/naylor/ASQM/ASQM0118
https://www.nxtbook.com/naylor/ASQM/ASQM1217
https://www.nxtbook.com/naylor/ASQM/ASQM1117
https://www.nxtbook.com/naylor/ASQM/ASQM1017
https://www.nxtbook.com/naylor/ASQM/ASQM0917
https://www.nxtbook.com/naylor/ASQM/ASQM0817
https://www.nxtbook.com/naylor/ASQM/ASQM0717
https://www.nxtbook.com/naylor/ASQM/ASQM0617
https://www.nxtbook.com/naylor/ASQM/ASQM0517
https://www.nxtbook.com/naylor/ASQM/ASQM0417
https://www.nxtbook.com/naylor/ASQM/ASQC12518
https://www.nxtbook.com/naylor/ASQM/ASQM0317
https://www.nxtbook.com/naylor/ASQM/ASQM0217
https://www.nxtbook.com/naylor/ASQM/ASQM0117
https://www.nxtbook.com/naylor/ASQM/ASQM1216
https://www.nxtbook.com/naylor/ASQM/ASQM1116
https://www.nxtbook.com/naylor/ASQM/ASQM1016
https://www.nxtbook.com/naylor/ASQM/ASAC0016
https://www.nxtbook.com/naylor/ASQM/ASQM0916
https://www.nxtbook.com/naylor/ASQM/ASQA0016
https://www.nxtbook.com/naylor/ASQM/ASQM0816
https://www.nxtbook.com/naylor/ASQM/ASQM0716
https://www.nxtbook.com/naylor/ASQM/ASQM0616
https://www.nxtbook.com/naylor/ASQM/ASQM0516
https://www.nxtbook.com/naylor/ASQM/ASQM0416
https://www.nxtbook.com/naylor/ASQM/ASQM0316
https://www.nxtbook.com/naylor/ASQM/ASQM0216
https://www.nxtbook.com/naylor/ASQM/ASQM0116
https://www.nxtbook.com/naylor/ASQM/ASQM1215
https://www.nxtbook.com/naylor/ASQM/ASQM1115
https://www.nxtbook.com/naylor/ASQM/ASQM1015
https://www.nxtbook.com/naylor/ASQM/ASQM0915
https://www.nxtbook.com/naylor/ASQM/ASQM0815
https://www.nxtbook.com/naylor/ASQM/ASQM0715
https://www.nxtbook.com/naylor/ASQM/ASQM0615
https://www.nxtbook.com/naylor/ASQM/ASQM0515
https://www.nxtbook.com/naylor/ASQM/ASQM0315
https://www.nxtbook.com/naylor/ASQM/ASQM0215
https://www.nxtbook.com/naylor/ASQM/ASQM0115
https://www.nxtbook.com/naylor/ASQM/ASQM1214
https://www.nxtbook.com/naylor/ASQM/ASQM1114
https://www.nxtbook.com/naylor/ASQM/ASQM1014
https://www.nxtbook.com/naylor/ASQM/ASQM0914
https://www.nxtbook.com/naylor/ASQM/ASQM0814
https://www.nxtbook.com/naylor/ASQM/ASQM0714
https://www.nxtbook.com/naylor/ASQM/ASQM0614
https://www.nxtbook.com/naylor/ASQM/ASQM0514
https://www.nxtbook.com/naylor/ASQM/ASQM0414
https://www.nxtbook.com/naylor/ASQM/ASQM0314
https://www.nxtbook.com/naylor/ASQM/ASQM0214
https://www.nxtbook.com/naylor/ASQM/ASQM0114
https://www.nxtbook.com/naylor/ASQM/ASQM1213
https://www.nxtbook.com/naylor/ASQM/ASQM1113
https://www.nxtbook.com/naylor/ASQM/ASQM1013
https://www.nxtbook.com/naylor/ASQM/ASQM0913
https://www.nxtbook.com/naylor/ASQM/ASQM0813
https://www.nxtbook.com/naylor/ASQM/ASQM0713
https://www.nxtbook.com/naylor/ASQM/ASQM0613
https://www.nxtbook.com/naylor/ASQM/ASQM0513
https://www.nxtbook.com/naylor/ASQM/ASQM0413
https://www.nxtbook.com/naylor/ASQM/ASQM0313
https://www.nxtbook.com/nxtbooks/naylor/ASQM0213
https://www.nxtbook.com/nxtbooks/naylor/ASQM0113
https://www.nxtbook.com/nxtbooks/naylor/ASQM1212
https://www.nxtbook.com/nxtbooks/naylor/ASQM1112
https://www.nxtbook.com/nxtbooks/naylor/ASQM1012
https://www.nxtbook.com/nxtbooks/naylor/ASQM0912
https://www.nxtbookmedia.com