Education Week - May 20, 2015 - 10

Thousands
Score Tests
By Hand
CONTINUED FROM PAGE 1
the Smarter Balanced Assessment
Consortium and the Partnership for
Assessment of Readiness for College
and Careers, or parcc-to gauge mastery
of the common core. That unprecedented
scoring project is testing the
capacity of the assessment industry
and fueling debate about what constitutes
a good way of measuring student
learning.
The scoring process is typically
shrouded in secrecy, but Pearson,
which is training scorers for parcc
states, as well as administering and
scoring the test, permitted a rare
visit to one of its 13 regional scoring
centers, in a nondescript brick office
building outside Columbus.
Inside is Launica Jones, who on a
recent day had been scoring the answers
to 3rd grade math questions.
The 23-year-old taught elementary
school for a while, but now she's going
to law school at night, and scoring the
parcc exam by day for extra cash. On
a break, she walks a reporter through
the process. The problem asks students
to analyze the multiplication
calculations of two fictional students,
decide which is correct, and explain
why.
"See?" she says, pointing at the
computer screen displaying the question.
"This one gets only one point
[out of four]. He got the part about
which child was right, but he didn't
say why."
As millions of nervous students sit
down at computers to take the exams
this spring, they can't tell that their
longer answers are being zapped out
to real human beings, who score them
at home or in corporate scoring centers.
But here those scorers are on a
recent afternoon, Ms. Jones and about
50 other men and women, sitting in
long rows, evaluating 3rd graders' answers
to math questions. They don't
score the entire parcc exam here;
individual questions are divvied up
and distributed to scoring centers
nationwide.
Learning the Ropes
On this day, the scorers-called
"raters" in industry-speak-are at
various stages in their training. Some,
like Ms. Jones, have passed a qualifying
test and are scoring real students'
answers. Others are still in training.
In one corner of the room, a group
of 10 aspiring scorers are discussing
how to grade the same math
problem Ms. Jones has been rating.
They've studied for two to three days
to win approval to score this one
item. They've examined "anchor sets"
of pregraded and annotated student
answers. They've studied 10 or more
additional practice sets of student answers
to learn to distinguish a complete
answer from a partial one.
All of those materials are compiled
in thick notebooks, along with grading
guidelines, for the would-be raters
to use as they consider dozens
of student answers to this one math
problem. Now they're peppering their
supervisor with questions.
If a student has the correct answer,
but forgets to add the dollar sign,
does he get credit? What if a student
shows a sound strategy, but an incorrect
calculation? The supervisor
walks through each student response
with her group, explaining the correct
way to score each one. When these
men and women complete their training,
they'll take a qualifying exam
designed to demonstrate that their
scoring consistently falls within the
ranges that Pearson and educators
from parcc have agreed upon.
Smarter Balanced has a more
decentralized way of training scorers,
since each state using that test
chooses its own vendor to administer
and score the test, and train raters.
While Pearson requires parcc scorers
to hold bachelor's degrees, for
instance, Smarter Balanced lets each
state set its own minimum requirements,
said Shelbi K. Cole, the deputy
director of content for Smarter Balanced.
California
offers an example:
Through its contractor, the Educational
Testing Service, the state is hiring
only scorers who have bachelor's
degrees, though they can be "in any
field," according to an ets flyer. Teaching
experience is "strongly preferred,"
but not required. Certified teachers,
10 | EDUCATION WEEK | May 20, 2015 | www.edweek.org
however, must be paid $20 per hour
to score, while non-teachers earn $13
per hour. As of late April, only 10 percent
of the scorers hired in California
were teachers, according to the state
department of education.
Regardless of their incoming qualifications,
however, all Smarter Balanced
raters will have to reach a common
target: after training, they must
be able to show that they can consistently
score answers within approved
ranges of accuracy, Ms. Cole said.
Clearing that hurdle doesn't ensure
job security, though. Their work
is monitored as they score, and if
their scores don't agree with those
of pregraded, model answers often
enough-70 percent to 90 percent of
the time, depending on the complexity
of the question-they can be dismissed.
"Once a scorer, not always a
scorer," said Luci Willits, the deputy
director of Smarter Balanced.
Focus on Reliability
That monitoring process is similar
to the one in use at Pearson. During
raters' training, and later, when
they're officially scoring, Pearson scoring
supervisors intermittently "back
read" selected papers to make sure
their scores fall within acceptable
ranges, said Robert Sanders, Pearson's
director of performance scoring.
They also slip pregraded models of
FROM TOP:
Cynthia Rutan, the scoring
director at the Westerville,
Ohio, center, works with
trainees on methods for
hand-scoring the PARCC test.
A sign at the center
prominently espouses some
guiding principles for scorers
as they scrutinize and rate
test questions for the 3rd
grade math section of the
PARCC test .
student work into the student responses
from time to time, to see if
scorers grade them correctly, he said.
In the Pearson scoring center, each
student answer generally gets scored
by a single rater. Ten percent of the
responses, however, are read by two
raters to verify consistency in scoring.
Some responses might be reviewed
by Pearson staff members if scorers
flag them for a variety of reasons,
such as illegible handwriting or responses
written in languages other
than English.
As they review raters' work, Pearson
staffers meet and talk with those
who are scoring too high or too low
in an attempt to remedy that "drift,"
Mr. Sanders said. A few must be
dismissed, and some leave training
before becoming raters. In the training
for 3rd grade math scoring, for instance,
85 percent of those who were
hired as scorers made it through the
qualifying test and went to work as
raters, Mr. Sanders said.
Pearson reports that among the
scorers hired as of April 30, 72 percent
had one or more years of teaching
experience, but only half are still
teaching. Any teaching experience-
not just that obtained in mainstream
public or private K-12 classrooms-is
acceptable, Mr. Sanders said.
Advertising for Scorers
Recruited through postings on sites
such as CraigsList, Monster.com and
Facebook, Pearson raters are paid
$12 per hour initially. Logging more
hours can bump their pay up to $14
per hour. There's performance pay,
too: a track record of quality scoring
can earn bonuses of $15 to $30 per
day. Raters on the day shift stay for
eight hours; those who work at night
typically work four to six hours. Scorers
who train and work from home-
three-quarters of those scoring the
parcc tests for Pearson-commit to
score 20 hours per week.
The time on task matters because
Pearson staffers monitor raters' productivity.
Acceptable scoring speeds
are based on Pearson's past experience
scoring tests. Those reviewing
3rd grade math, for instance, are
expected to score 50 to 80 answers
Photos by Maddie McGarvey for Education Week
http://www.Monster.com http://www.edweek.org

Education Week - May 20, 2015

Table of Contents for the Digital Edition of Education Week - May 20, 2015

Education Week - May 20, 2015
Gifted Programs Miss Disadvantaged Students
Army of Scorers Tackles Common-Core Tests
Groups Aim to Smooth Student-Police Relations
U.S. Senate Proposal Puts Spotlight On ‘Open Educational Resources’
Civil Rights Data Detail Increase In Complaints
Contents
News in Brief
Report Roundup
Accountability Measures for Traits Like ‘Grit’ Questioned
Long-Term Gains Seen for Kids Who Move Out of Poverty
Blogs of the Week
Selective Public Schools Struggle to Diversify Enrollments
Illinois Policymakers Scramble After Pension Law Struck Down
Student-Data Use a Key Issue In Debates Over Privacy Bills
Blogs of the Week
Why Not Practice What We Preached?
Education Has to Be a ‘Human Business’
Letters
TopSchoolJobs Recruitment Marketplace
Making the Right Commitment to Student-Data Privacy
Is the Public Ever Really Private?
Education Week - May 20, 2015 - Civil Rights Data Detail Increase In Complaints
Education Week - May 20, 2015 - 2
Education Week - May 20, 2015 - Contents
Education Week - May 20, 2015 - News in Brief
Education Week - May 20, 2015 - Report Roundup
Education Week - May 20, 2015 - Accountability Measures for Traits Like ‘Grit’ Questioned
Education Week - May 20, 2015 - Long-Term Gains Seen for Kids Who Move Out of Poverty
Education Week - May 20, 2015 - Blogs of the Week
Education Week - May 20, 2015 - 9
Education Week - May 20, 2015 - 10
Education Week - May 20, 2015 - 11
Education Week - May 20, 2015 - 12
Education Week - May 20, 2015 - 13
Education Week - May 20, 2015 - 14
Education Week - May 20, 2015 - 15
Education Week - May 20, 2015 - 16
Education Week - May 20, 2015 - Selective Public Schools Struggle to Diversify Enrollments
Education Week - May 20, 2015 - 18
Education Week - May 20, 2015 - Student-Data Use a Key Issue In Debates Over Privacy Bills
Education Week - May 20, 2015 - Blogs of the Week
Education Week - May 20, 2015 - 21
Education Week - May 20, 2015 - Why Not Practice What We Preached?
Education Week - May 20, 2015 - Education Has to Be a ‘Human Business’
Education Week - May 20, 2015 - Letters
Education Week - May 20, 2015 - 25
Education Week - May 20, 2015 - TopSchoolJobs Recruitment Marketplace
Education Week - May 20, 2015 - 27
Education Week - May 20, 2015 - Is the Public Ever Really Private?
Education Week - May 20, 2015 - CT1
Education Week - May 20, 2015 - CT2
Education Week - May 20, 2015 - CT3
Education Week - May 20, 2015 - CT4
https://ew.edweek.org/nxtbooks/epe/ew_03202024
https://ew.edweek.org/nxtbooks/epe/ew_03132024
https://ew.edweek.org/nxtbooks/epe/ew_03062024
https://ew.edweek.org/nxtbooks/epe/ew_02212024
https://ew.edweek.org/nxtbooks/epe/ew_02142024
https://ew.edweek.org/nxtbooks/epe/ew_02072024
https://ew.edweek.org/nxtbooks/epe/ew_01312024
https://ew.edweek.org/nxtbooks/epe/ew_01242024
https://ew.edweek.org/nxtbooks/epe/ew_01172024
https://ew.edweek.org/nxtbooks/epe/ew_12132023
https://ew.edweek.org/nxtbooks/epe/ew_11152023
https://ew.edweek.org/nxtbooks/epe/ew_11012023
https://ew.edweek.org/nxtbooks/epe/ew_10252023
https://ew.edweek.org/nxtbooks/epe/ew_10112023
https://ew.edweek.org/nxtbooks/epe/ew_10042023
https://ew.edweek.org/nxtbooks/epe/ew_09272023
https://ew.edweek.org/nxtbooks/epe/ew_09202023
https://ew.edweek.org/nxtbooks/epe/ew_09132023
https://ew.edweek.org/nxtbooks/epe/ew_08302023
https://ew.edweek.org/nxtbooks/epe/ew_08282023
https://ew.edweek.org/nxtbooks/epe/ew_08142023
https://ew.edweek.org/nxtbooks/epe/ew_07122023
https://ew.edweek.org/nxtbooks/epe/ew_06142023
https://ew.edweek.org/nxtbooks/epe/ew_06072023
https://ew.edweek.org/nxtbooks/epe/ew_05312023
https://ew.edweek.org/nxtbooks/epe/ew_05172023
https://ew.edweek.org/nxtbooks/epe/ew_05102023
https://ew.edweek.org/nxtbooks/epe/ew_05032023
https://ew.edweek.org/nxtbooks/epe/ew_04262023
https://ew.edweek.org/nxtbooks/epe/ew_04052023
https://ew.edweek.org/nxtbooks/epe/ew_03292023
https://ew.edweek.org/nxtbooks/epe/ew_03222023
https://ew.edweek.org/nxtbooks/epe/ew_03152023
https://ew.edweek.org/nxtbooks/epe/ew_03082023
https://ew.edweek.org/nxtbooks/epe/ew_03012023
https://ew.edweek.org/nxtbooks/epe/ew_02222023
https://ew.edweek.org/nxtbooks/epe/ew_02152023
https://ew.edweek.org/nxtbooks/epe/ew_02082023
https://ew.edweek.org/nxtbooks/epe/ew_02012023
https://ew.edweek.org/nxtbooks/epe/ew_01252023
https://ew.edweek.org/nxtbooks/epe/ew_01182023
https://ew.edweek.org/nxtbooks/epe/ew_12142022
https://ew.edweek.org/nxtbooks/epe/ew_12072022
https://ew.edweek.org/nxtbooks/epe/ew_11302022
https://ew.edweek.org/nxtbooks/epe/ew_11232022
https://ew.edweek.org/nxtbooks/epe/ew_11162022
https://ew.edweek.org/nxtbooks/epe/ew_11022022
https://ew.edweek.org/nxtbooks/epe/ew_10262022
https://ew.edweek.org/nxtbooks/epe/ew_10192022
https://ew.edweek.org/nxtbooks/epe/ew_10122022
https://ew.edweek.org/nxtbooks/epe/ew_10052022
https://ew.edweek.org/nxtbooks/epe/ew_09282022
https://ew.edweek.org/nxtbooks/epe/ew_09212022
https://ew.edweek.org/nxtbooks/epe/ew_09142022
https://ew.edweek.org/nxtbooks/epe/ew_04242013_unprotected
https://ew.edweek.org/nxtbooks/epe/ew_08072013_old
https://ew.edweek.org/nxtbooks/epe/ew_08172016
https://ew.edweek.org/nxtbooks/epe/ew_09072022
https://ew.edweek.org/nxtbooks/epe/ew_08312022
https://ew.edweek.org/nxtbooks/epe/ew_08242022
https://ew.edweek.org/nxtbooks/epe/ew_08172022
https://ew.edweek.org/nxtbooks/epe/ew_07132022
https://ew.edweek.org/nxtbooks/epe/ew_06152022
https://ew.edweek.org/nxtbooks/epe/ew_06082022
https://ew.edweek.org/nxtbooks/epe/ew_06012022
https://ew.edweek.org/nxtbooks/epe/ew_05112022
https://ew.edweek.org/nxtbooks/epe/ew_05042022
https://ew.edweek.org/nxtbooks/epe/ew_04272022
https://ew.edweek.org/nxtbooks/epe/ew_04132022
https://ew.edweek.org/nxtbooks/epe/ew_04062022
https://ew.edweek.org/nxtbooks/epe/ew_03302022
https://ew.edweek.org/nxtbooks/epe/ew_03232022
https://ew.edweek.org/nxtbooks/epe/ew_03162022
https://ew.edweek.org/nxtbooks/epe/ew_03092022
https://ew.edweek.org/nxtbooks/epe/ew_03022022
https://ew.edweek.org/nxtbooks/epe/ew_02232022
https://ew.edweek.org/nxtbooks/epe/ew_02162022
https://ew.edweek.org/nxtbooks/epe/ew_02092022
https://ew.edweek.org/nxtbooks/epe/ew_02022022
https://ew.edweek.org/nxtbooks/epe/ew_01192022
https://ew.edweek.org/nxtbooks/epe/ew_01122022
https://ew.edweek.org/nxtbooks/epe/ew_01052022
https://ew.edweek.org/nxtbooks/epe/ew_12082021
https://ew.edweek.org/nxtbooks/epe/ew_12012021
https://ew.edweek.org/nxtbooks/epe/ew_11242021
https://ew.edweek.org/nxtbooks/epe/ew_11172021
https://ew.edweek.org/nxtbooks/epe/ew_11032021
https://ew.edweek.org/nxtbooks/epe/ew_10272021
https://ew.edweek.org/nxtbooks/epe/ew_10202021
https://ew.edweek.org/nxtbooks/epe/ew_10112021
https://ew.edweek.org/nxtbooks/epe/ew_10062021
https://ew.edweek.org/nxtbooks/epe/ew_09292021
https://ew.edweek.org/nxtbooks/epe/ew_09222021
https://ew.edweek.org/nxtbooks/epe/ew_09152021
https://ew.edweek.org/nxtbooks/epe/ew_09082021
https://ew.edweek.org/nxtbooks/epe/ew_09012021
https://ew.edweek.org/nxtbooks/epe/ew_08252021
https://ew.edweek.org/nxtbooks/epe/ew_08182021
https://ew.edweek.org/nxtbooks/epe/ew_07142021
https://ew.edweek.org/nxtbooks/epe/ew_06162021
https://ew.edweek.org/nxtbooks/epe/ew_06092021
https://ew.edweek.org/nxtbooks/epe/ew_06022021
https://ew.edweek.org/nxtbooks/epe/ew_04282021
https://ew.edweek.org/nxtbooks/epe/ew_05122021
https://ew.edweek.org/nxtbooks/epe/ew_05052021
https://ew.edweek.org/nxtbooks/epe/ew_04212021
https://ew.edweek.org/nxtbooks/epe/ew_04142021
https://ew.edweek.org/nxtbooks/epe/ew_03312021
https://ew.edweek.org/nxtbooks/epe/ew_03242021
https://ew.edweek.org/nxtbooks/epe/ew_03172021
https://ew.edweek.org/nxtbooks/epe/ew_03102021
https://ew.edweek.org/nxtbooks/epe/ew_03032021
https://ew.edweek.org/nxtbooks/epe/ew_02242021
https://ew.edweek.org/nxtbooks/epe/ew_02172021
https://ew.edweek.org/nxtbooks/epe/ew_02102021
https://ew.edweek.org/nxtbooks/epe/ew_02032021
https://ew.edweek.org/nxtbooks/epe/ew_01202021
https://ew.edweek.org/nxtbooks/epe/ew_01132021
https://ew.edweek.org/nxtbooks/epe/ew_01062021
https://ew.edweek.org/nxtbooks/epe/ew_12092020
https://ew.edweek.org/nxtbooks/epe/ew_12022020
https://ew.edweek.org/nxtbooks/epe/ew_11252020
https://ew.edweek.org/nxtbooks/epe/ew_11182020
https://ew.edweek.org/nxtbooks/epe/ew_11042020
https://ew.edweek.org/nxtbooks/epe/ew_10282020
https://ew.edweek.org/nxtbooks/epe/ew_10212020
https://ew.edweek.org/nxtbooks/epe/ew_10142020
https://ew.edweek.org/nxtbooks/epe/ew_10072020
https://ew.edweek.org/nxtbooks/epe/ew_09302020
https://ew.edweek.org/nxtbooks/epe/ew_09232020
https://ew.edweek.org/nxtbooks/epe/ew_09162020
https://ew.edweek.org/nxtbooks/epe/ew_09092020
https://ew.edweek.org/nxtbooks/epe/ew_09022020
https://ew.edweek.org/nxtbooks/epe/ew_08262020
https://ew.edweek.org/nxtbooks/epe/ew_08192020
https://ew.edweek.org/nxtbooks/epe/ew_07152020
https://ew.edweek.org/nxtbooks/epe/ew_06172020
https://ew.edweek.org/nxtbooks/epe/ew_06102020
https://ew.edweek.org/nxtbooks/epe/ew_06042020
https://ew.edweek.org/nxtbooks/epe/ew_06032020
https://ew.edweek.org/nxtbooks/epe/ew_05132020
https://ew.edweek.org/nxtbooks/epe/ew_05062020
https://ew.edweek.org/nxtbooks/epe/ew_04292020
https://ew.edweek.org/nxtbooks/epe/ew_04082020
https://ew.edweek.org/nxtbooks/epe/ew_04012020
https://ew.edweek.org/nxtbooks/epe/ew_03252020
https://ew.edweek.org/nxtbooks/epe/ew_03182020
https://ew.edweek.org/nxtbooks/epe/ew_03112020
https://ew.edweek.org/nxtbooks/epe/ew_03042020
https://ew.edweek.org/nxtbooks/epe/ew_02262020
https://ew.edweek.org/nxtbooks/epe/ew_02192020
https://ew.edweek.org/nxtbooks/epe/ew_02122020
https://ew.edweek.org/nxtbooks/epe/ew_02052020
https://ew.edweek.org/nxtbooks/epe/ew_01222020
https://ew.edweek.org/nxtbooks/epe/ew_01152020
https://ew.edweek.org/nxtbooks/epe/ew_01082020
https://ew.edweek.org/nxtbooks/epe/ew_12112019
https://ew.edweek.org/nxtbooks/epe/ew_12042019
https://ew.edweek.org/nxtbooks/epe/ew_11272019
https://ew.edweek.org/nxtbooks/epe/ew_11132019
https://ew.edweek.org/nxtbooks/epe/ew_11062019
https://ew.edweek.org/nxtbooks/epe/ew_10302019
https://ew.edweek.org/nxtbooks/epe/ew_10232019
https://ew.edweek.org/nxtbooks/epe/ew_10162019
https://ew.edweek.org/nxtbooks/epe/ew_10092019
https://ew.edweek.org/nxtbooks/epe/ew_10022019
https://ew.edweek.org/nxtbooks/epe/ew_09252019
https://ew.edweek.org/nxtbooks/epe/ew_09182019
https://ew.edweek.org/nxtbooks/epe/ew_09112019
https://ew.edweek.org/nxtbooks/epe/ew_09042019
https://ew.edweek.org/nxtbooks/epe/ew_08282019
https://ew.edweek.org/nxtbooks/epe/ew_08212019
https://ew.edweek.org/nxtbooks/epe/ew_07172019
https://ew.edweek.org/nxtbooks/epe/ew_06192019
https://ew.edweek.org/nxtbooks/epe/ew_06122019
https://ew.edweek.org/nxtbooks/epe/ew_06032019
https://ew.edweek.org/nxtbooks/epe/ew_05152019
https://ew.edweek.org/nxtbooks/epe/ew_05082019
https://ew.edweek.org/nxtbooks/epe/ew_05012019
https://ew.edweek.org/nxtbooks/epe/ew_04242019
https://ew.edweek.org/nxtbooks/epe/ew_04172019
https://ew.edweek.org/nxtbooks/epe/ew_04102019
https://ew.edweek.org/nxtbooks/epe/ew_04032019
https://ew.edweek.org/nxtbooks/epe/ew_03202019
https://ew.edweek.org/nxtbooks/epe/ew_03132019
https://ew.edweek.org/nxtbooks/epe/ew_03062019
https://ew.edweek.org/nxtbooks/epe/ew_02272019
https://ew.edweek.org/nxtbooks/epe/ew_02202019
https://ew.edweek.org/nxtbooks/epe/ew_02132019
https://ew.edweek.org/nxtbooks/epe/ew_02062019
https://ew.edweek.org/nxtbooks/epe/ew_01232019
https://ew.edweek.org/nxtbooks/epe/ew_01162019
https://ew.edweek.org/nxtbooks/epe/ew_01092019
https://ew.edweek.org/nxtbooks/epe/ew_12122018
https://ew.edweek.org/nxtbooks/epe/ew_12052018
https://ew.edweek.org/nxtbooks/epe/ew_11282018
https://ew.edweek.org/nxtbooks/epe/ew_11142018
https://ew.edweek.org/nxtbooks/epe/ew_11072018
https://ew.edweek.org/nxtbooks/epe/ew_10312018
https://ew.edweek.org/nxtbooks/epe/ew_10242018
https://ew.edweek.org/nxtbooks/epe/ew_10172018
https://ew.edweek.org/nxtbooks/epe/ew_10102018
https://ew.edweek.org/nxtbooks/epe/ew_10032018
https://ew.edweek.org/nxtbooks/epe/ew_09262018
https://ew.edweek.org/nxtbooks/epe/ew_09192018
https://ew.edweek.org/nxtbooks/epe/ew_09122018
https://ew.edweek.org/nxtbooks/epe/ew_09052018
https://ew.edweek.org/nxtbooks/epe/ew_08292018
https://ew.edweek.org/nxtbooks/epe/ew_08222018
https://ew.edweek.org/nxtbooks/epe/ew_07182018
https://ew.edweek.org/nxtbooks/epe/ew_06202018
https://ew.edweek.org/nxtbooks/epe/ew_06132018
https://ew.edweek.org/nxtbooks/epe/ew_06062018
https://ew.edweek.org/nxtbooks/epe/ew_05302018
https://ew.edweek.org/nxtbooks/epe/ew_05232018
https://ew.edweek.org/nxtbooks/epe/ew_05162018
https://ew.edweek.org/nxtbooks/epe/ew_05092018
https://ew.edweek.org/nxtbooks/epe/ew_05022018
https://ew.edweek.org/nxtbooks/epe/ew_04252018
https://ew.edweek.org/nxtbooks/epe/ew_04182018
https://ew.edweek.org/nxtbooks/epe/ew_04112018
https://ew.edweek.org/nxtbooks/epe/ew_04042018
https://ew.edweek.org/nxtbooks/epe/ew_03212018
https://ew.edweek.org/nxtbooks/epe/ew_03072018
https://ew.edweek.org/nxtbooks/epe/ew_sr_03072018
https://ew.edweek.org/nxtbooks/epe/ew_02282018
https://ew.edweek.org/nxtbooks/epe/ew_02212018
https://ew.edweek.org/nxtbooks/epe/ew_02142018
https://ew.edweek.org/nxtbooks/epe/ew_02072018
https://ew.edweek.org/nxtbooks/epe/ew_01242018
https://ew.edweek.org/nxtbooks/epe/ew_01172018
https://ew.edweek.org/nxtbooks/epe/ew_01102018
https://ew.edweek.org/nxtbooks/epe/ew_12132017
https://ew.edweek.org/nxtbooks/epe/ew_11292017
https://ew.edweek.org/nxtbooks/epe/ew_11152017
https://ew.edweek.org/nxtbooks/epe/ew_11082017
https://ew.edweek.org/nxtbooks/epe/ew_11012017
https://ew.edweek.org/nxtbooks/epe/ew_10252017
https://ew.edweek.org/nxtbooks/epe/ew_10182017
https://ew.edweek.org/nxtbooks/epe/ew_10112017
https://ew.edweek.org/nxtbooks/epe/ew_10042017
https://ew.edweek.org/nxtbooks/epe/ew_09272017
https://ew.edweek.org/nxtbooks/epe/ew_09202017
https://ew.edweek.org/nxtbooks/epe/ew_09132017
https://ew.edweek.org/nxtbooks/epe/ew_09062017
https://ew.edweek.org/nxtbooks/epe/ew_08302017
https://ew.edweek.org/nxtbooks/epe/ew_08232017
https://ew.edweek.org/nxtbooks/epe/ew_07192017
https://ew.edweek.org/nxtbooks/epe/ew_06212017
https://ew.edweek.org/nxtbooks/epe/ew_06142017
https://ew.edweek.org/nxtbooks/epe/ew_06072017
https://ew.edweek.org/nxtbooks/epe/ew_05312017
https://ew.edweek.org/nxtbooks/epe/ew_05242017
https://ew.edweek.org/nxtbooks/epe/ew_05172017
https://ew.edweek.org/nxtbooks/epe/ew_05102017
https://ew.edweek.org/nxtbooks/epe/ew_04262017specialreport
https://ew.edweek.org/nxtbooks/epe/ew_04262017
https://ew.edweek.org/nxtbooks/epe/ew_04192017
https://ew.edweek.org/nxtbooks/epe/ew_04052017
https://ew.edweek.org/nxtbooks/epe/ew_03292017
https://ew.edweek.org/nxtbooks/epe/ew_03222017
https://ew.edweek.org/nxtbooks/epe/ew_03082017
https://ew.edweek.org/nxtbooks/epe/ew_03012017
https://ew.edweek.org/nxtbooks/epe/ew_02222017
https://ew.edweek.org/nxtbooks/epe/ew_02152017
https://ew.edweek.org/nxtbooks/epe/ew_02082017
https://ew.edweek.org/nxtbooks/epe/ew_01252017
https://ew.edweek.org/nxtbooks/epe/ew_01252017specialreport
https://ew.edweek.org/nxtbooks/epe/ew_01182017
https://ew.edweek.org/nxtbooks/epe/ew_01042017
https://ew.edweek.org/nxtbooks/epe/ew_12142016
https://ew.edweek.org/nxtbooks/epe/ew_12142016v2
https://ew.edweek.org/nxtbooks/epe/ew_11302016
https://ew.edweek.org/nxtbooks/epe/ew_11162016
https://ew.edweek.org/nxtbooks/epe/ew_11092016
https://ew.edweek.org/nxtbooks/epe/ew_11022016
https://ew.edweek.org/nxtbooks/epe/ew_10262016
https://ew.edweek.org/nxtbooks/epe/ew_10192016
https://ew.edweek.org/nxtbooks/epe/ew_10122016
https://ew.edweek.org/nxtbooks/epe/ew_10052016
https://ew.edweek.org/nxtbooks/epe/ew_09282016
https://ew.edweek.org/nxtbooks/epe/ew_09212016
https://ew.edweek.org/nxtbooks/epe/ew_09142016
https://ew.edweek.org/nxtbooks/epe/ew_09072016
https://ew.edweek.org/nxtbooks/epe/ew_08312016
https://ew.edweek.org/nxtbooks/epe/ew_08242016
https://ew.edweek.org/nxtbooks/epe/ew_08032016
https://ew.edweek.org/nxtbooks/epe/ew_08032016
https://ew.edweek.org/nxtbooks/epe/ew_07202016
https://ew.edweek.org/nxtbooks/epe/ew_01112017
https://ew.edweek.org/nxtbooks/epe/ew_06082016
http://ew.edweek.org/nxtbooks/epe/tc_06092016
http://ew.edweek.org/nxtbooks/epe/dc_06022016
https://ew.edweek.org/nxtbooks/epe/ew_06012016
https://ew.edweek.org/nxtbooks/epe/ew_05182016
https://ew.edweek.org/nxtbooks/epe/ew_sr_05112016
https://ew.edweek.org/nxtbooks/epe/ew_05112016
https://ew.edweek.org/nxtbooks/epe/ew_04272016
https://ew.edweek.org/nxtbooks/epe/ew_04202016
https://ew.edweek.org/nxtbooks/epe/ew_04132016
https://ew.edweek.org/nxtbooks/epe/ew_03302016
https://ew.edweek.org/nxtbooks/epe/ew_sr_03302016
https://ew.edweek.org/nxtbooks/epe/ew_03232016
https://ew.edweek.org/nxtbooks/epe/ew_03162016
https://ew.edweek.org/nxtbooks/epe/ew_03092016
https://ew.edweek.org/nxtbooks/epe/ew_02242016
https://ew.edweek.org/nxtbooks/epe/ew_sr_02242016
https://ew.edweek.org/nxtbooks/epe/ew_02172016
https://ew.edweek.org/nxtbooks/epe/ew_02102016
https://ew.edweek.org/nxtbooks/epe/ew_sr_01272016
https://ew.edweek.org/nxtbooks/epe/ew_01272016
https://ew.edweek.org/nxtbooks/epe/ew_01202016
https://ew.edweek.org/nxtbooks/epe/ew_sr_01132016
https://ew.edweek.org/nxtbooks/epe/ew_01132016
http://ew.edweek.org/nxtbooks/epe/qc_01072016
https://ew.edweek.org/nxtbooks/epe/ew_01062016
https://ew.edweek.org/nxtbooks/epe/ew_12092015
https://ew.edweek.org/nxtbooks/epe/ew_12022015
https://ew.edweek.org/nxtbooks/epe/ew_sr_11112015
https://ew.edweek.org/nxtbooks/epe/ew_11112015
https://ew.edweek.org/nxtbooks/epe/ew_11042015
https://ew.edweek.org/nxtbooks/epe/ew_10282015
https://ew.edweek.org/nxtbooks/epe/ew_10212015
https://ew.edweek.org/nxtbooks/epe/ew_sr_10212015
https://ew.edweek.org/nxtbooks/epe/ew_10142015
https://ew.edweek.org/nxtbooks/epe/ew_10072015
https://ew.edweek.org/nxtbooks/epe/ew_09302015
https://ew.edweek.org/nxtbooks/epe/ew_sr_09302015
https://ew.edweek.org/nxtbooks/epe/ew_09232015
https://ew.edweek.org/nxtbooks/epe/ew_09162015
https://ew.edweek.org/nxtbooks/epe/ew_09092015
https://ew.edweek.org/nxtbooks/epe/ew_08262015
https://ew.edweek.org/nxtbooks/epe/ew_08192015
https://ew.edweek.org/nxtbooks/epe/ew_08052015
https://ew.edweek.org/nxtbooks/epe/ew_07082015
https://ew.edweek.org/nxtbooks/epe/ew_06102015
http://ew.edweek.org/nxtbooks/epe/tc_06112015
http://ew.edweek.org/nxtbooks/epe/dc_06042015
https://ew.edweek.org/nxtbooks/epe/ew_06032015
https://ew.edweek.org/nxtbooks/epe/ew_05202015
https://ew.edweek.org/nxtbooks/epe/ew_sr_05132015
https://ew.edweek.org/nxtbooks/epe/ew_05132015
https://ew.edweek.org/nxtbooks/epe/ew_05062015
https://ew.edweek.org/nxtbooks/epe/ew_04222015
https://ew.edweek.org/nxtbooks/epe/ew_sr_04152015
https://ew.edweek.org/nxtbooks/epe/ew_04152015
https://ew.edweek.org/nxtbooks/epe/ew_04012015
https://ew.edweek.org/nxtbooks/epe/ew_03252015
https://ew.edweek.org/nxtbooks/epe/ew_sr_03182015
https://ew.edweek.org/nxtbooks/epe/ew_03182015
https://ew.edweek.org/nxtbooks/epe/ew_03042015
https://ew.edweek.org/nxtbooks/epe/ew_02252015
https://ew.edweek.org/nxtbooks/epe/ew_sr_02252015
https://ew.edweek.org/nxtbooks/epe/ew_sr_02182015
https://ew.edweek.org/nxtbooks/epe/ew_02182015
https://ew.edweek.org/nxtbooks/epe/ew_02042015
https://ew.edweek.org/nxtbooks/epe/ew_01282015
https://ew.edweek.org/nxtbooks/epe/ew_01212015
https://ew.edweek.org/nxtbooks/epe/ew_sr_01212015
https://ew.edweek.org/nxtbooks/epe/ew_01142015
http://ew.edweek.org/nxtbooks/epe/qc_01082015
https://ew.edweek.org/nxtbooks/epe/ew_01072015
https://ew.edweek.org/nxtbooks/epe/ew_12102014
https://ew.edweek.org/nxtbooks/epe/ew_12032014
https://ew.edweek.org/nxtbooks/epe/ew_11122014
https://ew.edweek.org/nxtbooks/epe/ew_sr_11122014
https://ew.edweek.org/nxtbooks/epe/ew_11052014
https://ew.edweek.org/nxtbooks/epe/ew_10292014
https://ew.edweek.org/nxtbooks/epe/ew_10222014
https://ew.edweek.org/nxtbooks/epe/ew_sr_10222014
https://ew.edweek.org/nxtbooks/epe/ew_10152014
https://ew.edweek.org/nxtbooks/epe/ew_10082014
https://ew.edweek.org/nxtbooks/epe/ew_sr_10012014
https://ew.edweek.org/nxtbooks/epe/ew_10012014
https://ew.edweek.org/nxtbooks/epe/ew_09242014
https://ew.edweek.org/nxtbooks/epe/ew_09172014
https://ew.edweek.org/nxtbooks/epe/ew_09102014
https://ew.edweek.org/nxtbooks/epe/ew_08272014
https://ew.edweek.org/nxtbooks/epe/ew_08202014
https://ew.edweek.org/nxtbooks/epe/ew_sr_08202014
https://ew.edweek.org/nxtbooks/epe/ew_08062014
https://ew.edweek.org/nxtbooks/epe/ew_07092014
https://ew.edweek.org/nxtbooks/epe/ew_06112014_v2
https://ew.edweek.org/nxtbooks/epe/ew_06112014
http://ew.edweek.org/nxtbooks/epe/dc_06052014
https://ew.edweek.org/nxtbooks/epe/ew_06042014
https://ew.edweek.org/nxtbooks/epe/ew_05212014
https://ew.edweek.org/nxtbooks/epe/ew_05142014
https://ew.edweek.org/nxtbooks/epe/ew_05072014
https://ew.edweek.org/nxtbooks/epe/ew_sr_04232014
https://ew.edweek.org/nxtbooks/epe/ew_04232014
https://ew.edweek.org/nxtbooks/epe/ew_04162014
https://ew.edweek.org/nxtbooks/epe/ew_04022014
https://ew.edweek.org/nxtbooks/epe/ew_03262014
http://ew.edweek.org/nxtbooks/epe/tc_20140313
https://ew.edweek.org/nxtbooks/epe/ew_03122014
https://ew.edweek.org/nxtbooks/epe/ew_sr_03052014
https://ew.edweek.org/nxtbooks/epe/ew_03052014
https://ew.edweek.org/nxtbooks/epe/ew_02262014
https://ew.edweek.org/nxtbooks/epe/ew_sr_02192014
https://ew.edweek.org/nxtbooks/epe/ew_02192014
https://ew.edweek.org/nxtbooks/epe/ew_01292014_v2
https://ew.edweek.org/nxtbooks/epe/ew_02052014
https://ew.edweek.org/nxtbooks/epe/ew_01292014
https://ew.edweek.org/nxtbooks/epe/ew_01222014
https://ew.edweek.org/nxtbooks/epe/ew_01152014
http://ew.edweek.org/nxtbooks/epe/qc_01092014
https://ew.edweek.org/nxtbooks/epe/ew_01082014
https://ew.edweek.org/nxtbooks/epe/ew_12112013
https://ew.edweek.org/nxtbooks/epe/ew_12042013
https://ew.edweek.org/nxtbooks/epe/ew_11132013
https://ew.edweek.org/nxtbooks/epe/ew_11062013
https://ew.edweek.org/nxtbooks/epe/ew_sr_10302013
https://ew.edweek.org/nxtbooks/epe/ew_10302013
https://ew.edweek.org/nxtbooks/epe/ew_10232013
https://ew.edweek.org/nxtbooks/epe/ew_10162013
https://ew.edweek.org/nxtbooks/epe/ew_10092013
https://ew.edweek.org/nxtbooks/epe/ew_sr_10022013
https://ew.edweek.org/nxtbooks/epe/ew_10022013
https://ew.edweek.org/nxtbooks/epe/ew_09252013
https://ew.edweek.org/nxtbooks/epe/ew_09182013
https://ew.edweek.org/nxtbooks/epe/ew_09112013
https://ew.edweek.org/nxtbooks/epe/ew_08282013
https://ew.edweek.org/nxtbooks/epe/ew_sr_08212013
https://ew.edweek.org/nxtbooks/epe/ew_08212013
https://ew.edweek.org/nxtbooks/epe/ew_08072013
https://ew.edweek.org/nxtbooks/epe/ew_07102013
https://ew.edweek.org/nxtbooks/epe/ew_06122013
http://ew.edweek.org/nxtbooks/epe/dc_06062013
https://ew.edweek.org/nxtbooks/epe/ew_06052013
https://ew.edweek.org/nxtbooks/epe/ew_sr_05222013
https://ew.edweek.org/nxtbooks/epe/ew_05222013
https://ew.edweek.org/nxtbooks/epe/ew_05152013
https://ew.edweek.org/nxtbooks/epe/ew_05082013
https://ew.edweek.org/nxtbooks/epe/ew_sr_04242013
https://ew.edweek.org/nxtbooks/epe/ew_04242013
https://ew.edweek.org/nxtbooks/epe/ew_04172013
https://ew.edweek.org/nxtbooks/epe/ew_04032013
https://ew.edweek.org/nxtbooks/epe/ew_03272013
https://ew.edweek.org/nxtbooks/epe/ew_03132013
http://ew.edweek.org/nxtbooks/epe/tc_20130314
https://ew.edweek.org/nxtbooks/epe/ew_03062013
https://ew.edweek.org/nxtbooks/epe/ew_02272013
https://ew.edweek.org/nxtbooks/epe/ew_sr_02202013
https://ew.edweek.org/nxtbooks/epe/ew_02202013
https://ew.edweek.org/nxtbooks/epe/ew_sr_02062013
https://ew.edweek.org/nxtbooks/epe/ew_02062013
https://ew.edweek.org/nxtbooks/epe/ew_01302013
https://ew.edweek.org/nxtbooks/epe/ew_01232013
https://ew.edweek.org/nxtbooks/epe/ew_01162013
http://ew.edweek.org/nxtbooks/epe/qc_01102013
https://ew.edweek.org/nxtbooks/epe/ew_01092013
https://ew.edweek.org/nxtbooks/epe/ew_12122012
https://ew.edweek.org/nxtbooks/epe/ew_12052012
https://ew.edweek.org/nxtbooks/epe/ew_sr_11142012
https://ew.edweek.org/nxtbooks/epe/ew_11142012
https://ew.edweek.org/nxtbooks/epe/ew_11072012
https://ew.edweek.org/nxtbooks/epe/ew_10312012
https://ew.edweek.org/nxtbooks/epe/ew_sr_10242012
https://ew.edweek.org/nxtbooks/epe/ew_10242012
https://ew.edweek.org/nxtbooks/epe/ew_10172012
https://ew.edweek.org/nxtbooks/epe/ew_10102012
https://ew.edweek.org/nxtbooks/epe/ew_10032012
https://ew.edweek.org/nxtbooks/epe/ew_09262012
https://ew.edweek.org/nxtbooks/epe/ew_09192012
https://ew.edweek.org/nxtbooks/epe/ew_09122012
https://ew.edweek.org/nxtbooks/epe/ew_08292012
https://ew.edweek.org/nxtbooks/epe/ew_sr_08222012
https://ew.edweek.org/nxtbooks/epe/ew_08222012
https://ew.edweek.org/nxtbooks/epe/ew_20120829
https://ew.edweek.org/nxtbooks/epe/ew_sr_08292012
https://ew.edweek.org/nxtbooks/epe/ew_20120822_v2
https://ew.edweek.org/nxtbooks/epe/ew_20120822
https://ew.edweek.org/nxtbooks/epe/ew_test
http://ew.edweek.org/nxtbooks/epe/diplomascount_2012issue34
https://www.nxtbookmedia.com