Are Children Learning

Measurement Inc. inks $108 million testing contract

PHOTO: Shannan Muskopf via Flickr

Measurement Inc. and the Tennessee Department of Education are officially in business together.

The testing company signed an almost $108 million contract to develop Tennessee’s next standardized test. It replaces the biggest testing company in the country, Pearson Inc., as the producer of Tennessee’s end-of-year exams.


READ ONE OF OUR LATEST STORIES ABOUT MEASUREMENT INC. AND SIGN UP TO RECEIVE DAILY EMAIL UPDATES OF TENNESSEE EDUCATION NEWS.


The Department of Education announced last month that Measurement Inc. had emerged victorious in a competitive bidding process to develop the state’s next standardized test, which will be aligned with the Common Core State Standards for math and English.

It’s a big win for the North Carolina-based company, which in 2012 accounted for just 6 percent of the country’s testing market.

Here are some other things to know about the creators of the TCAP reboot, most likely coming to desks everywhere in May 2016 :

1. Measurement Inc. is not new to Tennessee. The for-profit company has worked in the state for more than 14 years. Projects included helping the Tennessee Department of Education transition its writing test from paper to computer, and aligning the writing assessment to the Common Core standards.

2. Measurement Inc. is subcontracting to AIR, a much larger player in the country’s testing market. AIR already has contracts with Utah and Florida, so Tennessee educators will be able to compare scores of Tennessee students with students from those states “with certainty and immediately.” AIR is also working with Smarter Balanced, one of two federally funded consortia charged with developing Common Core-aligned exams. That means that educators in Tennessee will also likely be able to measure their students’ progress with students in the 16 states in the Smarter Balanced Consortium.

3. In its 34-year history, Measurement Inc has worked with 32 state departments of education and dozens of local school districts.

4. Measurement Inc already has had a scoring center in Nashville since 1998.

5. The five-year contract is worth $107,720,557.37. In contrast, contenders McGraw-Hill and Questar’s bid  approached $130 million. The cost of Tennessee’s contract is almost exactly the cost of Georgia’s five-year contract for a Common Core-aligned test with McGraw-Hill, but significantly less than Florida’s $220 million, six year contract with AIR.

TNReady backlash

Tennessee lawmakers take matters into their own hands on TNReady testing problems

PHOTO: Marta W. Aldrich
State lawmakers are in session at the Tennessee State Capitol in Nashville.

It was an extraordinary day on Capitol Hill in Nashville and, in many ways, unprecedented.

As reports of more problems with Tennessee’s standardized test escalated from their public schools back home, members of the General Assembly overwhelmingly approved a sweeping measure to pull this year’s TNReady scores from accountability systems for students, teachers, schools, and districts.

A spokeswoman said Gov. Bill Haslam will sign the legislation.

The votes circumvented the legislature’s committee process but, after days of technical problems with the state’s return to online testing, lawmakers had reached a boiling point. In the midst of an election year, they rose to their feet and, one after another, railed against the Department of Education and its testing company, Questar, for their oversight of the beleaguered test.

Get more stories like this in your inbox!
Sign up for Chalkbeat newsletters here, and get the education news you care about delivered daily.

At midday, the Senate and House convened a conference committee as a bipartisan coalition of House members used passage of the state’s $37.5 billion budget as a bargaining chip. With lawmakers going back and forth to the governor’s office to confer, they tacked on their amendment to a bill sponsored by Rep. Eddie Smith of Knoxville and Sen. Dolores Gresham of Somerville.

“The camel was already loaded down heavy, but this was the straw that broke the camel’s back,” Smith said of more testing glitches on Thursday. “The circumstances were so extraordinary that going through the traditional committee process did not serve our teachers or students. That’s why we did what we did.”

What they did was pass a bill to:

  • Let local school boards determine, between a range of 0 and 15 percent, what TNReady scores will count toward students’ final grades;
  • Prevent local districts from using the scores for any decisions related to hiring, firing, or compensating teachers;
  • Ensure that none of this year’s TNReady data can be used to put a school on the “priority list” of lowest-performing schools eligible for state intervention; and
  • Nix the use of TNReady data in determining A-F ratings for schools, a system that’s to begin this fall

“It was clear many members of the General Assembly wanted to address concerns related to the recent administration of state assessments,” Haslam spokeswoman Jennifer Donnals said in a statement. “The governor understands these concerns and did not oppose the legislation.”

The decision means Tennessee will take a breath as it seeks to fix its broken testing system, which has been snakebit from the outset. In 2016, Education Commissioner Candice McQueen canceled most testing after TNReady’s new online platform collapsed under the weight of statewide testing on newly minted digital devices. The next year, Tennessee reverted to mostly paper-and-pencil tests, but there were scoring and score delivery issues under new vendor Questar.

This week, when the third year of testing launched, McQueen had been more confident under a gradual transition to online testing beginning with high school students. But on Monday, a login issue stopped testing in its tracks. Tuesday was worse, as Questar’s system shut down because of an alleged cyber attack.

“What you heard today is that, until we get testing right, we want to make sure our teachers, students and schools are not impacted,” Smith told Chalkbeat when the dust had settled on Thursday.

“We’re still going to move forward with our accountability system. We’ll still see what the data shows this year. But we want to make sure the data isn’t skewed. We want to make sure it’s reliable.”

News of the pause drew immediate cheers from teacher groups.

“The legislature made sure students, teachers and schools were protected against the failures of TNReady,” said Jim Wrye, a lobbyist for the Tennessee Education Association, commending lawmakers for taking “decisive action.”

“We are very pleased legislators ensured that employment or compensation decisions based on the data cannot be used,” added JC Bowman, executive director of Professional Educators of Tennessee.

But others warned that systems for holding teachers and schools accountable are key to ensuring an equitable education for all students.

“While we are dismayed that there were issues with the online TNReady tests, we believe that assessments are the clearest way to gauge what students know, and how well schools are serving all students,” said Gini Pupo-Walker of the Tennessee Educational Equity Coalition.

“Tennessee has made great progress by raising expectations, creating high standards and implementing TNReady,” Pupo-Walker said, “and it is important to continue to assess students every year on their mastery in the core content areas.”

Correction: April 19, 2018: This story has been corrected to show that both the Senate and the House approved the bill on Friday. A previous version said the Senate had recessed and would vote Monday on the House-approved bill.

exceptions to the rule

The highs and lows of Colorado education are spotlighted in ‘The Outliers’

PHOTO: Chalkbeat file
Students at Sheridan's Fort Logan Elementary collaborate on a literacy lesson.

The Boulder Valley School District serves a largely affluent population with highly educated parents. In Sterling on the Eastern Plains, fewer than 1 in 6 adults has a bachelor’s degree. But both the Boulder district and the Valley Re-1 district serving Sterling send a large portion of their graduates to college, and few of them need remediation classes when they get there.

Those are just two of the findings in a new report from the Denver-based education reform advocacy group A Plus Colorado that examines both exemplary and struggling districts. A Plus focuses on data analysis to drive public support for policy changes. This is the second year that A Plus has released “The Outliers,” which is intended to help educators find models to emulate.

The report notes success stories like DSST: Stapleton High School, part of the Denver-based charter network, which posted the state’s highest average SAT scores for white students, black students and students from low-income families. Its Hispanic students also posted SAT scores that were among the highest in the state.

Among the report’s nuanced findings, the tiny Sheridan district south of Denver sends relatively few students to college, with many later needing remediation. But the district has made big strides in the graduation rate of homeless students, who make up 25 percent of its students. In 2016, 64 percent of its homeless students graduated, compared with 53 percent for the state and 42 percent in Denver.

Here are four takeaways from the report:

The numbers only tell so much.

The report shows schools where students from low-income families — as measured by free- and reduced-price lunch rates — do well on elementary math tests or middle school language arts, and where Hispanic students graduate at high rates or have good SAT scores. However, it doesn’t explain just how those schools succeed.

CEO Van Schoales said A Plus Colorado isn’t able to visit all districts and schools to research what they’re doing right, but he hopes the report can still be a resource for principals and superintendents.

“Folks need to spend the time to get to understand the places where most kids are getting to standards or graduating or showing growth,” he said. “There can be an echo chamber in education around the cool places or what’s hot. This report is the data. There are a lot of places doing great work.”

Small districts are just as capable of serving at-risk students as large ones.

The first year of “The Outliers” only looked at the 76 districts serving at least 1,000 students. This year, the report looks at roughly 120 districts with publicly available data. Small districts are more likely to be outliers in both good and bad ways. With fewer students overall, it doesn’t take many students to significantly boost or drag down achievement percentages.

The researchers found small school districts serving low-income and diverse student populations and getting good outcomes.

“A lot of school districts think that the bigger you are, the more capacity you have and the more good you can do, and our report shows that that is not necessarily true,” Schoales said. “You can find school districts doing well by low-income kids all over Colorado and ones that are not.”

Online schools need a lot more scrutiny.

The report found that students in online schools do worse even than students in low-performing brick-and-mortar schools, and that when districts open online schools, it pulls down districtwide performance.

The Byers district east of Denver, where 82 percent of students attend online schools, and Colorado Digital BOCES, a cooperative collection of online schools, showed some of the lowest academic growth in the state, the report found.

“In theory, it sounds great,” but most online schools are not working for their students, Schoales said.

This is not a new concern. A 2016 investigation by Education Week raised serious questions about the operation of GOAL Academy online schools. But the sector continues to expand, with A Plus calling it “one of the fastest growing segments within the Colorado educational ecosystem.”

Colorado suppresses so much student data that it’s hard to get a complete picture.

Colorado has strict data privacy rules that lead to the suppression of student achievement information from small batches and sometimes even larger groups of students. As a result, A Plus Colorado said it doesn’t know whether the 300 black students in the Boulder Valley School District or the 366 students in Manitou Springs who qualify for free- and reduced-price lunch are meeting grade-level expectations.

That’s because the state redacts scores whenever fewer than four students score at a particular proficiency level, and then shields additional scores from other groups and even other schools to further obscure the data.

A Plus says this 3-year-old policy makes it impossible to discern how certain groups of students are performing.

Complete test data is available to district officials, but Schoales said that’s not good enough. If they and the public can’t compare among school districts, they don’t know how much better they could be doing.

“The public and policy makers need to know what’s working and where we can learn from,” Schoales said.

Read the rest of the report, with lots of district- and school-level information, here: