essa watch

Growth plus proficiency? Why states are turning to a hybrid strategy for judging schools (and why some experts say they shouldn’t)

PHOTO: Alan Petersime

A compromise in a long-running debate over how to evaluate schools is gaining traction as states rewrite their accountability systems. But experts say it could come with familiar drawbacks — especially in fairly accounting for the challenges poor students face.

Under No Child Left Behind, schools were judged by the share of students deemed proficient in math and reading. The new federal education law, ESSA, gives states new flexibility to consider students’ academic growth, too.

This is an approach that some advocates and researchers have long pushed for, saying that is a better way to judge schools that serve students who start far below proficiency.

But some states are proposing measuring academic growth through a hybrid approach that combines both growth and proficiency. (That’s in addition to using proficiency metrics where they are required.) A Chalkbeat review of ESSA plans found that a number of places plan to use a hybrid metric to help decide which of their schools are struggling the most, including Arizona, Connecticut, Delaware, Louisiana, Massachusetts, and Washington D.C.

The idea has a high-profile supporter: The Education Trust, a civil rights and education group now headed by former U.S. Education Secretary John King. But a number of researchers say the approach risks unfairly penalizing high-poverty schools and maintaining some of the widely perceived flaws of No Child Left Behind.

These questions have emerged because ESSA, the new federal education law, requires states to use academic and other measures to identify 5 percent of their schools as struggling. States have the option to include “academic progress” in their accountability systems, and many are doing so.

This is a welcome trend, says Andrew Ho of Harvard, who has written a book on the different ways to measure student progress. Systems that use proficiency percentages alone, rather than accounting for growth, “are a disaster both for measurement and for usefulness,” Ho said. “They are extremely coarse and dangerously misleading.”

Under a growth-to-proficiency model, Student A would be considered on track to proficiency by grade 6 based on the growth from grades 3 to 4, but students B and C would not. (Image: Ho’s “A Practitioner’s Guide to Growth Models”)

States that propose using this hybrid measure — commonly called “growth to proficiency” or “growth to standard” — have offered varying degrees of specificity in their plans about how they will calculate it. The basic idea is to measure whether students will meet or maintain proficiency within a set period of time, assuming they continue to grow at the same rate. Schools are credited for students deemed on track to meet the standard in the not-too-distant future, even if the students aren’t there yet.

This tends to rewards schools that serve students who are already near, at, or above the proficiency standard, meaning that schools with a large number of students in poverty will likely get lower scores on average.

It also worries researchers wary of re-creating systems that incentivize schools to focus on students near the proficiency bar, as opposed to those far below or above it. That phenomenon has been observed in some research on accountability systems focused on proficiency.

“As an accountability metric, growth-to-proficiency is a terrible idea for the same reason that achievement-level metrics are a bad idea — it is just about poverty,” said Cory Koedel, an economist at the University of Missouri who has studied school accountability. He has argued that policymakers should try to ensure ratings are not correlated with measures of poverty.

Researchers tend to say that the strongest basis for sorting out the best and worst schools (at least as measured by test scores) is to rely on sophisticated value-added calculations. Those models control for where students start, as well as demographic factors like poverty.

“If there are going to be high stakes — and I don’t suggest that there should be — then the more technically rigorous value-added models become the best way to approach teacher- and school-level accountability,” said Ho.

A large share of states are planning to use a value-added measure or similar approach as part of their accountability systems, in several cases alongside the growth-to-proficiency measure.

Some research has found that these complex statistical models can be an accurate gauge of how teachers and schools affect students’ test scores, though it remains the subject of significant academic debate.

But The Education Trust, which has long backed test-based accountability, is skeptical of these growth models, saying that they water down expectations for disadvantaged students and don’t measure whether students will eventually reach proficiency.

“Comparisons to peers won’t reveal whether that student will one day meet grade-level standards,” the group’s Midwest chapter stated in a report on Michigan’s ESSA state plan. “This risks setting lower expectations for students of color and low-income students, and does not incentivize schools to accelerate learning for historically underserved student groups.”

In an email Natasha Ushomirsky, EdTrust’s policy director, said the group supports measures like growth to proficiency over value-added models “because a) they do a better job of communicating expectations for raising student achievement, and b) they can be used to understand whether schools are accelerating learning for historically underserved students, and prompt them to do so.”

Of the value-added approach, Ushomirsky said, “A lower-scoring student is likely to be compared only to other lower-scoring students, while a higher-scoring student is compared to other higher-scoring students. This means that the same … score may represent very different amounts of progress for these two students.”

Marty West, a professor at Harvard, says the most prudent approach is to report proficiency data transparently, but to use value-added growth to identify struggling schools for accountability purposes.

“There are just too many unintended consequences from using [proficiency] or any hybrid approach as the basis of your performance evaluation system,” he said.

“The most obvious is making educators less interested in teaching in [high-poverty] schools because they know they have an uphill battle with respect to any accountability rating — and that’s the last thing we want.”

This story has been updated to include additional information from Education Trust.

Who Is In Charge

Indianapolis Public Schools board gives superintendent Ferebee raise, bonus

PHOTO: Dylan Peers McCoy
Lewis Ferebee

Indianapolis Public Schools Superintendent Lewis Ferebee is getting a $4,701 raise and a bonus of $28,000.

The board voted unanimously to approve both. The raise is a 2.24 percent salary increase. It is retroactive to July 1, 2017. Ferebee’s total pay this year, including the bonus, retirement contributions and a stipend for a car, will be $286,769. Even though the bonus was paid this year, it is based on his performance last school year.

The board approved a new contract Tuesday that includes a raise for teachers.

The bonus is 80 percent of the total — $35,000 — he could have received under his contract. It is based on goals agreed to by the superintendent and the board.

These are performance criteria used to determine the superintendent’s bonus are below:

Student recruitment

How common is it for districts to share student contact info with charter schools? Here’s what we know.

PHOTO: Laura Faith Kebede
Staff members of Green Dot Public Schools canvass a neighborhood near Kirby Middle School in the summer of 2016 before reopening the Memphis school as a charter.

As charter schools emerge alongside local school districts across the nation, student addresses have become a key turf war.

Charter schools have succeeded in filling their classes with and without access to student contact information. But their operators frequently argue that they have a right to such information, which they say is vital to their recruitment efforts and gives families equal access to different schools in their area.

Disputes are underway right now in at least two places: In Tennessee, school boards in Nashville and Memphis are defying a new state law that requires districts to hand over such information to charters that request it. A New York City parent recently filed a formal complaint accusing the city of sharing her information improperly with local charter schools.

How do other cities handle the issue? According to officials from a range of school districts, some share student information freely with charters while others guard it fiercely.

Some districts explicitly do not share student information with charter schools. This includes Detroit, where the schools chief is waging an open war with the charter sector for students; Washington, D.C., where the two school sectors coexist more peacefully; and Los Angeles.

Others have clear rules for student information sharing. Denver, for example, set parameters for what information the district will hand over to charter schools in a formal collaboration agreement — one that Memphis officials frequently cite as a model for one they are creating. Baltimore and Boston also share information, although Boston gives out only some of the personal details that district schools can access.

At least one city has carved out a compromise. In New York City, a third-party company provides mass mailings for charter schools, using contact information provided by the school district. Charter schools do not actually see that information and cannot use it for other purposes — although the provision hasn’t eliminated parent concerns about student privacy and fair recruitment practices there.

In Tennessee, the fight by the state’s two largest districts over the issue is nearing a boiling point. The state education department has already asked a judge to intervene in Nashville and is mulling whether to add the Memphis district to the court filing after the school board there voted to defy the state’s order to share information last month. Nashville’s court hearing is Nov. 28.

The conflict feels high-stakes to some. In Memphis, both local and state districts struggle with enrolling enough students. Most schools in the state-run Achievement School District have lost enrollment this year, and the local district, Shelby County Schools, saw a slight increase in enrollment this year after years of freefall.

Still, some charter leaders wonder why schools can’t get along without the information. One Memphis charter operator said his school fills its classes through word of mouth, Facebook ads, and signs in surrounding neighborhoods.

“We’re fully enrolled just through that,” said the leader, who spoke on condition of anonymity to protect his relationship with the state and local districts. “It’s a non-argument for me.”

A spokeswoman for Green Dot Public Schools, the state-managed charter school whose request for student information started the legal fight in Memphis, said schools in the Achievement School District should receive student contact information because they are supposed to serve students within specific neighborhood boundaries.

“At the end of the day, parents should have the information they need to go to their neighborhood school,” said the spokeswoman, Cynara Lilly. “They deserve to know it’s open.”