essa watch

Growth plus proficiency? Why states are turning to a hybrid strategy for judging schools (and why some experts say they shouldn’t)

A compromise in a long-running debate over how to evaluate schools is gaining traction as states rewrite their accountability systems. But experts say it could come with familiar drawbacks — especially in fairly accounting for the challenges poor students face.

Under No Child Left Behind, schools were judged by the share of students deemed proficient in math and reading. The new federal education law, ESSA, gives states new flexibility to consider students’ academic growth, too.

This is an approach that some advocates and researchers have long pushed for, saying that is a better way to judge schools that serve students who start far below proficiency.

But some states are proposing measuring academic growth through a hybrid approach that combines both growth and proficiency. (That’s in addition to using proficiency metrics where they are required.) A Chalkbeat review of ESSA plans found that a number of places plan to use a hybrid metric to help decide which of their schools are struggling the most, including Arizona, Connecticut, Delaware, Louisiana, Massachusetts, and Washington D.C.

The idea has a high-profile supporter: The Education Trust, a civil rights and education group now headed by former U.S. Education Secretary John King. But a number of researchers say the approach risks unfairly penalizing high-poverty schools and maintaining some of the widely perceived flaws of No Child Left Behind.

These questions have emerged because ESSA, the new federal education law, requires states to use academic and other measures to identify 5 percent of their schools as struggling. States have the option to include “academic progress” in their accountability systems, and many are doing so.

This is a welcome trend, says Andrew Ho of Harvard, who has written a book on the different ways to measure student progress. Systems that use proficiency percentages alone, rather than accounting for growth, “are a disaster both for measurement and for usefulness,” Ho said. “They are extremely coarse and dangerously misleading.”

Under a growth-to-proficiency model, Student A would be considered on track to proficiency by grade 6 based on the growth from grades 3 to 4, but students B and C would not. (Image: Ho’s “A Practitioner’s Guide to Growth Models”)

States that propose using this hybrid measure — commonly called “growth to proficiency” or “growth to standard” — have offered varying degrees of specificity in their plans about how they will calculate it. The basic idea is to measure whether students will meet or maintain proficiency within a set period of time, assuming they continue to grow at the same rate. Schools are credited for students deemed on track to meet the standard in the not-too-distant future, even if the students aren’t there yet.

This tends to rewards schools that serve students who are already near, at, or above the proficiency standard, meaning that schools with a large number of students in poverty will likely get lower scores on average.

It also worries researchers wary of re-creating systems that incentivize schools to focus on students near the proficiency bar, as opposed to those far below or above it. That phenomenon has been observed in some research on accountability systems focused on proficiency.

“As an accountability metric, growth-to-proficiency is a terrible idea for the same reason that achievement-level metrics are a bad idea — it is just about poverty,” said Cory Koedel, an economist at the University of Missouri who has studied school accountability. He has argued that policymakers should try to ensure ratings are not correlated with measures of poverty.

Researchers tend to say that the strongest basis for sorting out the best and worst schools (at least as measured by test scores) is to rely on sophisticated value-added calculations. Those models control for where students start, as well as demographic factors like poverty.

“If there are going to be high stakes — and I don’t suggest that there should be — then the more technically rigorous value-added models become the best way to approach teacher- and school-level accountability,” said Ho.

A large share of states are planning to use a value-added measure or similar approach as part of their accountability systems, in several cases alongside the growth-to-proficiency measure.

Some research has found that these complex statistical models can be an accurate gauge of how teachers and schools affect students’ test scores, though it remains the subject of significant academic debate.

But The Education Trust, which has long backed test-based accountability, is skeptical of these growth models, saying that they water down expectations for disadvantaged students and don’t measure whether students will eventually reach proficiency.

“Comparisons to peers won’t reveal whether that student will one day meet grade-level standards,” the group’s Midwest chapter stated in a report on Michigan’s ESSA state plan. “This risks setting lower expectations for students of color and low-income students, and does not incentivize schools to accelerate learning for historically underserved student groups.”

In an email Natasha Ushomirsky, EdTrust’s policy director, said the group supports measures like growth to proficiency over value-added models “because a) they do a better job of communicating expectations for raising student achievement, and b) they can be used to understand whether schools are accelerating learning for historically underserved students, and prompt them to do so.”

Of the value-added approach, Ushomirsky said, “A lower-scoring student is likely to be compared only to other lower-scoring students, while a higher-scoring student is compared to other higher-scoring students. This means that the same … score may represent very different amounts of progress for these two students.”

Marty West, a professor at Harvard, says the most prudent approach is to report proficiency data transparently, but to use value-added growth to identify struggling schools for accountability purposes.

“There are just too many unintended consequences from using [proficiency] or any hybrid approach as the basis of your performance evaluation system,” he said.

“The most obvious is making educators less interested in teaching in [high-poverty] schools because they know they have an uphill battle with respect to any accountability rating — and that’s the last thing we want.”

This story has been updated to include additional information from Education Trust.

Who's In Charge

Who’s in charge of rethinking Manual High School’s ‘offensive’ mascot?

PHOTO: Scott Elliott/Chalkbeat
Manual High School is one of three Indianapolis schools managed by Charter Schools USA.

As other schools in Indiana and across the nation have renounced controversial team names and mascots in recent years, Emmerich Manual High School in Indianapolis has held onto the Redskins.

One of the reasons why the school hasn’t given it up, officials said during a state board of education meeting this week, is because it’s unclear whose responsibility it would be to change the disparaging name.

Is it the obligation of the district, Indianapolis Public Schools, which owns the building and granted the nickname more than 100 years ago?

Is it the duty of the charter operator, Charter Schools USA, which currently runs the school?

Or is it the responsibility of the state, which took Manual out of the district’s hands in 2011, assuming control after years of failing grades?

“I don’t care who’s responsible for it,” said Indiana State Board of Education member Gordon Hendry, as he acknowledged the uncertainty. “I think it’s high time that that mascot be retired.”

The mascot debate resurfaced Wednesday as state officials considered the future of Manual and Howe high schools, which are approaching the end of their state takeover. Charter School USA’s contracts to run the schools, in addition to Emma Donnan Middle School, are slated to expire in 2020, so the schools could return to IPS, become charter schools, or close.

Manual is only one of two Indiana schools still holding onto the Redskins name, a slur against Native Americans. In recent years, Goshen High School and North Side High School in Fort Wayne have changed their mascots in painful processes in which some people pushed back against getting rid of a name that they felt was integral to the identity of their communities.

Knox Community High School in northern Indiana also still bears the Redskins name and logo.

“The term Redskins can be absolutely offensive,” said Jon Hage, president and CEO of Charter Schools USA. “We’ve had no power or authority to do anything about that.”

He suggested that the state board needs to start the process, and that the community should have input on the decision.

An Indianapolis Public Schools official told Chalkbeat the district didn’t have clear answers yet on its role in addressing the issue.

Even if the state board initiates conversations, however, member Steve Yager emphasized that he does not want the state to make the decision on the mascot.

“We don’t have to weigh in on that,” Yager said. “I feel like that’s a local decision.”

reaction

Tennesseans reflect on Candice McQueen’s legacy leading the state’s schools

PHOTO: Caroline Bauman
Education Commissioner Candice McQueen speaks with Arlington High School students during a school visit Tuesday that kicked off a statewide tour focused on student voices.

As Candice McQueen prepares to leave her role as Tennessee education commissioner in January, education leaders, advocates, and parents are weighing in on her impact on the state’s schools.

McQueen 44, will become the CEO of National Institute for Excellence in Teaching in mid-January after about four years under the outgoing Gov. Bill Haslam administration.

Her tenure has been highlighted by overhauling the state’s requirements for student learning, increasing transparency about how Tennessee students are doing, and launching a major initiative to improve reading skills in a state that struggles with literacy. But much of the good work has been overshadowed by repeated technical failures in Tennessee’s switch to a computerized standardized test — even forcing McQueen to cancel testing for most students in her second year at the helm. The assessment program continued to struggle this spring, marred by days of technical glitches.

Here are reactions from education leaders and thinkers across the state:

Gini Pupo-Walker, senior director of education policy and programs at Conexión Américas:

“It was her commitment to transparency, equity, and strong accountability that helped create a nationally recognized framework that places students at its center. Commissioner McQueen’s commitment to inclusion and engagement meant that our partners across the state had the opportunity to weigh in, share their experiences, and to ask hard questions and conduct real conversations with policymakers. Tennessee continues to lead the nation in innovation and improvement in K-12 education, and that is due in no small part to Commissioner McQueen’s leadership.”

Shawn Joseph, superintendent of Metro Nashville Public Schools, who in August co-penned a letter declaring “no confidence” in state testing:

“Since joining MNPS just over two years ago, I’ve had the pleasure of working closely with Commissioner McQueen and her team. She has been a strong advocate for Tennessee’s children, and I especially want to thank her for her support of the work that is taking place in Nashville. We send her our very best wishes — and our hearty congratulations for accepting her new role.”

JC Bowman, executive director of Professional Educators of Tennessee:

“Commissioner Candice McQueen is one of the most visible members of the Haslam Administration. She took over the department during a dark period in public education, and she made a significant difference within the department, particularly in the infrastructure. Those changes are not readily noticeable, as they include systems, processes and human capital. There are some exceptional people within the Department of Education working to make public education a success in our state. It is unfortunate that online testing continues to be a point of contention, but the state is moving in a positive direction. The next Commissioner of Education and the 111th Tennessee General Assembly will need to make adjustments in student assessment as we move forward.   We will always be grateful to Commissioner McQueen for her unwavering support of increasing teacher salaries and commitment to student literacy.”

Sharon Griffin, leader of the state-run Achievement School District:

“I have truly appreciated Dr. McQueen’s leadership and vision for the Department of Education.  From a distance and even closer in recent months, I have clearly seen the integrity and passion she brings to the work of improving student outcomes.  We have absolutely connected around our shared belief in how what’s in the best interest of students should guide our work.”

Jamie Woodson, CEO of SCORE:

“Tennessee students have been served very well by the steady and strong leadership of Commissioner McQueen. Her priorities have been the right ones for our children: improving student achievement, with a specific focus on reading skills; advocating for great teaching and supporting teachers to deliver high-quality instruction; and emphasizing that students and schools with the greatest needs must receive targeted focus and support in order to improve.”

Sarah Carpenter, executive director of parent advocacy group Memphis Lift:

“Memphis parents want decision makers to be accessible, and we appreciate that Commissioner McQueen made a point to build relationships and hear concerns from the entire community. Hopefully, the next education commissioner will bring parents to the table for conversations about our kids’ education.”

Mendell Grinter, leader of Memphis student advocacy group Campaign for School Equity:

“In our collaborative work and position in the educational landscape, we have witnessed firsthand how Commissioner McQueen has served as a tireless advocate for students and families in Tennessee. Over the past two years her leadership has inspired school leaders, and teachers alike to recognize the sense of urgency for improving school equity and academic outcomes for more students.”

Andy Spears, author of Tennessee Education Report and vocal critic of state test, TNReady:

“After what can charitably be called a rocky tenure at the helm of the Tennessee Department of Education, Candice McQueen has miraculously landed another high-level job. This time, she’ll take over as CEO of the National Institute for Excellence in Teaching, an organization apparently not at all concerned about the track record of new hires or accountability.”

Beth Brown, president of Tennessee Education Association:

“As candidates for the state’s next commissioner of education are considered, it is my hope that serious consideration is given to an individual’s experience in our own Tennessee public schools… Students and educators are struggling with two major issues that must be tackled by the next commissioner: high-stakes standardized tests and a lack of proper funding for all schools. Our schools need a leader who understands that the current test-and-punish system is not helping our students succeed. Governor Bill Haslam has made significant increases in state funding for public education, but there is still much work to be done to ensure every child has the resources needed for a well-rounded public education.”