Evaluating School Reform in the District of Columbia

The National Research Council Makes Its Report, Finally

It feels like forever that DC Public Schools have been known as one of the worst (if not the worst) public school systems in the nation. Low test scores and high dropout rates back up the perception. Twenty years ago, DC School Reform Act of 1995 (a gift from Congress, not a District initiative) gave us charter schools. Many Washingtonians with an investment in the school system (i.e. parents, students, teachers, etc. ) believed that this was the answer. But after ten years, the numbers hadn’t improved—not in the new charters or in the traditional public schools.

In 2007, Mayor Adrian Fenty and his supporters put their money on Michelle Rhee and the Public Education Reform Amendment Act (PERAA). The law gave control of DC Public Schools to the Mayor and more flexibility to administrators like Chancellor Rhee. To make sure that the changes instituted under PERAA worked, the mayor was required to submit either an independent annual evaluation or a five-year evaluation of the DC public school system. Mayor Fenty chose to go with the five-year assessment, which was due September 15, 2012. The National Research Council—the independent agency that received the contract to do the evaluation in 2009— has finally completed their 300-page report An Evaluation of the Public Schools of the District of Columbia: Reform in a Changing Landscape. On June 3, 2015, the Council of the District of Columbia’s Committee on Education held a public round table to discuss the results.

Surprise! Despite more than eight years of mayoral control, DC’s public schools still have ridiculously low test scores and high dropout rates. The Report states:

“while there have been some improvements in the public schools of the District of Columbia since a 2007 reform law, significant disparities remain in learning opportunities and academic progress across student groups and the city’s wards.”

Retired math teacher and stalwart DCPS advocate Guy Brandenburg is not impressed with the results. According to Brandenburg:

“if you care anything about reducing the gaps between achievement levels of white students and those of color, the poor, special ed students, and English language learners (i.e. immigrants), then mayoral control has been a spectacular failure.”

Brandenburg breaks down the numbers in his blog post A Quick Look at the National Academy Report on Mayoral Control of Schools of Washington, DC: “The gaps between the pass rates on the DC-CAS standardized tests of those groups under mayoral control or the Public Education Reform Amendment Act are enormous and have essentially remained unchanged since 2007, when the law was implemented, according to the data in this report.

Note that the report combines the data for both the DC public schools and charter schools, combined, at all grade levels, in both reading and math. Here are two graphs, made by me from data in the report, which show the lack of change. …. HIGH NUMBERS ARE BAD because they show large gaps in proficiency rates. Low numbers are good. Notice that there has been almost no change since mayoral control; some lines go up a tiny bit, some go down a bit, others waver back and forth a bit. Not a success story.”

To rectify the problem, Chancellor Rhee implemented the DCPS Effectiveness Assessment System for School-Based Personnel otherwise known as IMPACT. Believing that DCPS’ failures rested largely with the teachers, Rhee implemented IMPACT in order to weed out the good from the bad. Once done, she would shuffle the deck and place “highly effective” teachers at more difficult schools. But as Brandenburg points out, “every single teacher remaining in DCPS has been repeatedly measured as effective or better. Yet the ratings for teachers at schools with high poverty rates remains much lower than those at schools with low poverty rates … these low-ranked teachers are not holdovers from the ‘bad old days’ – they are either brand-new hires or have been repeatedly measured as good or excellent under IMPACT.”

The report makes several recommendations, including that the city take a more coordinated approach to monitoring learning conditions in schools, such as school environment, discipline, and academic support, to better understand what progress is being made for students.

Mary Filardo executive director of the 21st Century School Fund was interviewed on the radio program, the Education Town Hall. No doubt, she has some recommendations of her own to share. The episode can be found at this page – http://educationtownhall.org/2015/06/10/mayoral-control/. You must scroll down a little to find it.

. . . → Read More: Evaluating School Reform in the District of Columbia

How Well Are Charter Schools in DC Educating Students Who Are Officially At-Risk?

Cross-Posted from GFBrandenburg’s Blog

The results may surprise you.

To answer this question, I used some recent data. I just found out that the DC City Council has begun requiring that schools enumerate the number of students who are officially At-Risk. They define this as students who are

“homeless, in the District’s foster care system, qualify for Temporary Assistance for Needy Families (TANF) or the Supplemental Nutrition Assistance Program (SNAP), or high school students that are one year older, or more, than the expected age for the grade in which the students are enrolled.” (That last group is high school students who have been held back at least one time at some point in their school career.)

So, it’s a simple (but tedious) affair for me to plot the percentage of such at risk students, at each of the roughly 200 publicly-funded schools in Washington, DC, versus the average percentage of students who were proficient or advanced in math and reading on the 2014 DC-CAS.

I was rather shocked by the results. Here are my main conclusions:

1. For almost all of the schools, to get a rough idea of the percent of students passing the DC-CAS, simply subtract 90% minus the number of students ‘At-Risk’. The correlation is very, very strong.

2. There are only THREE DC charter schools with 70% or more of their students At-Risk, whereas there are THIRTY-ONE such regular public schools. So much for the idea that the charter schools would do a better job of educating the hardest-to-reach students (the homeless, those on food stamps, those who have already failed one or more grades, etc).

3. The only schools that have more than 90% of their students ‘passing’ the DC-CAS standardized tests remain, to this day, the small handful of schools in relatively-affluent upper Northwest DC with relatively high percentages of white and Asian students..(Unless you include Sharpe Health school, where students who cannot feed or dress themselves or hold a pencil are somehow deemed ‘proficient’ or ‘advanced’ by methods I can only guess at…)

4. As I’ve indicated before, it appears that for the most part, DC’s charter schools are mostly enrolling smaller percentages of At-Risk, high-poverty students but higher fractions of the students in the middle of the wealth/family-cohesion spectrum than the regular DC public schools. There are a few exceptions among the charter schools: BASIS, Yu Ying, Washington Latin and a few others are succeeding in attracting families and students at the high end of the socio-economic and academic scales.

5. It looks like we are now turning into a tripartite school system: one for affluent and well-educated familes (relatively high fractions of whites and Asians; mostly but not all in regular Ward 3 public schools); one for those in the middle (mostly blacks and hispanics, many enrolled in charter schools), and one for those at the seriously low end of the socio-economic spectrum, overwhelmingly African-American, largely At Risk, and mostly in highly-segregated regular public schools.

Very, very sad.

Here is the graph that sums it all up. Click on it to see a larger version.

In blue we have the regular public schools of Washington DC for which I have DC-CAS data for 2014, from grades 3 through 8 and grade 10. In red we have the privately-run but publicly-funded charter schools. Along the horizontal axis, we have the percentage of students who are officially At Risk as defined by the DC CIty Council. Along the vertical axis, we have the average percentage of students who scored ‘proficient’ or ‘advanced’ in math and reading on the DC-CAS at those schools. The green line is the line of best fit as calculated by Excel. Notice that the data points pretty much follow that green line, slanting down and to the right.

To nobody’s surprise, at both the charter and regular public schools, on the whole, the greater the percentage of students at a school who are At Risk, the smaller the percentage of students who ‘pass’ the DC-CAS standardized tests.

The colors do help us see that at the far right-hand end of the graph, there are lots of blue dots and only a small number of red ones. This means that the vast majority of schools with high percentages of At Risk students are regular DC public schools. You could interpret that to mean that parents in more stable families in those neighborhoods are fleeing from what they see as the bad influence of potential classmates who are extremely . . . → Read More: How Well Are Charter Schools in DC Educating Students Who Are Officially At-Risk?