Publishing Teacher Rankings

A recently reported story here has raised the old argument about teacher performance yet again. Certainly, I understand that parents worry about their children and worry about having the best teacher; however, a major concern is when students and parents try to ‘teacher shop’. Schools have appraisal systems and methods of evaluating teachers, the ultimate aim is to improve the learning of all students, not to identify and shun weak teachers. 

School unions in my country and other western countries usually decry the practice of trying to rank schools and/or teachers. I know that different teachers have different levels of pedagogical performance, but that can vary, students all have different learning styles and thus different students will respond to different teachers, that does not make one teacher better than another.

Education is also a collaborative effort; the Year 12 English teacher is not solely responsible for the results, good or bad of his English class, twelve or more years of education have moulded the students language skills, same too mathematics or science.

Our school has considered using Key Performance Indicators (KPI’s) to measure ourselves and has also, from time to time, considered Performance Based Pay. While I am not fundamentally opposed to the concept, per se, I really struggle to see how it could be applied fairly and equitably across the whole school.

However, I can say that sites like or the LA Times publishing a ranking list of 6,000 teachers is counter productive and results in bullying. As this website points out, teachers need to be evaluated and need to improve their craft, but public ‘outing’ is not going to do that.

Article reprinted here for convenience.

Reporting of Teacher Performance

By Walt Gardner on February 27, 2012 7:18 AM

It had to happen sooner or later. Sixteen months after the Los Angeles Times published rankings of 6,000 third- through fifth-grade teachers in the Los Angeles Unified School District that it compiled from seven years of math and English scores, news organizations under the Freedom of Information Law finally received data on 18,000 teachers in the New York City school system when a state court declined to hear a last ditch appeal from the teachers union to keep the information private. In quick order, The New York Times published the names of teachers and their schools, and their ranking based on their students’ gains on state standardized tests in math and English over five years until the 2009-10 school year (“City’s Ratings of 18,000 Teachers Indicate That Quality Is Widely Diffused,” The New York Times, Feb. 25).

The rationale was that parents have the right to know how their children’s teachers rank. It’s a compelling argument if it can be proved that publication of ratings leads to better instruction. But it doesn’t. For one thing, there is what newspapers report as a huge margin or error in the New York City case. (Actually, the correct term in educational testing is measurement error.) A teacher’s score could be 35 points off on the math exam, or 53 points off on the English exam. These numbers hardly instill confidence. For another, teachers who teach English language learners, special education students and disadvantaged students receive lower scores than when they teach affluent students. This raises the question of fairness. Finally, the practice relies on the alleged benefits of naming and shaming, which even Bill Gates opposes (“Shame Is Not the Solution,” The New York Times, Feb. 23).

In an attempt to mollify critics, The New York Times offered teachers an opportunity to respond to ratings that they considered unwarranted for one reason or another (“Teachers: An Invitation to Respond to Your Data Report,” Feb. 23). It’s better than nothing, but it’s a sop. The New York Post patted itself on the back in a news story that began: “City parents gave The Post an A-plus yesterday for publishing teacher-evaluation data that revealed valuable information about the educators who are leading their children” (“Parents praise release of NYC public school teacher ratings,” Feb. 26).

The issue of evaluating teachers was comprehensively addressed by the Economic Policy Institute in a briefing paper it released on Aug. 29, 2010 (“Problems With the Use of Student Test Scores to Evaluate Teachers“). Ten respected scholars concluded that the value-added metric should be used with “caution.” I don’t doubt that it can provide some useful information, but that is not the way it is being implemented. Value-added results constitute a disproportionate part of teacher evaluations. I grant that no system of teacher evaluation is perfect. There will always be aspects that are controversial. However, when so much depends on the results of student test scores, it’s imperative that more compelling evidence be presented about the value-added metric to assure confidence.

I can’t think of data reports with a similar margin of error in any other field that have received such prominent coverage. In fact, most editors would in all likelihood dismiss out of hand any study with such shaky statistics. The imprecision alone would constitute a red flag. Aaron Pallas put it best: “For teachers, the key concern is fairness. Fairness is primarily a procedural issue: Teachers, and the unions that represent them, seek an evaluation process that is neither arbitrary nor capricious, relying on stable and valid criteria that they believe accurate characterize the quality of their work” (“Reasonable doubt,” Eye on Education, Feb. 6).

In a court of law in this country, prosecutors have to prove beyond a reasonable doubt that a defendant is guilty of a crime in order to get a conviction, or lawyers have to provide a preponderance of evidence in a civil trial to win their case. But in the court of public opinion, neither standard must be met to prove that teachers are guilty of ineffectiveness. This makes a travesty of what is taking place.”


About Pak Liam

Living, teaching and traveling in Asia.
This entry was posted in administration, Best Practise and tagged , , , , , , , , , , . Bookmark the permalink.

3 Responses to Publishing Teacher Rankings

  1. Although teacher performance is an important issue, and measuring it is requisite toward maintaining a functional educational system, what we need just as much is the measuring of administrator performance.

    Private industry uses the 360 approach when performing annual reviews. Teachers should be evaluated by their students, peers and supervisors. Moreover, administrators should be evaluated by teachers.

    After talking with numerous teachers regarding our “broken educational system,” it has become apparent that teacher underperformance is only part of the issue, and that a much bigger part comes from administrator corruption and/or incompetence.

    Dr. Joseph Lennox

    • Pak Liam says:

      Our school trialed 360 degree evaluation a couple of years ago, unfortunately we found it unwieldy and cumbersome to apply for all staff. We also had a rather low rate of return of evaluations across all parents, students and staff meaning that the results were based on a small number of respondents and thus not so reliable.

      However, I totally agree with your comment about administrators needing to be appraised, measured and checked. (in an ideal world even school boards would be regularly appraised).

  2. Pingback: Publishing Teacher Rankings | MYP @ Global Jaya International ... | International Baccalaureate Program |

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s