Tag Archives: value added

New York City Teacher Performance Data To Be Released

Yup, it has finally happened. New York State’s highest court threw out the union’s lawsuit to prevent the release of performance scores of over 12,000 NYC teachers of elementary and middle school. The city plans to publicize the scores in the coming weeks.

Walcott doesn’t seem too keen on the idea, but his tune will change once the mayor for whom he is the sock puppet whispers a few choice words in his ear.

This was the result of a Freedom of Information Act request filed by several media outlets, including the New York Times and NY1. It will be up to those same media outlets if they want to publish the scores or not. We all know what they are going to do.

Despite the fact that the ratings give no other information aside from a number from 1 to 100, despite the fact that it is asinine to summarize a teacher’s skill in a simple number, despite the fact that “value added” has been shown time after time to be utterly useless, and despite the fact that the Los Angeles Times’ campaign to smear teachers with this data resulted in the suicide of dedicated teacher Rigoberto Ruelas in 2010, they will no doubt plaster these numbers far and wide.

Look forward to another spring of teacher-basing, culminating in a renewed attempt by Bloomberg to do away with Last In First Out. This will provide endless grist for the anti-teacher mill. I predict a full front page headline in the New York Post with the words DISGRACEFUL or EXPOSED on the day the scores are released. And if another teacher or two commits suicide (God forbid), that will be good for headlines as well.

Meanwhile, the video on NY1’s website features a frothing-at-the-mouth Michael Mulgrew of the UFT screaming about how the data is flawed. They could not have chosen a better clip to capture the whole “union thug” angle the media in NYC loves to go for.

My hat is off to NYC’s Fourth Estate. You valiantly filed a FOIA request in order to smear teachers. Where are those requests for the unending flood of corrupt OSI and SCI reports used by the DOE to destroy the livelihoods of countless dedicated educators? You know, those same reports that have found to be completely bogus in one court case after another?

First New York City, then New York State. As we speak, I am sure Arne down in D.C. is huddled around a giant marble table with Rupert Murdoch and Joel Klein, devising a nationwide database of teacher performance scores to be published in USA Today and U.S. News and World Report.

 

Coming Soon: More Blogging

"O Captain! My Captain! I'm gonna get canned because my "value added" data stinks.

I am sorry for my silence over the past day or so. It is that time of year when I am buried under final exams and grades.

We base our finals on the Regents Exams, New York State’s long-time standardized tests. As I grade these exams, I see more and more proof that “value added” will wreak havoc on the teaching profession here in  NYC.

Most of my students are bombing their essays. At least a third of that group wrote excellent pieces that did not directly relate to the question being asked. The essay required an examination of two separate presidential decisions, including its reasons and impacts on history.

One student wrote a wonderful piece about Thomas Jefferson, tracing his career from the Declaration of Independence to his death on the 50th anniversary of the Declaration of Independence. It was historically accurate and rich in detail learned from the class. Unfortunately, it missed the point of the essay and I had to grade it low as per the rubric.

But as I read these essays, I saw the true value added. They all know more than what they did before, much more. Many students who received low grades obviously retained tons of information. One student who is an English Language Learner and never wrote a full essay wrote 2 pages of decent history. The value added fundamentalists would disregard these inspiring signs of intellectual growth just so they can have an excuse to fire veteran teachers.

Well, it is 11pm on Sunday night and I still have around 90 essays to grade. These lazy teachers and their cushy schedules.

Enjoy the new week everybody. Things will be back to normal here in a day or two.

The Anatomy of Education Deform

It starts with a study like this one as reported by the New York Times. A bunch of Ivy League economists get together to study the impact of teachers on students.  “Better” teachers were those whose students had improving standardized exam scores. They then track 2.5 million students over the course of several years. Their findings show students who had at least one “good” teacher between the 4th and 8th grades go on to make $4, 600 more than those who only had one “average” teacher. Furthermore, “students with top teachers are less likely to become pregnant as teenagers, more likely to enroll in college, and more likely to earn more money as adults.” The implication is that we need to evaluate teachers by their students’ exam scores and fire the ones that are “bad”. According to one of the economists who conducted the study, John Friedman, “the message is to fire people (teachers) sooner rather than later.”

This is the embryonic stage of an education deformation. By reading its DNA, we discover everything education deform is and what it is capable of doing.

Scientists deal in the world of inanimate facts. They can use laboratories to create controlled environments, allowing them to eliminate variables to discover true cause and effect relationships. While real scientists in all fields have their hot button debates, those debates take place within a wider tradition of consensus on fundamental ideas. Economists and Educationists, on the other hand, are social scientists who generally have no such consensus. They are divided into ideological camps.Economists can be Keynesians or Neoliberals, Salt Water or Fresh Water. Education “experts” are whole language or phonics, constructivists or traditionalists. Their research has no lab and instead has to take place in the wild, so to speak. That means they cannot control for variables, which means they have no way of knowing if that tax cut was really the thing that boosted the economy or that teacher was the thing that boosted test scores. They observe human interactions as literally millions of factors act upon those interactions and then choose one of those factors as the sole “cause”. Despite the pretense of using data, their conclusions are generally shaped by the ideology they wish to support. After all, in the grand scheme of things, all ideologies in the social sciences have been “proven” at some point with data.

Let us assume for now that their contention is true, that you can assess a “good” teacher by their students’ test scores and that bad teachers adversely impact the futures of their students. Why, then, is “the message …to fire people sooner rather than later”? There is nothing in their research that proves firing bad teachers sooner rather than later is a benefit. First, with whom do you replace those bad teachers? First year teachers would be unknown quantities since they cannot be judged by student exam scores. Would it be beneficial to use them over bad teachers? Why fire anyone at all? The message of their research could just as easily be to mentor or support bad teachers so they can become good teachers. Or maybe the message is we need to do another study on what makes the “good” teachers so good and teach that to all the bad ones. There are literally hundreds of conclusions that can be drawn from this research. Out of all of those conclusions, it is curious that Friedman would choose to spout this one. Logically speaking, it does not necessarily follow from his research.

And the research does not necessarily follow any logic of its own. According the manuscript (which you can read here), they looked at 2.5 million students in the same state. They looked at their enrollment histories, previous test scores and household wealth. If their exam scores went down at the end of a school year with a given teacher, they can tell that the teacher had a negative effect size. In the words of the study, “the jump in the teacher’s impact at the end of the grade taught by that teacher suggests that the observed impact on test scores is most likely due to a causal effect of the teacher rather than systematic differences in student characteristics, as such characteristics would have to be uncorrelated with past test scores and only affect the current test score.”

Really?

I teach U.S. History which has a Regents Exam by the end of the school year. The previous year the students take Global History with other teachers, which also culminates in a Regents Exam. Due to scoring rubrics and content, the Global History exam is way tougher than the U.S. History exam. Students who take U.S. History with me generally get higher grades on that exam than they did on the Global exam. Does this mean I am a better teacher than all the teachers of Global? According to this study, the answer is yes. They assume that every test is an equally objective barometer of student achievement. There is no way for the study to control for the varying difficulties of each exam, whether it is the difficulty of the rubric or vocabulary or content. The Global exam also requires kids to remember concepts over a two-year period (Global History is a two-year course), while U.S. History is only one year. Not to mention, students take Global History in their 9th and 10th grades. Everyone knows that 9th and 10th graders are way different than 11th graders. 9th and 10th graders are less mature, less focused and generally in greater danger of dropping out or falling behind. 11th graders are over the hump of their high school years, many of them focusing on getting into college or starting life in the real world. They are young adults, more mature and, yes, generally smarter than kids in previous grades. The economists who did the study, however, believe humans do not change over time. They have fixed “characteristics” as they say, so any change in exam scores must be the result of the teacher. From the top to bottom, the study is wrought with issues like these that fail to take in every single factor that contributes to any given exam score. This makes the study less scientific and more like guesswork.

For these reasons, the conclusion the report makes about the long-term impacts of teachers on students’ live is even more problematic. They say students with good teachers in the younger years go on to have lower rates of teenage pregnancy and higher rates of college admissions and adult earnings. This type of thinking holds teachers responsible for not only the education, but the lifestyle choices of their students, choices made well after the student is out of that teacher’s classroom. Despite the fact that there is no way to account for all the potential causal factors in teenage pregnancy, college admissions and earnings, the economists conclude that teachers have a sizeable impact on these things. There is no accounting for cultural reasons why teenagers might have kids or go to college. The economists assume that just because the students in the study come from the same socioeconomic background, they have controlled for the cultural factor in life decisions. What about a poor kid from a family that sets college as an expectation from a young age? How about a poor kid born to a teenage mother or who lives in a neighborhood where teenage motherhood is common? How can a teacher have an “effect size” over personal decisions made years later? What is the role of the teachers the student has at the time kids make these decisions, teachers who were not part of the study?

Despite all of the problems with studies like this, it will surely become a weapon for the education deformers. They will cite the findings of these three Ivy League economists who conducted the largest and longest study of effect size to date. The reports conclude that we should fire “bad” teachers. The defomers will use this conclusion to ram all types of teacher evaluations into the system, evaluations that are designed to fire not bad teachers, but older teachers that make too much money. The economists and the deformers speak the same language. Instead of talking about kids in the context of their cultures, communities, families and schools, they want to tie kids to teachers and teachers only. It is the problem with all of the social sciences. They take what is essentially an art, whether it is life choices, business or teaching and try to contort it into a scientific study. They create studies that are later used as justification for major policy decisions. Unlike scientists in the physical sciences, the ultimate goal of many social scientists is to have their research politicized by people in power. Each supposedly objective study is really a contestant in the game show of “pick a policy”. The true worth of a study is measured not in the scientific rigor of its findings, but whether or not it shapes policy later on.

Naomi Klein’s The Shock Doctrine describes the role economists have played in privatization schemes around the world. They have been the vanguard of a Neoliberal movement that seeks to privatize every part of the state. Privatization is the favorite policy of Neoliberals everywhere. Public schools are the latest battleground of the Neoliberal push to privatize. The three economists are taking their study on the road, presenting it to journals in hopes it will become a weapon in the policy debate over public schools. Policy makers will point to this “scientific” study as a justification to get rid of tenure and job security in teaching. The general public will unquestioningly embrace it, as they do every fad study that is reported on in the news. There will be more calls for charter schools that do not have things like teacher tenure. In the words of Nobel Prize-winning economist Joe Stiglitz, economics tends to have its fair share of “free market fundamentalists”, people who believe that there should be no public institutions whatsoever.

The three young economists who conducted this study may or not be free market fundamentalists, but they certainly have given the free market fundamentalists in the public school debate a powerful weapon with which to bludgeon public schooling. They are certainly testing fundamentalists and their research assumes the infallible objectivity of standardized exams. In this regard, they are identical to the education deformers.

These economists from this study are education deform ideologues.

Just like deformers, they assume the infallibility of standardized exams. Their research does not even speak to the differences between exams or consider that the exams themselves can be fallible.

Just like deformers, they use that assumption to help conclude that poverty is not destiny. Instead, they all conclude that the teacher is destiny.

Just like education deformers, they say “bad” teachers need to get fired soon, despite the fact that their own research does not necessarily come to this conclusion.

This is not science, it is dogma. What is worse, they use one dogma to prove other dogmas. We will see this study sold as scientific research. What it is really is just another school reform mantra by people with no connection to public school at all. It is just another arrogant set of education deformers who believe their thick assumptions about schools should apply to the education of everyone else’s children.