I feel the problem isn't that there is standardized testing. The problem is that it's "do or die" standardized testing. A well above average student that's poor at taking tests (which seems to be due to the stress of this sort of testing), you get poor scores. If we're talking about an average student that's good at taking tests, they will show to be average. They're good at taking tests.
Then we have legislation that expects every student to show the same growth per year. An ESE student may never show growth. You can't expect a student that is only expected to learn life skills to show the same growth as an average student.
Teachers should be graded, but not by the current model. I agree that it should be more by the administration and less by test scores. You can tell which teachers are good teachers. Heck, I can tell which teachers are good teachers as a substitute teacher. For some, teaching is a paycheck. They really shouldn't be teachers. For others, it's a lifelong dream and they're good at it.
I have pretty strong opinions about unions, but I'm not going to flounder this thread that hard. I'll just say that administrators play favorites.