Tag Archives: Schools

The validity of grades

February 17, 2010 By in Academia, Essays, Teaching Tags: , , , , , , , 5 Comments

Marco Arment writes at Marco.org (proving that he was prescient when it comes to domain names) and created the awesome web service Instapaper, which I use solely for its Kindle export feature. One of his favorite posts is “School grades are hopelessly broken.” It’s worth reading, and Marco is probably right: school grades are too high and don’t reflect real knowledge, but like healthcare or the military, there’s no easy way to fix them.

Although Marco’s essay is mostly right, it also doesn’t propose any real solutions to the problem he describes—because there aren’t any. The incentive for parents in high school is to want their kid to get the highest grade possible; consequently, they will often fight for their kids, leading to an overall negative equilibrium, and one that I benefited from in late middle and early high school when I decided to effectively fail math as an ill-conceived protest against my parents. At the time I didn’t consciously realize this dynamic, or that protesting in ways that chiefly hurt me aren’t terribly wise, but I was also 13 – 15 at the time and didn’t know any better.

For most teachers, the easiest thing to do on an individual level is inflate grades, which reduces complaints from both parents and students. This isn’t optimal on a societal level, which generates posts like Marco’s, but it is on an individual level, and I don’t see an easy way to generate incentives to change this (more on that later). Marco says:

Grades don’t reflect your aptitude, intelligence, or understanding of the subject matter. You don’t need to actually learn much useful material to get good grades. (And many of those who learn exceptionally well don’t get good grades.)

This is probably true. But if grades don’t reflect all this, then imagine what the people with really low GPAs are like. Grades aren’t good at stratifying the high end of the curve, but they at least show some of where the low end is. And I suspect the really high end, especially in hard college majors like engineering, CS, and so forth, are still reasonably good guides to aptitude. Marco says, “You can understand why I don’t trust the validity of grades.” You shouldn’t trust grades fully—but that’s because grades aren’t supposed to be the full measure of man. Nothing is, except maybe life, and what does that really mean?

I see a lot of comments about colleges, high schools, grades, and how to improve those kinds of issues on sites like Hacker News and Slashdot. Most are good at identifying problems; Chris Smeder, for example, tells us how to improve college teaching in three major ways. He’s probably right about all of those, but he misses an important point: most universities are not set up (or, if you like buzzwords, “incentivized”) to reward teaching.

Smeder misses the main point, which isn’t identifying the problem; a gazillion people in the Chronicle of Higher Education have said virtually the same thing at various times. The real problem is solving the problem, which requires changing the incentives that drive professors. At the moment, hiring and tenure decisions at virtually all universities (and all the big ones you’ve heard of) are made mostly on research and publication. Teaching simply doesn’t count for much. Therefore, the people who succeed in getting hired and getting tenured optimize for what they’re being judged on: research and publication. Teaching is secondary. Heroic individuals and people who want to practice better teaching will help somewhat, but they aren’t enough to change the system as a whole.

Once you’ve realized this incentive problem, the question becomes, “How do you change the incentives?” I have no good answers for that, but it’s the real question you should be asking if you’re genuinely interested. And it might keep you from generalizations like this one, which is back to Marco’s essay:

Most people from my generation can’t really do anything else in the real world except bullshit jobs because nobody ever held them to very high standards.

This probably is true of all generations, and the rhetoric of most people during most generations (consider, for example, the New York Times’ Generation Me vs. You Revisited). I suspect that not all the jobs Marco assumes are bullshit are bullshit. And even if all this is true, schools aren’t going to be offering the kind of information he’d presumably like GPAs to show.

I’d get near-zero homework grades because I’d never do it, so I needed (and usually got) near-100% test grades to make up the difference. I’d barely pull through and get a C most of the time.

This works for some people, especially who start their own businesses. Most people don’t and never will. So their grades count. I’m reminded of Paul Graham’s comment from “What You’ll Wish You’d Known:”

In retrospect this was stupid. It was like someone getting fouled in a soccer game and saying, hey, you fouled me, that’s against the rules, and walking off the field in indignation. Fouls happen. The thing to do when you get fouled is not to lose your cool. Just keep playing.

By putting you in this situation, society has fouled you. Yes, as you suspect, a lot of the stuff you learn in your classes is crap. And yes, as you suspect, the college admissions process is largely a charade. But like many fouls, this one was unintentional. So just keep playing.

Rebellion is almost as stupid as obedience. In either case you let yourself be defined by what they tell you to do. The best plan, I think, is to step onto an orthogonal vector. Don’t just do what they tell you, and don’t just refuse to. Instead treat school as a day job. As day jobs go, it’s pretty sweet. You’re done at 3 o’clock, and you can even work on your own stuff while you’re there.

The right thing to do is your homework, because it’s presumably easy, and then do the rest of your work on your own time. And although GPAs are broken, they’re also the best we’ve got. As Joel Spolsky says in his advice to Computer Science majors:

Never underestimate how big a deal your GPA is. Lots and lots of recruiters and hiring managers, myself included, go straight to the GPA when they scan a resume, and we’re not going to apologize for it. Why? Because the GPA, more than any other one number, reflects the sum of what dozens of professors over a long period of time in many different situations think about your work. SAT scores? Ha! That’s one test over a few hours. The GPA reflects hundreds of papers and midterms and classroom participations over four years. Yeah, it’s got its problems. There has been grade inflation over the years. Nothing about your GPA says whether you got that GPA taking easy classes in home economics at Podunk Community College or taking graduate level Quantum Mechanics at Caltech. Eventually, after I screen out all the 2.5 GPAs from Podunk Community, I’m going to ask for transcripts and recommendations. And then I’m going to look for consistently high grades, not just high grades in computer science.

Marco can be largely right in a micro sense and still be wrong, or at least doesn’t really deal with what should happen in a macro sense. If you’re the principal of a high school, or a college president, or an individual employer, or any number of other positions, what can you do to change the presumed brokenness of grades? How can you transform the system producing said grades? Until you’ve answered that, you’ve done a lot of the work that’s already been done (see, e.g., here for an older view of school problems) without facing the hardest part of the task.

The Art of Teaching — Gilbert Highet

February 15, 2010 By in Nonfiction, Reviews Tags: , , , , , , 1 Comment

For reasons not clear to me, The Art of Teaching is regularly recommended to teachers or people who want to be teachers. It’s not very good; skip it and read Why Don’t Students Like School: A Cognitive Scientist Answers Questions About How the Mind Works and What It Means for the Classroom instead, which has advice that’s both more practical and more theoretical than The Art of Teaching.

Highet says that “This book is called The Art of Teaching because I believe that teaching is an art, not a science.” He might be right. But he doesn’t present much evidence as to why it is, or how one can become a better artist in a significant way. A lot of his advice is obvious or vague. Among the obvious parts:

The first essential of good teaching… is that the teacher must know the subject That really means he must continue to learn it.
The second essential is that he must like it.

Among the vague parts:

Learn the peculiar patterns of [your students’] thought and emotions just as you would learn to understand horses or dogs—or other animals (for there are all kinds of different animals implicit in children: the very small ones are often more like birds)—and then you will find that many of the inexplicable things they do are easy to understand, and many of the unpardonable thing easy to forget.

What does it mean to “learn the peculiar patterns” of students’ thought? Highet never says. And I’m leaving aside the double aside he uses, or the fact that he compares students to animals. What’s next—the freshman whisperer?

The Art of Teaching is big on ideas and short on execution. There’s not much to say about it other than a warning to stay away from it.

Susan Engel doesn't get the problems with schools, but she'll tell us to "Teach Your Teachers Well" anyway

November 12, 2009 By in Academia, Links Tags: , , , , , , , , , , 7 Comments

Susan Engel’s Teach Your Teachers Well completely misses the point. She says:

And if we want smart, passionate people to become these great educators, we have to attract them with excellent programs and train them properly in the substance and practice of teaching.

But the problems with teacher training probably have less to do with teacher training and more to do with institutional structures and incentives within teaching itself.

She says, “Our best universities have, paradoxically, typically looked down their noses at education, as if it were intellectually inferior.” The reason they probably look down upon education is that most educators, in the sense of public school teachers, have little incentive to excel at teaching once they earn tenure; consequently, most don’t. There’s been a lot of material published on this subject:

Taken together, these pieces paint the proverbial damning indictment of how teaches are hired, promoted, and (not) fired. Once you’ve read them, it’s hard to accept the dissembling evident from teachers’ unions. Given the research cited regarding the importance of good teachers and how few incentives there are to become a good teacher, maybe it shouldn’t be a surprise that education majors and graduate students typically have incredibly low standardized test scores and GPAs, as shown in the following chart (2002; source):

gre_scores_by_department

Notice that education is at the bottom. Should it be much of a surprise that the best universities, which are almost by definition hyper-competitive, look down on the profession? Susan Engel thinks so.

If you change the incentives around teaching, the programs that teach teachers will change, and so will the skill of the teachers more generally. Over the last thirty years, the larger economy has undergone a vast shift toward greater competition and freer markets—a vast boon to consumers. The market for primary and secondary education has seen virtually none of this competition, or, to the extent it has seen such competition, has seen it on a district-by-district level, which requires geographical moves to take advantage of it.

This topic is one I attend to more than others because I think I’d like teaching high school and that I might even be good at it. But the pay is low, even relative to academia (which isn’t most remunerative field in existence), and, worse, there’s virtually no extrinsic reward for excellence. Almost anyone with a slightly competitive spirit is actively driven out; even those who have it begin with probably lose it when they realize they’ll make the same money for less work than those with it. And you’ll basically have to spend an extra year or two and lots of money to get an M.A. in education, which sounds like a worthless degree.

If you teach computer science in most districts, you make as much as someone who teaches P.E. You might notice that, according to Payscale.com‘s average salary by major table, education majors usually start at about $36,200 and make a mid-career average of $54,100. That’s probably low because it doesn’t take into account the extra time off teachers get during the summer. Still, notice the numbers for Math: $47,000 / $93,600, Computer Science: $56,400 / $97,400 or even my own major, English: $37,800 / $66,900.

But I doubt money will solve the problem without institutional reform, which is very slowly picking up. Susan Engel’s comments, however, only muddy the water with platitudes instead of real solutions.

EDIT: And if you want further hilarity as far as teaching incentives go, check out Edward Mason’s story, “Union blocks teacher bonuses.” As Radley Belko says, “The Boston teacher’s union is blocking an incentive bonus for exceptional teachers sponsored by the Bill and Melinda Gates and Exxon Mobil foundations unless the bonuses are distributed equally among all teachers, good, bad, and average.”