Outsourcing

call center
Creative Commons License photo credit: vlima.com

After reading a recent NYTimes article on a company that provided assignment grading for professors, I was struck by my own ambivalent feelings. Having taught writing intensive courses for many years, it seemed like a welcomed relief to be able to send those papers off to professional services and receive them back corrected and commented. “The graders working for EduMetry, based in a Virginia suburb of Washington, are concentrated in India, Singapore and Malaysia,” and go so far as to match the tone of voice requested, whether constructive, formal, informal, encouraging, etc.

The idea, according to EduMetry, is to take paper grading off of our shoulders so that we can better dedicate ourselves to teaching, which I must say is not a bad one. Rarely has traditional paper grading been a rewarding experience for me, and even more rarely has it been a truly educational experience for the student. It seems often to be one of those tasks that belong more to academic folkloric culture than a real pedagogical tool. It’s painful, takes a lot of time, and gives very little return on your investment…

On the other hand farming out grading would in a sense maintain the status quo of paper writing by allowing professors to avoid thinking about the real use of writing in academia. Instead of being rethought and made integral to the teaching practices,  the papers would become some external requirement evaluated by outside graders, and would have no other meaning for the students themselves. Papers would join the ranks of the outsourced products we consume, both in terms of writing and now in terms of correcting.

The underlying question in all this seems to be regarding the status of the paper itself and its actual use. Do we continue assigning traditional papers that offer little pedagogical experience, or do we revise the role of writing and the various forms it can take in the classroom? Services like EduMetry do meet a demand, but is that demand not related to a very uncreative idea of what student papers should look like?

A, B, C and Hot or Not

Last December, Baruch’s campus news posted an article proudly announcing that a professor at our college had made RateMyProfessors’ top ten hottest list. The website lists assessment categories, including the easiness of the class, the rater’s interest in the subject, and clarity. Hotness is given the caveat “just for fun.” A ‘rate my realtor’ website has relevant categories such as communication, market knowledge, and negotiating. A ‘rate my doctor’ website has categories for punctuality, friendliness, and helpfulness. Neither of these cites include hotness. Why would RateMyProfessor.com invite students to judge their teachers by appearance, even by sexual appeal?

Part of what RateMyProfessor.com offers is a chance to level the playing field. The power dynamic between students and teachers can sometimes seem so severe. I’ve had many conversations with fellow teachers about grade grubbing: emails and office visits with students who either plead, bully, or plead and bully at the same time. There is something raw and vulnerable to the badgering of course, and that is what makes the situation stressful and sometimes even wrenching. I sweat through these conversations when they were happening, and they turned my stomach later at night.

“I am not a B student” (or fill in whatever the disappointing grade is). I think this is the gut feeling behind a lot of grade issues even when it isn’t said. And this is what I mean by an uneven playing field between teachers and students. I’ve realized there is a crucial difference between the relationship of teacher and student to those between realtor and client, doctor and patient. A flakey realtor can definitely be annoying, could keep you from the perfect apartment. The effects of an incompetent doctor could have a major impact on your life. But grades affect people’s identity, their sense of who they are at a time when the clay is still wet. When majors are still not entirely decided, much less careers, a grade might seem like a public judgment, affecting your own, private sense of self. When I was in college, the A’s in English and B’s and C’s in math and science told me I was a certain kind of person, they also directed me towards one career and away from other. My students at Baruch have an even more pragmatic grasp of the way grades affect their sense of themselves and way the outside world sees them. They know what grade point average it takes to get into business school, or to get an interview at Ersnt & Young. They have a keen sense that a grade attaches to their fate.

Paolo Carpignano, in “The Shape of the Sphere: the Public Sphere and the Materiality of Communication,” defines the public sphere as any practice that mediates between the public and the private. I went back to the readings from his class at the New School recently, when some recent events made me think about students and their identities, and my own, and also the public/private practice of judging, rating, and grading—the way it effects our sense of ourselves and the way others see us.

In the past few years, I’ve reconnected with people through Facebook and a few have told me they’ve Googled me; to find out what I’ve been doing since high school, or since the last family wedding or funeral. And this summer after a cousin mentioned Googling me, I of course Googled myself. I have an unusual name, so any hit I get is pretty surely me. And there, the very first one, was RateMyProfessor. And the very first rating, above several with comments such as “nice” and a few “boring” and one or two more generous, was a very detailed and sexually explicit post. I guessed, after thinking about it a lot, that a C might feel like the same kind of humiliation, affecting the way you see yourself and the way other people see you. Reading the post made me think that my sense of vulnerability might be right in line with what my student had felt.

For weeks after that post I fantasized about wearing a bomb suit to class. I wanted to prevent students from judging my appearance at all: here is an area in which I am no less vulnerable to judgment than anyone, no matter my maturity or professional accomplishment. For awhile after I found that post, I measured a student’s likelihood to retaliate on RateMyProfessor while I turned in grades. I eventually pushed this to the side, but a sense of wariness remains. I wonder how many other teachers are affected by the site and how we might clear a space for it within the academy, to absorb and reflect with students over what it has to tell us.

There has been some stone throwing on both sides, since RateMyProfessor began to offer teachers the chance to respond. (You can see a striking example from a past cac.cophony post: http://cac.ophony.org/2008/02/21/when-professors-strike-back/). But this has been like a back-alley scuffle behind the lecture halls where we talk about things like the public sphere and the role of the Internet in the academy. Grading and RateMyProfessor.com seem like very public spheres that affect our identities, that mediate between the public and private. But the practices themselves, as Michael pointed out in a recent post, aren’t the source of much open, deliberate debate.

Paolo Carpginano, “The Shape of the Sphere: The Public Sphere and the Materiality of Communication,” Constellations 6, no. 2 (1999).

Against Grades and Grading

The majority of students from the Business school who come to the Schwartz Institute to rehearse their company or industry analysis powerpoint presentations seem to look at the rehearsal process as an opportunity to improve a necessary skill. This has been one of the most rewarding aspects for me of my work as a Communication Fellow: the students are always grateful for the help in improving their public-speaking skills. They are motivated by the idea that they are helping themselves. I like that I do not have to grade their work for them to see it as important.

The institution of grading students on an A through F scale has done a horrible disservice to education. It has falsely given the impression to generations of students that the teacher or the professor has some ultimate authority over the value of their work, as if their own assessment of what they were doing was somehow secondary. The result of this institution is a division among most students into two groups — a group motivated by competition and the drive for the teacher’s approval, and a group lacking in motivation with little interest in the teacher’s assessment. What is missing all too often among students in both of these groups is the sense that their education is their own.

I have found several methods of correcting this problem that work within the extant system. By far the best of these methods is to ask students to write self-evaluations. All teachers who have ever taught a graded course know that students approach them to apologize for not having completed an assignment — the proverbial “my dog ate my homework” moment. The self-evaluation taps into the students’ innate authority over their work which is too often evident only in their apologies. If you ask students to write about how they have approached the assignments of the class and you ask them to write about their own perceptions of their strengths and weaknesses, they very quickly begin to realize their own agency in the learning process and to begin take responsibility for their own education.

Of course the best thing, I think, would simply be to do away with grades and grading altogether. I know that for many people this suggestion amounts to advocating “mere anarchy.” Without the carrot and stick, there would be no motivation anywhere among students, no assessment, no accountability. It’s true that in all likelihood, the students who come to me to rehearse their powerpoint presentation are not motivated purely by their own desire to improve. Their presentations are graded and they want to get a good grade. Well, perhaps this is true. But in a time when the movement for standards has taken over every level of education, I find some comfort in recollecting a different ideal.

The Importance of Being Earnestly Edited

palin-edits

If your students have any doubts about the importance of good copy editing, perhaps you could use this for “show and tell”.

Attack of the Grade-Grubbers?

If you have ever taught a college course, you might be familiar with the “grade-grubber,” that is, that special species of student who is never satisfied with the grade that he or she has earned, but is always keening for you to bump them up a half-letter or higher. On Tuesday, the New York Times published an article about the clash between student expectations and the grades they receive from professors, and it is currently their most emailed article. Professors interviewed attribute a rise in grade disputes variously to an increased sense of entitlement, competition among peers, and “ultra-efficient” test-prep in their K-12 education. Most interesting was the explanation that students have a misunderstanding about what grades actually reflect:

James Hogge, associate dean of the Peabody School of Education at Vanderbilt University, said: “Students often confuse the level of effort with the quality of work. There is a mentality in students that ‘if I work hard, I deserve a high grade.’ “

In line with Dean Hogge’s observation are Professor Greenberger’s test results. Nearly two-thirds of the students surveyed said that if they explained to a professor that they were trying hard, that should be taken into account in their grade.

Jason Greenwood, a senior kinesiology major at the University of Maryland echoed that view.

“I think putting in a lot of effort should merit a high grade,” Mr. Greenwood said. “What else is there really than the effort that you put in?”

“If you put in all the effort you have and get a C, what is the point?” he added. “If someone goes to every class and reads every chapter in the book and does everything the teacher asks of them and more, then they should be getting an A like their effort deserves. If your maximum effort can only be average in a teacher’s mind, then something is wrong.”

So, if grade-grubbing is a widespread phenomenon, and is at least in part a function of students not grasping the difference between merit and effort, what can we do to counteract this? How do we more effectively communicate our expectations to students? Do you provide a grade-breakdown in your syllabi? Do you give students access to grade calculators via online classroom management systems such as Blackboard? Do you provide students with the rubrics you use to grade their work?

As an aside, what do you think was missing from this Times article? I saw nary a mention of how the commercialization of higher education and the-customer-is-always-right mentality plays into student entitlement.

“Students today are…”

Branford Marsalis provocatively lays it down. Thoughts?

[youtube]http://www.youtube.com/watch?v=5rz2jRHA9fo[/youtube]

Via RateYourStudents.

James Paul Gee on Learning and Games

From Edutopia, the website of the George Lucas Educational Foundation, an excellent interview with James Paul Gee, a linguist who has become the leading authority on video games and pedagogy and who gave a great talk at the CUNY Grad center last year. Enjoy.

Outsourcing grading and written feedback

I was surprised today to find an ad on InsideHigherEd to a company called EduMetry, which offers various outsourcing services to colleges and professors, among them, a 24/7 virtual writing center, and “Virtual TA.”

Virtual TA is a program where the grading of papers, and the writing of “Rich Feedback” is outsourced.

According to “The Case for Rich Feedback,” on the EduMentry site,

One area crying out for attention is the extent of feedback students receive on their ongoing written assignments. Almost universally, assignments come back with a score or letter-grade and a few scrawls that are too brief, general, vague and or otherwise too minimal to make a difference. The student is left with little guidance on what to do differently.

The same page attributes this lack of rich feedback being given to students to a a lack of support that faculty members receive from the university.

But the solutions to that problem are smaller and fewer classes, and faculty learning how to give useful feedback, and students learning how to use that feedback.

I realize this kind of service would best appeal to those running the kinds of huge lecture classes in which “non-virtual” TAs currently do the grading and feedback writing for professors.

But the name “Virtual TA” is kind of a misnomer. They’re not virtual TAs; they’re real TAs you can’t see or visit with, who have no connection with the culture of the college or its student body.

Leaving aside the large lecture course, which I think is not a good idea pedagogically except in certain fields, I fear that this Virtual TA system might be employed in more standard college courses. And if it were, I can’t imagine it being a good idea for the professor, who won’t be reading the papers, and who won’t be learning all s/he can about the students, who themselves won’t be benefitting from the professor’s own feedback.

In response to that concern, EduMetry says (on their FAQ):

Wouldn’t you be interfering in the instructor-student relationship?

We have no direct contact with students. We are at the service of the institution and its faculty members. We provide instructors with a student-ID-scrambling utility that ensures a double-blind grading process. As former academics ourselves, we do everything possible to keep the professor in the loop (and not in the dark, as delegating grading might appear at first blush). In addition to having access to all the individual-student feedback, professors receive a summary report for the class that points out the highlights from the grading of that assignment. This report further ensures that faculty members are aware of how students did, adjust their teaching (content, pace, style, design of assignments) based on the summary feedback.

Truly rich feedback can be provided only by those who know both the subject, the students, and their work, as intimately as is possible given the circumstances.

It’s not the interference between teacher and student, mentioned by EduMentry above, that I fear.
Instead, it’s the gap between teacher and student that this creates.

I guess you might say I “mind the gap.”