close
The Wayback Machine - https://web.archive.org/web/20151005163149/https://itself.wordpress.com/2011/01/03/on-student-evaluations/

On student evaluations

Many of us who teach love to complain about student evaluations:  what they mean, how they’re used, the retaliation that is often expected with them, etc.  I think that this is an important question in academia–the place of user feedback within the culture–but the issue is heightened with websites like Rate Your Professor.  If you didn’t see it, The Chronicle of Higher Education recently profiled the now-defunct blog, Rate Your Students, which was a clearinghouse of professors complaining about their students and occasionally going down the dark alley of student evaluations.  (The Chronicle failed to mention that Rate Your Students was transfigured into a new manifestation, called College Misery, and it’s largely more of the same.)

The college where I teach has moved into using an online student evaluation tool called IDEA.  The good thing about IDEA is that it allows the professor to select which classroom activities or learning objectives were essential or important and then let the students evaluate based on those goals.  The IDEA process allows the numbers to be compared to the local institution and all other classes within the same discipline between all schools that participate with IDEA.  Students do their evaluations outside of the classroom, online, at their convenience, so there is no pressure of the professor intimidating the students and classroom time is not wasted on the evaluations.

This sounds good in theory, but in practice, some questions are raised.  Does it matter what students are doing–or where they are–when they do their evaluations?  (I recently had a couple that was doing premarital counseling with me take their online personality and premarital assessment battery tests on their iPhones, and even basic information was entered incorrectly.)  Is it always helpful to evaluate students at different institutions or in the same discipline for different courses?  Do students really think that saying that a professor is too tough on writing is a negative reflection on the professor?

On one level, the numerical responses are interesting.  But they often show that there will always be one or two students so irritated that they simply answer all of the questions negatively, even when the questions aren’t applicable to the particular classroom situation.  The same could be said of positive evaluations, as well.

I understand that it is important to understand the student culture at the particular colleges where we teach, and evaluations are sometimes helpful for this, and I have learned, I think, to present my courses to my students in a way that might not be the way I would want to do it but in a way that I think works to entertain my middle-of-the-road student enough to trick them into learning.

But what I usually think about–and am in instructed in workshops on campus–is how to designate my course goals in a way that will yield positive results.  And I have even started to re-think the calendar of the course based on when students are doing their evaluations.  For example, semesters where I have scheduled a final exam that falls after the closing date for their online evaluations the comments tend to be about how unfair the test is, etc., etc., and the numerical scores become lower.  One semester I had so many students involved with academic integrity issues that I didn’t think anything about the evaluations were reliable; my position of a pastor of a denomination most of them are unfamiliar with makes me a target for being subjective, opinionated, arrogant, etc., in their comments.

But I have learned to be extraordinarily neutral.  I’ll say things like, “if you want my opinion about this, I’ll tell it to you outside of class.”  “As someone not a member of this particular church, I can’t really comment on this.”  Many of the students are Methodist, since it is officially “related” to the denomination, and when issues related to the Methodists come up–including a local story of a Methodist pastor who murdered two wives and provoked a suicide in his church office before he voluntarily surrendered his ordination–I say I don’t know anything about the Methodists, because of my back history with trying to get ordained in the Methodist Church, which one student found out about from her pastor (so as to discredit professors who teach world religions in colleges) and later used it against me in the classroom and on my student evaluation comments.  I even give the conservative students extra talk time when talking about issues, and do so openly because, I say, they’re getting the liberal college professor thing from me.  This way of muting myself is totally “not me,” I often wonder whether I am really challenging students in the classroom because I am holding back my own ideas or interpretations, but I think I’ve got it down for this particular group of students that I tend to get in the 100 level class.

There are other nuances I could get into here, but here’s my payoff.  This past semester I worked very hard on improving my courses, made sure I had coffee before the 8 AM class, even took time to pray the Anglican rosary before class sometimes, and was mindful every time I walked into the classroom of what the students would be thinking of me and my presentation.  I dressed more casually.  I talked to the athletic students about their sports scores.  I talked Vera Bradley with some of the students.  It isn’t that I wasn’t interested in the students beyond grading them before, but I was very intentional about this, along with making myself to appear to be as neutral on just about every issue that came up in our current events time.

So my student evaluations are better than they’ve ever been, and I feel good about it.  It’s a great feeling when I feel like I did a good job teaching the students and that they, on the whole, appreciated it to the point that I get an acceptable evaluation from a tough crowd.  It also helped that I had a great group of students, no one went looking for loopholes in the syllabus, no one really challenged my attendance policy, and I had no issues of academic integrity.  I didn’t have the education major who is about to graduate asking to make an appointment to offer suggestions in my “pedagogical approach.”  But this isn’t always going to be the case where everything went right every semester.

But my question now is “what now?”  Do I keep doing what I am doing?  Many of us often harp about how high school teachers teach to an exam in the No Child Left Behind system, but am I now teaching to my evaluations to the new generation of No Child Left Behind students?  Does this have a negative impact on my teaching; is my sense of success a false one?  Is my sense of success this semester really misplaced in terms of the function of my particular 100 level class within the larger core curriculum of the college?  It pains me a little that one comment I had this past semester was that I am “too objective.”  That’s what I’m going for, but that’s not me at all!  But at the same time, my presentation and change of personality in the classroom has helped students get past whatever barriers they might have with an overweight preacher talking about Islam at 8 AM.

I’ve always been very skeptical of student evaluations, and I still am, even when they’re working for me for a change.  Or is it because no matter how good they might be, they could be completely different the next semester?

9 Responses to “On student evaluations”

  1. Slocum Says:

    “Does this have a negative impact on my teaching; is my sense of success a false one?”
    -How would you go about determining the answer to this question?

    Teaching to the bubble-dot eval (I’m exaggerating) may have helped *you* actually teach better, which would be good, but I seriously suspect that more widespread this practice is, the lower the quality of education becomes.

  2. Adam Kotsko Says:

    So far my evaluations have been pretty consistent across the board, and I think part of it may be simply that I’m teaching at a pretty selective college and so don’t have that many “issues” with them. Another part is probably that my classes tend to be small, so there’s more personal identification with me and less chance of some pissed-off outlier. And though I hate to say it, I probably get an artificial boost from being a white man with a beard.

  3. dbarber Says:

    I’d be interested to hear more about the ways in which you think this was a “compromise” (or whatever term you prefer). What if one were to say, in response to this, that this is what it means to be a teacher, what it means to engage students where they are?

  4. Christopher Rodkey Says:

    When I leave the classroom I think that I could have taken some conversations deeper, used some of my specializations or experience to draw some insight. I don’t like giving the last exam before the closing date on the evaluations, but that has really changed the dynamic on them.

    Perhaps what I need to do is give a handout to them asking for specific feedback on things I want to know about the books I use, the pacing of the course, things they wish we spent more time on, etc.

  5. Christopher Rodkey Says:

    Also, I have taught at several schools as an adjunct–DePaul, Joliet Jr. College, the Feltre School (Chicago), Drew Theological School, County College of Morris, Bergen County Community College, New Jersey City University, Harrisburg Area Community College, and Defiance College to name a few of them–and have found the way that students approach the evaluations are very different and should be used very differently. Where I teach presently is the toughest crowd I have experienced *in the 100 level classes.*

    When I teach upper-level classes, often with very small class sizes, the evaluations are a different story, because those students usually want to be there.

  6. Adam Kotsko Says:

    On the “rate your students” idea, I’ve long thought that a more appropriate parody site would be “rate your administrator.”

  7. Christopher Rodkey Says:

    Or “rate your interviewer” at the big conferences.

    Thinking about this all some more today, with student evaluations becoming more used for retention purposes for adjuncts, and the future of higher education being with adjuncts, is it possible or probable that students who use the evaluation comments for retaliation purposes–which *does* happen–could be liable for libel, intentionally saying something false for the purpose of damage.

    Where I teach with the elctronic evals, the students are actually warned that irresponsible comments could be tracked down. So, in essence, students are exposing themselves to a potential lawsuit if an employment decision is made based on their comments? If I were a student, I would think twice about this, though I doubt that few of them would consider this.

  8. Adam Kotsko Says:

    That scenario seems pretty far fetched to me, because the whole problem with adjuncts is that they have no power. Can someone making less than minimum wage teaching really afford to hire a lawyer?

  9. Christopher Rodkey Says:

    True, but all it would take is for it to happen once, even though adjuncts always sign a contract saying that we have no employment after the semester is over.

    There was an article in The Chronicle some time ago about how to avoid libel issues when one writes a letter of recommendation and then gets a phone call from an interviewing committee.


Comments are closed.

Follow

Get every new post delivered to your Inbox.

Join 4,645 other followers