By Doug Ward

A recent meeting at the National Academies of Sciences, Engineering and Medicine achieved little consensus on how best to evaluate teaching, but it certainly showed a widespread desire for a fairer system that better reflects the many components of excellent teaching.

The National Academies co-sponsored the meeting earlier this month in Washington with the Association of American Universities and TEval, a project associated with the Center for Teaching Excellence at KU. The meeting brought together leaders from universities around the country to discuss ways to provide a richer evaluation of faculty teaching and, ultimately, expand the use of practices that have been shown to improve student learning.

A CTE rubric for evaluating teaching helps instructors and departments focus on a series of questions.

My colleague Andrea Greenhoot, professor of psychology and director of CTE, represented KU at the meeting. Members of the TEval team from the University of Massachusetts, Amherst, the University of Colorado, Boulder, and Michigan State University also attended. The TEval project involves more than 60 faculty members at KU, CU and UMass. It received a five-year, $2.8 million grant from the National Science Foundation last year to explore ways to create a fairer, more nuanced approach to evaluating teaching.

The TEval project, which is known as Benchmarks at KU, has helped put KU at the forefront of the discussion about evaluating teaching and adopting more effective pedagogical strategies. Nine departments have been working to adapt a rubric developed at CTE, identify appropriate forms of evidence, and rethink the way they evaluate teaching. Similar conversations are taking place among faculty at CU and UMass. One goal of the project is to provide a framework that other universities can follow.

Universities have long relied on student surveys as the primary – and often sole – means of evaluating teaching. Those surveys can gather important feedback from students, but they provide only one perspective on a complex process that students know little about. The results of the surveys have also come under increasing scrutiny for biases against some instructors and types of classes.

Challenges and questions

The process of creating a better system still faces many challenges, as speakers at the meeting in Washington made clear. Emily Miller, associate vice president for policy at the AAU, said that many universities were having a difficult time integrating a new approach to evaluating teaching into a rewards system that favors research and that often counts teaching-associated work as service.

“We need to think about how we recognize the value of teaching,” Miller said.

She also summarized questions that had arisen during discussions at the meeting:

  • What is good teaching?
  • What elements of teaching do we want to evaluate?
  • Do we want a process that helps instructors improve or one that simply evaluates them annually?
  • What are the useful and appropriate measures?
  • What does it mean to talk about parallels between teaching and research?
  • How can we situate the conversation about the evaluation of teaching in the larger context of institutional change and university missions?

Noah Finkelstein, a University of Colorado physics professor who is a principal investigator on the TEval grant, brought up additional questions:

  • How do we frame teaching excellence within the context of diversity, equity and inclusion?
  • How can we create stronger communities around teaching?
  • How do we balance institutional and individual needs?
  • How do we reward institutions who improve teaching?
  • When will AAU membership be contingent on teaching excellence?

Moving the process forward

Instructors at KU, CU and UMass are already grappling with many of the questions that Miller and Finkelstein raised.

At KU, a group will meet on Friday to talk about the work they have done in such areas as identifying the elements of good teaching; gathering evidence in support of high-quality teaching practices; developing new approaches to peer evaluation for faculty and graduate teaching assistants; providing guidance on instructor reflection and assessment; and making the evaluation process more inclusive. There have also been discussions among administrators and Faculty Senate on ways to integrate a new approach into the KU rewards structure. Considerable work remains, but a shift has been set in motion.

KU faculty and staff share insights on teaching

Several KU faculty members have recently published articles about their inquiry into teaching. Their articles are well worth the time to read. Among them:

Briefly …

  • Writing in EdSurge, Bryan Alexander says that “video is now covering a lot of ground, from faculty-generated instructional content to student-generated works, videoconferencing and the possibility of automated videobots.” The headline goes beyond anything in the article, but it nonetheless raises an interesting thought: “Video assignments are the new term paper.”
  • The Society for Human Resource Management writes about a trend it calls “microinternships,” which mirror the work of freelancers. Microinternships involve projects of 5 to 20 hours that the educational technology company Parker Dewey posts on a website. Students bid on the work, and Parker Dewey takes a percentage of the compensation. The company says it is working with 150 colleges and universities on the microinternship project.
  • Writing in The Chronicle of Higher Education, Aaron Hanlan argues that by relying on a growing number of contingent, “disposable” instructors, “institutions of higher education today operate as if they have no future.” In following this approach, tenured faculty and administrators “are guaranteeing the obsolescence of their own institutions and the eventual erasure of their own careers and legacies,” he argues.
  • EAB writes about the importance of reaching out to students personally, saying that email with a personal, supportive tone can be like a lifeline to struggling students.

  • Doug Ward is the associate director of the Center for Teaching Excellence and an associate professor of journalism. You can follow him on Twitter @kuediting.

By Doug Ward

Watching David Johnson’s class in digital logic design is a bit like watching synchronized swimming.

After a few minutes of announcements, Johnson and half a dozen GTAs and undergraduate teaching fellows fan out across an Eaton Hall auditorium as 60 or so students begin to work on problems that Johnson has assigned.

student with white headphones sit at table and listens to instructor who leans on table and speaks
David Johnson works with a student during Introduction to Digital Logic Design.

A hand goes up on one side of the room. Johnson approaches, and students around him listen intently as he asks questions and quietly offers advice. Across the aisle, a group of four young men confers about the problem, looking things up on laptops, writing down notes by hand, erasing, writing again, and sharing ideas. A few rows ahead, two young women point at the problem on the screen at the front of the room. They confer, take notes, and confer more. Across the room, hands go up and, one by one, the class assistants approach, offer their help and then search for more raised hands.

“We’re always busy helping someone,” Johnson said.

Similar scenes have increasingly played out across the university – and across the country – as a growing number of instructors, primarily in STEM fields, have hired undergraduate teaching assistants to work in their classes. The undergrad TAs are just one example of how colleges and universities have elevated the importance of peer learning as part of their efforts to retain students and to help them move toward graduation.

Many educational roles

At KU, those efforts extend into many areas. First-Year Experience, honors, pharmacy and business are among the programs that use peer mentors. The Undergraduate Advising Office has a team of peer advisors who, among other things, help students navigate choices of classes and majors, and help them find campus resources. As anxiety and depression have increased among students, Counseling and Psychological Services has created a peer educator program to work with students on mental health.

young woman helps a student with a problem in both foreground and background
Student assistants help their peers work through problems in David Johnson’s class.

The university’s Supplemental Instruction program is also growing and now has peer leaders working with two dozen courses. Those peer leaders have successfully completed the course they are helping with. They lead sessions in which students review course material, prepare for exams, work on study skills, and offer support to one another throughout a semester. That approach, which started at the University of Missouri-Kansas City, has been found to improve grades, retention rates and, ultimately, graduation rates.

Peers have always played a role in learning, and they have long been involved in writing programs, tutoring and review sessions. The use of large numbers of undergraduate assistants in classes is relatively new, though, and is tied to a growing use of flipped classes, active learning, and in-class problem-solving. Over the past five years or so, KU instructors in such fields as geology, biology, chemistry, physics, and engineering have hired undergraduate assistants to work in their largest classes. Those assistants do such things as monitor online discussion boards, help with labs, proctor exams, and hold office hours. A pre-semester training program was started two years ago for undergraduate assistants in STEM courses, allowing the assistants and instructors to gain a better understanding of how to work together.

Undergraduate assistants have been crucial in transforming large lecture courses into hubs of active learning. Coordinating with instructors and graduate teaching assistants, they monitor groups or sections of a classroom, answer questions, offer praise, and through their interactions with students, make large courses more personal. Like students who lead Supplemental Instruction sessions, the undergraduate assistants in large classes have recently taken the course, so they understand the flow of the class, the course material, and the areas where students are most likely to struggle.

As they help their peers, they hone their own understanding of course material, improve their communication skills, and gain experience working with groups of people. That deeper understanding helps prepare them for upper-level classes as well as medical school exams, internships and graduate school. Most rely on the money they earn to help pay their college bills. Nearly all report a sense of satisfaction from the experience.

“When you see someone finally get it, it’s really cool,” one undergraduate assistant said at a recent training session.

Zero lecture timestudent assistant stands and leans elbow on table as student points to a problem on a sheet of paper

Johnson has used graduate teaching assistants, Supplemental Instruction assistants, and undergraduate teaching fellows (as the assistants are known in engineering) to make dramatic changes in his classes. With the help of Molly McVey, a post-doctoral teaching fellow in engineering, Johnson flipped a course in which he was lecturing about half of class time. They created online materials that helped students prepare for in-class problem-solving and hired undergraduate fellows to help in the classroom. When the flipped version debuted last year, lecture time had dropped to nearly zero.

“The only time they really hear me speak is if I have an announcement, usually to remind them of a test,” Johnson said.

Johnson first tried the flipped approach during a summer computer science camp for high school students, and he was surprised by how much more students learned. So he began to transform EECS 140, which he described as a gateway course required of all students in electrical engineering. He received a course transformation grant from the Center for Teaching Excellence and worked with course designers and video specialists at the Center for Online and Distance Learning to create online materials. He had the undergraduate assistants create the in-class problems, which he described as “nearly perfect” because they require considerable thought but can still be completed during class time.young man in yellow shirt runs his hand through his hair as a student assistant sits beside him and helps him with a problem

During the first week, students aren’t sure what to make of the hands-on approach, but that hesitancy quickly disappears as they adapt to the in-class problem-solving.

“The first class they were just sitting there waiting,” Johnson said. “I explained to them again that they could start working. By the third or fourth class, they were already asking questions even before the class started.”

The questions continue throughout the class period, and Johnson and the student assistants are constantly on the move. The constant interaction has helped Johnson better connect to the class.

“When I walk around and talk to students, I really understand what they don’t understand,” Johnson said. “That really helps me do a better job.”

Students are free to leave class once they complete the day’s problems, but many stay for the entire period. Some who finish early work on the next online module, knowing they can get help if they have questions. Others like to stay and help their peers.

Improved learning and a sense of satisfaction

Learning has improved significantly in many areas of the class, and the number of students who drop or fail has fallen. The approach isn’t perfect. Johnson said there was a dip in some areas on the last of the four exams he gives. By the end of the semester, though, many students know that their grades won’t change much regardless of how they do on the last exam, so they don’t approach that exam with the same seriousness they do earlier work, Johnson said.

During class, though, the students are focused and engaged. A hand goes up at the back. An undergraduate teaching fellow kneels, listens and offers advice. A hand goes up in front, in the center, on the far side of the room. Johnson moves from table to table, student to student.

“Students always think it’s easy for an instructor to do that,” Johnson said. “For me, it’s a lot harder to go around and explain something to someone who doesn’t understand some things than it is to just stand up there and flap away and hope they understand. It takes a lot more energy out of me, but I feel much better at the end of class when I think, ‘Wow, I really did teach somebody something.’ ”


Doug Ward is the associate director of the Center for Teaching Excellence and an associate professor of journalism. You can follow him on Twitter @kuediting.

CTE’s Twitter feed