By Doug Ward

A colleague’s daughter recently finished her first year of college. In high school, he said, she had never really had to study to get good grades. In college, though, she had to adjust her study habits and her thinking after her early grades dipped below the A’s and B’s she had routinely – and easily – received.

That sort of dip in grades is common among traditional freshmen as they learn to live away from home for the first time, deal with the liberation and temptations of personal independence, and try to make sense of the academic expectations of college. How they deal with that jolt can affect everything from their choice of majors to their ability to stay in college.

Jennifer Meta Robinson, an anthropology professor at Indiana University-Bloomington, has been studying this phenomenon, which she calls “grade surprise.” Students usually have a good sense of the grades they will receive on assignments or exams, or in a class. When that expectation doesn’t match reality, though, they experience grade surprise.

woman gestures as she stands amid seated in a conference room
Jennifer Meta Robinson explains her work in “grade surprise” to members of the steering committee of the Bay View Alliance.

Robinson explained her research to the steering committee of the Bay View Alliance earlier this month in Bloomington, Indiana. Both Indiana and KU are members of the Bay View Alliance, a consortium of 10 research-intensive universities that are working to elevate teaching and improve learning among students. Robinson and colleagues in chemistry, computer science and informatics recently received a mini-grant from the Association of American Universities to continue their work of surveying students and analyzing university data to try to find questions they have about grade surprise among students:

  • How does grade surprise affect retention in various majors?
  • Does the power of grade surprise grow as students move through additional classes?
  • What approaches help students recover when they encounter grade surprise?

Robinson’s hypothesis is that grade surprise impedes student progress but can be mitigated. When students are overconfident, she said, failure is more painful than when they have low expectations about their grades.

“Surprise creates pain,” Robinson said.

She is also looking at the flip side of that: whether there is positive grade surprise.

“There’s a human tendency to rewrite the past,” she said. “We mitigate our pain by retelling our story in a way that makes it less surprising.”

For instance, students might tell themselves that a low grade was the instructor’s fault or that people like them just don’t do well with this type of material or in these types of classes. That type of thinking can easily push students out of classes or majors.

Interestingly, few students seem to blame instructors when grades come in lower than expected.

“We were surprised at how few students said, ‘The teacher had it in for me,’” Robinson said. “Or, ‘This was out of left field. I studied this other thing and it wasn’t on the test.’ There was very little of that. It really was about more about what I can do, what I practice, where I can spend more time. The locus of control was within.”

Disparities in distribution and reaction

Grade surprise isn’t equally distributed, Robinson said. Underrepresented minority students and first-generation students are more likely to be surprised by their grades. And women feel more disappointment when they receive lower grades.

Robinson and her colleagues have been sharing context about grades to try to ease some of the pain of grade surprise. For instance, in computer science and informatics classes at Indiana, women generally receive higher grades than men. In chemistry, women and men receive similar grades, although all receive lower grades than they did in high school.

“So women may feel that more, that disappointment in themselves, that setback of, ‘Oh, maybe I don’t belong,’” Robinson said. “But that’s where we could say to them that they may be processing this differently but the GPA facts of it are that they are doing the same.”

An analysis of data at Indiana shows that many students bounce back after the shock of an initial grade. They expect an A, receive a C but then eventually get an A in the course. Robinson and her colleagues want to better understand what students do to recover. They are also looking at the mindset of students who think they did poorly on, say, a midterm exam but actually did well. What happens if they enroll for the subsequent semester before they know their grade?

“What is that little detour through the course?” she asked. “How long does that hang in the air that you think you’ve bombed but you get that assignment back and got that A after all?”

A move toward wider use of data

Robinson describes the grade surprise project as one of many that “connect classes to the potential of big data.” Indiana has an ambitious program in helping faculty members combine university demographic data with data about student performance in classes. That combination is often referred to as learning analytics. The Indiana program, known as Learning Analytics Fellows, has led to more than 50 projects since it started in 2015. It is run through a recently created Center for Learning Analytics and Student Success.

We have been working on a similar project at KU, though at a smaller scale. An AAU mini-grant through the Center for Teaching Excellence has allowed several STEM departments to use university data to learn more about their students and about the paths they take through various curricula. The recently created Office of Analytics and Institutional Research (formerly the Office of Institutional Research and Planning) has continued the momentum around wider application of university data. One of its divisions focuses on academic data analytics and is looking at ways of making more data available to faculty members.

These types of data project allow instructors and departments to ask new questions about curricula, with an eye toward improving student retention and graduation rates. As Robinson explained in her talk at Indiana, this use of data is driving culture change as universities find ways to scale learning analytics even as they explore the potential of data in education. Robinson emphasized the importance of providing context for data and of applying “interpretive muscle” to tease out insights.

“These are drivers for change at all of our universities,” she said.


Doug Ward is the associate director of the Center for Teaching Excellence and an associate professor of journalism. You can follow him on Twitter @kuediting.

By Doug Ward

BOULDER, Colo. – Noah Finkelstein rarely minces words, and the words he offers to public universities carry a lofty challenge.

Society can make no better investment in its future than by promoting higher education, he said. It is perhaps the most fundamental form of infrastructure we have – institutions designed to influence the lives of students and build the core components of society. Pressures on these institutions have pushed them toward priorities that run counter to their founding missions, though, and overlook the very aspect that makes them special: in-person education grounded in a particular region.

Finkelstein is a physics professor at the University of Colorado, Boulder, and co-director of the Center for STEM Learning at CU. He was one of the hosts for the semiannual meeting of the Bay View Alliance steering committee in June in Boulder. KU is among the nine member universities of the Bay View Alliance, which works toward changing university culture in ways that improve teaching and learning. I wrote earlier about Emily Miller of the Association of American Universities and the update she provided about the AAU STEM Initiative. While she focused on the challenges of gaining internal support for changes in teaching culture, Finkelstein spoke more broadly about the way universities have responded to external pressures.

Noah Finkelstein works on a poster at a strategy session for member universities of the Bay View Alliance

One of the biggest problems, he said, is that universities, responding to concerns from legislators, parents and students, have focused on higher education as a driver of the economy rather than as a means of empowering individuals and investing in the future of democratic society.

“We have those roles inverted,” Finkelstein said. “We’re leading with economic and workforce development. The problem with that as a leading goal is that it does not ensure that benefits flow to individuals or to our society as a whole. It’s possible, but if we start with these other two – if we empower individuals, if we invest in our society writ large – workforce and economic development do come along for the ride in time.”

Universities have taken on the vernacular of business, he said, promoting ill-defined goals of innovation and entrepreneurship, and putting economic drivers ahead of individuals. And like publicly traded businesses, they have pursued a goal of “short-term profit over long-term welfare within our institutions.” That type of thinking must stop, he said.

“We have the privilege of being long term,” Finkelstein said. “We have that opportunity and we must not forgo using that tremendous lever we possess to improve society.”

Short-term thinking has helped drive a wedge between the essential functions of teaching and research at public universities, he said. As states have drastically cut funding to universities, universities have grown increasingly dependent on undergraduate tuition to pay the bills.

“The role of teaching is essential at our institutions,” Finkelstein said, “but it matters to consider the question: to what end? Right now it’s being seen as the main financial driver of our institutions by those who are making decisions. And it’s true that our campuses are driven by undergraduate tuition. But there is – or ought to be – more to it than that. How do we couple that to undergraduate development and learning, or student development and learning, rather than follow the easy, destructive path of hiring adjunct faculty and decouple our core missions of research and teaching?”

He pointed to three ways the BVA could help lead universities toward a better model.

Promote evidence-based teaching. BVA is already engaged in this by creating tools, policies and practices that promote evidence-based teaching. Subgroups of the BVA have been working on models, some financed by grants, to show how teaching specialists can help improve teaching and learning; to create tools for analysis of data about teaching and learning; to use university data to answer questions about teaching and learning; to promote means of assessing teaching that reach beyond student evaluations; and to explore ways to help teaching centers better reach faculty members.

Empower all those engaged in education. Finkelstein said the professional development of chairs was a “key lever” in spreading evidence-based teaching. Another is changing the rewards system so that instructors who use evidence-based teaching stand a fair chance in the promotion and tenure system and in merit raises.

“There seems to be a stronger and stronger discontinuity between what is recognized and rewarded and the core value systems for which our institutions were established,” Finkelstein said. “And that’s something that we can really take on within the BVA.”

The challenge is bigger than that, though, he said. Universities must do a better job of involving everyone in building community.

“This is a way of connecting people, from the parking staff to the faculty to the students to the chancellor to advisors on our campus, that we are engaged in collective vision making. That creates a community. It stitches people together in what have been historically different enterprises. It also allows for essential forms of inclusion and belonging that historically have not been our strength at these kinds of institutions.”

Create vision and identity. Universities create mission statements and value statements that often change when leaders change, and fail to resonate with the individuals on campus, Finkelstein said. Similarly, setting goals like increasing retention and graduation rates is important, but those goals are so general that they don’t provide a means of connecting people or of defining specific roles.

“The students don’t understand what this means,” Finkelstein said. “The faculty don’t understand what this means. Certainly the staff within many of our campus efforts don’t know what this means.”

BVA can be instrumental in sharing and modeling for universities what compelling and comprehensive visions might look like, he said. He also offered his vision for what public universities are and should be.

“We are about knowledge at our institutions,” he said. “We’re about the generation of knowledge and need to be proud of that mantle.”

Not only that, but a college education enculturates students into knowledge systems, he said.

“That’s what education is about,” Finkelstein said. “Not only are we generators of knowledge but we’re generators of those people who are the leaders of these knowledge systems. These things must essentially be coupled, and we are better for having that happen.”

Public universities must also embrace their regional identities, he argued. They must have an international scope grounded in a regional identity.

“We have the particular privilege of being residence-based and committed to human interactions,” Finkelstein said. “We are about people interacting with other people. But we are also still geographically, temporally and spatially located systems. We are essentially regionally based and should recognize that.”

Universities can’t be shy about explaining who they are and where they fit into society.

“We need to put a stake in the ground for what we are as social institutions and enterprises,” Finkelstein said. “Make it very clear and shout this from rooftops.”


Doug Ward is the associate director of the Center for Teaching Excellence and an associate professor of journalism. You can follow him on Twitter @kuediting.

CTE’s Twitter feed