Wake Forest University

college rankings

Rethinking Admissions

Continuing the Conversation

Posts Tagged ‘college rankings’

Do College Reputations Drive Rankings or Is it the Other Way Around?

Monday, May 17th, 2010

There’s no doubt that some students are unduly influenced by college rankings published by national magazines, regardless of the criteria used to come up with the lists. But new research suggests that faculty can also be heavily influenced by rankings, even when it comes to opinions on academic offerings in their own field. Nicholas A. Bowman, a postdoctoral research associate at the Center for Social Concerns at the University of Notre Dame, and Michael N. Bastedo, an associate professor of education at the University of Michigan’s Center for the Study of Higher and Postsecondary Education, examined the effects of The Times World University Rankings after they were introduced in 2004. The first year, faculty members and administrators were asked to list up to 30 universities around the world that they considered leaders in their areas of study – science, technology, social science, medicine and arts and the humanities. In analyzing responses in subsequent years, the researchers found that the widely publicized rankings helped form a consensus about the perceived prestige of certain universities. In other words, institutions that fared well in the first year did significantly better in the second year as well.  Based on their findings, Bastedo and Bowman conclude that  “clearly, rankings drive reputation, and not the other way around,” with the reputations of institutions appearing to change “in concert with the introduction and widespread use of a particular rankings system.” This is not the first time research on college rankings has led to this type of conclusion. In a paper published in February in the American Journal of Education, the same researchers examined the U.S. News & World Report rankings and similarly concluded that colleges’ reputations are influenced by rankings.  Read more about the faculty study in the Chronicle of Higher Education.

Are College Rankings Based on Circular Logic?

Friday, January 15th, 2010

students_in_conversationWhen students are making the all-important decision of where to apply to college, they often turn to U.S. News and World Report’s rankings of colleges and universities. According to one study, more than half of incoming college freshmen surveyed said the rankings were important when making their decision about which school to attend.

But a new study calls into question the methodology used to rank the schools. Specifically, it examines the “reputational” survey that makes up 25 percent of the score that the magazine uses for its rankings. The research shows that reputational scores are based on the previous year’s rankings, and rankings, in turn, are based on the reputational scores. In other words, the scores are circular.

The study, published in the American Journal of Education, was conducted by Michael N. Bastedo, an associate professor of education at the Center for the Study of Higher and Postsecondary Education at the University of Michigan, and Nicholas A. Bowman, a postdoctoral research associate in the Center for Social Concerns at the University of Notre Dame.

In an interview with Inside Higher Ed, Bastedo said that the study raises serious questions about the validity of the reputational survey. The findings suggest that reputational rankings won’t change, even as the quality of colleges does change. But Robert Morse, director of data research for U.S. News, says it’s not surprising that reputational scores are “relatively stable from one year to another,” adding that “schools themselves say they change slowly, not rapidly.”