{"id":100,"date":"2011-09-08T16:34:24","date_gmt":"2011-09-08T16:34:24","guid":{"rendered":"https:\/\/blogs.swarthmore.edu\/wordpress-camp\/ir-sandbox\/?p=100"},"modified":"2023-09-13T15:41:16","modified_gmt":"2023-09-13T15:41:16","slug":"its-the-number-1-time-for-rankings","status":"publish","type":"post","link":"https:\/\/blogs.swarthmore.edu\/institutional-research\/?p=100","title":{"rendered":"It’s the Number 1 time for Rankings!"},"content":{"rendered":"

\"Runners<\/a>A number of admissions guide publishers have released rankings recently, and the Godzilla of them all, US News, will be coming out shortly.\u00a0 It’s always an interesting time for Institutional Researchers.\u00a0 We spend a lot of time between about November and June each year responding to thousands (I’m not kidding) of questions from these publishers, and then in late summer and early fall we get to see what amazing tricks they perform with this information, what other sources of “information” they find to spice up their product, and the many ways they slice and dice our institutions.<\/p>\n

The time spent on their surveys is probably the most frustrating aspect of IR work.\u00a0 (Not all IR offices have this responsibility, but many do.)\u00a0 We are deeply committed to providing accurate information about the institution to those who need it.\u00a0 But so often guidebook questions are poorly constructed or not applicable, and the way they interpret and use the data can be bizarre.\u00a0 While publishers may truly believe that they are fulfilling a mission to serve the public by providing their synthesis of what admittedly is confusing data, there is no misunderstanding that selling products (guides, magazines) is their ultimate purpose.\u00a0 Meanwhile, we are painfully aware of the important work that we were not able to do on behalf of our institutions because of the time we spent responding to their surveys.<\/p>\n

So the rankings come out, alumni ask questions, administrators debate the methodology and the merit, newspapers get something juicy to write about, and then we all go back and do it all over again.\u00a0\u00a0 Some of my colleagues get really worked up about this, and I can understand that.\u00a0 But maybe I’m just getting too old to expend energy where it does no good.\u00a0\u00a0 It seems to me like complaining about the weather.\u00a0 It is what it is.\u00a0 You do the best you can – carry an umbrella, get out your snow shovel, hibernate – and get on with life.\u00a0 Don’t get me wrong – I believe we should engage in criticism, conversation, and even collaboration if appropriate.\u00a0 I just don’t think we should get ulcers over it.<\/p>\n

<Minor Rant>That said, I do think it’s especially shameful for publishers to lead prospective students to think that “measures” such as the salaries volunteered by a tiny fraction of alumni on PayScale.com will be useful in their search for a college that’s right for them.<\/Minor Rant><\/p>\n

I think we have to acknowledge that there has been some good from all this.\u00a0 There was a time when some institutions spun their numbers shamelessly (I know of one that reported the average SAT of those in the top quartile), and the increased scrutiny of rankings led to some embarrassment and some re-thinking about what is right.\u00a0 It also led to a collaborative effort, the Common Data Set<\/a>, in which the higher education and the publishing communities agreed on a single methodology and definitions to request and report some of the most common data that admissions guidebooks present.\u00a0 In the past one guidebook would ask for average SAT, another for median, another for inter-quartile range, leave athletes out, put special admits in, and worst of all – no instructions about what was wanted.\u00a0 And then people wondered why there were six different numbers floating around.\u00a0 Unfortunately, once this set was agreed on and came into practice, guidebooks began to ask more and more questions to differentiate themselves from each other.\u00a0 (And some still don’t use it!)\u00a0 So it seems that a really good idea has backfired on us in a substantial way.<\/p>\n

Another good to come from this is that some of the measures used by the rankings really are important, and having your institution’s data lined up against everyone else’s prompts us to ask ourselves hard questions when we aren’t where we’d like to be.\u00a0 Here at Swarthmore, even though we are fortunate to have excellent retention and graduation rates, we wondered why they were a few points behind some peers.\u00a0 Our efforts to understand these differences have led to some positive changes for our students.\u00a0 This is likely happening at many institutions.\u00a0 The evil side of that coin is when institutions make artificial changes to affect numbers rather than actually improving what they do.<\/p>\n

On balance, I think that at this moment in time the guidebooks and rankings are doing more harm than good.\u00a0 The “filler” questions that use institutional resources (do prospective students really want to know the number of microform units in the library?), and the proliferation of rankings that underscore the truly commercial foundation of this whole enterprise (Newsweek\/Kaplan’s “Horniest” – really??) have gotten me a bit worn this year.<\/p>\n

But we’ll keep responding.\u00a0 And we’ll keep providing information on our website and through collaborative projects such as NAICU’s UCan<\/a> (University and College Accountability Network) to try to ensure that accurate information is available.\u00a0 As a parent who will soon be looking at these guides from a different perspective, I will have new incentive to see some good in it all.<\/p>\n

So in my best live and let live spirit, I will share the Reader’s Digest description of the Big One – the US News rankings-\u00a0 for my non-IR\u00a0 colleagues here at Swarthmore in Part II of this post.\u00a0 (IR friends, look away…)<\/p>\n","protected":false},"excerpt":{"rendered":"

A number of admissions guide publishers have released rankings recently, and the Godzilla of them all, US News, will be coming out shortly.\u00a0 It’s always an interesting time for Institutional Researchers.\u00a0 We spend a lot of time between about November and June each year responding to thousands (I’m not kidding) of questions from these publishers, … Continue reading It’s the Number 1 time for Rankings!<\/span><\/a><\/p>\n","protected":false},"author":4,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4,5],"tags":[7,35],"_links":{"self":[{"href":"https:\/\/blogs.swarthmore.edu\/institutional-research\/index.php?rest_route=\/wp\/v2\/posts\/100"}],"collection":[{"href":"https:\/\/blogs.swarthmore.edu\/institutional-research\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.swarthmore.edu\/institutional-research\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.swarthmore.edu\/institutional-research\/index.php?rest_route=\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.swarthmore.edu\/institutional-research\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=100"}],"version-history":[{"count":5,"href":"https:\/\/blogs.swarthmore.edu\/institutional-research\/index.php?rest_route=\/wp\/v2\/posts\/100\/revisions"}],"predecessor-version":[{"id":1585,"href":"https:\/\/blogs.swarthmore.edu\/institutional-research\/index.php?rest_route=\/wp\/v2\/posts\/100\/revisions\/1585"}],"wp:attachment":[{"href":"https:\/\/blogs.swarthmore.edu\/institutional-research\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=100"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.swarthmore.edu\/institutional-research\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=100"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.swarthmore.edu\/institutional-research\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=100"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}