I’ve been asked by my administration for my estimation of the strongest philosophy departments in the UK (in research terms). I’m not a big fan of league tables, but, rather than leave things to my private whim I thought I’d take a look at a least two peer-review based assessments out there: the “last RAE (2001)”:http://www.hero.ac.uk/rae/rae_dynamic.cfm?myURL=http://195.194.167.103/Results/openuoa.asp and the “Leiter reports”:http://www.philosophicalgourmet.com/overall.htm . Leiter has a ranking of UK departments, but to get one for the RAE you need to make some choices. My crude method was to to take the crude score (5*, 5 or 4) and multiply this by the number of staff submitted (with 5* as 6). This gave me the following ranking table (below the fold):
| RAE | Leiter | ||
| 1 | Oxford | 1 | Oxford |
| 2 | Cambridge | 2 | Cambridge |
| 3 | Kings | 3 | St Andrews |
| 4 | Leeds | 4 | Birkbeck |
| 5 | St Andrews |
Kings | |
| 6 | UCL | Reading | |
| 7 | Warwick | 7 | LSE |
| 8 | Bristol | UCL | |
| 9 | Edinburgh | 9 | Edinburgh |
| 10 | Birkbeck | 10 | Sheffield |
| 11 | LSE | 11 | Leeds |
| 12 | Sheffield | 12 | Glasgow |
| 13 | Sussex | 13 | Stirling |
| 14 | Stirling | York | |
| 15 | Durham | 15 | Nottingham |
Interesting points:
(1) There’s a lot of consensus between Leiter and the RAE at the top of the table.
(2) Four departments get into the top 15 according to the RAE but not Leiter: Warwick, Bristol [my own department – full disclosure!], Sussex and Durham.
(3) Four departments make Leiter but not RAE: Reading, York, Nottingham and Glasgow.
I’m sure that we at Bristol have become stronger since the RAE, especially in philosophy of science given the moves of Alexander Bird from Edinburgh and Samir Okasha from York (and I hope this gets reflected in Leiter next time!) but on the whole, the large measure of agreement between the two lists ought to boost confidence in Leiter. There are some anomalies, though, and I do think it odd that a department that only scored a 4 at RAE (Glasgow) should make the Leiter top 15. Nottingham is clearly up-and-coming with some strong new appointments (though will this be affected by that University’s “grey-listing” by the Association of University Teachers?). I also believe that Sheffield, which comes 12th on the RAE and 10th on Leiter and has a particularly strong graduate programme, should come higher up both tables and that Leiter’s high ranking of Reading is closer to the truth than their non-appearance in the RAE top-15. Naturally, these opinions are just personal ones, and can be taken with as much salt as you like!
{ 28 comments }
harry 04.30.04 at 1:27 pm
One thing Leiter has on his side is that he does not depend on the ability of a department to produce a high-quality RAE report. No disrespect to whoever did Reading’s, but it does seem peculiar that they are not in the RAE top 15. The other advantage Leiter has is that it does not always make financial sense to aim for a 5* in RAE: sometimes its better (financially) to get a lower number with all your staff submitted, than higher with just a few. I can’t work out whether your methodology deals with that (now I re-read it seems that it does).
Chris Bertram 04.30.04 at 1:55 pm
Harry, you are right about that threshold effect. The trouble is that although we all knew that there would be such an effect, the funders didn’t disclose how large it would be until after the results were in, thus making rational decision-making close to impossible. As to your other point, I don’t think the presentation effect will have been as marked in philosophy as in some other disciplines. There were, though, some outrageous discrepancies in the RAE, most notably the (comparatively) high score achieved by Bradford.
harry 04.30.04 at 2:17 pm
bq. most notably the (comparatively) high score achieved by Bradford.
entirely unrelated, I am sure, to the composition of the Philosophy RAE committee.
Colin Farrelly 04.30.04 at 3:51 pm
I agree that Bristol should rate higher on Leiter’s rankings. Of course I am biased as I did my PhD there! It is a great dept that is strong in the main areas of philosophy and with the new faculty recruited in the past few years it should continue to rise in the rankings. Of particular note is the excellent supervision in political philosophy :)
David 04.30.04 at 6:28 pm
I know–let’s have a ranking of philosophers:
Dennett higher than Burge.
Churchland lower than Putnam.
Aristotle higher than Plato.
Scotus lower than Aquinas.
Etc., Etc.
Doesn’t that seem an absurd thing to do? Seems so to me.
Why isn’t it considered absurd to take groups of philosophers and do the same sort of thing?
There’s probably a good answer to this latter question, but I can’t quite see it yet.
Nicole Wyatt 04.30.04 at 6:39 pm
David wrote:
“I know—let’s have a ranking of philosophers:
Dennett higher than Burge.
Churchland lower than Putnam.
….
Doesn’t that seem an absurd thing to do? Seems so to me.”
It seems absurd because the cases you use are hard ones.
I think however that Bach higher than Wyatt seems smack on. (Not that I’m not trying to catch up.)
des 04.30.04 at 6:39 pm
Is is that there are no mediocrities in philosophy, david? Or merely that you can’t spot them, or object to those who think they can?
Hint: Many of the rubbish ones didn’t make it to posterity. Where, for example, would you rank Sir William Hamilton (notable only for accusing De Morgon of plagiarism)? Up with Plato, or not?
David 04.30.04 at 7:07 pm
No, des. I’m suggesting that solid objective “ranking” is rather hard to do.
Sometimes I think that fact gets lost in the mix.
chun the unavoidable 04.30.04 at 8:35 pm
The top five philosophers alive today:
1) Jacques Derrida.
2) Jacques Lacan*.
3) Anyone named “Kit” (tie).
4) Susan Hayek
5) The Brothers Wachowski**
—
*There’s a lot you don’t know, buddy.
**Jerry Fodor would have made the cut were he not primarily an opera critic.
David 04.30.04 at 8:47 pm
Ah, yes.
Kit is mighty FINE!
http://www.nyu.edu/gsas/dept/philo/faculty/fine/
jdsm 04.30.04 at 9:23 pm
I think David’s point is at least half right. Of course, if someone publishes a bunch of papers which are rubbish you can say he’s probably not a first class philosophical mind. However, some philosophers just allow ideas to germinate in their minds for ages or have flashes of inspiration, which might not come until later. In what sense is it useful for someone considering graduate studies to look at rankings of departments based only on “actualised” talent rather than “potential” talent? Peer review rewards quality but also prolific publishing because you become better known. The quiet ones who don’t publish because they’re smart enough to know their interesting thesis is wrong, won’t get a look in.
Andrew Boucher 04.30.04 at 10:02 pm
Well this rush to rate has made philosophy more like sports – complete with rival rating systems, like the different methods of evaluating the best college (American) football team. I guess the philosophy itself was getting too boring – better to concentrate on the social aspects.
enthymeme 05.01.04 at 2:18 am
RAE aside, Durham, if in the top 15 at all should be in by dint of EJ Lowe’s presence. Birkbeck drops a notch with the departure of Edgington to Oxford; and the LSE should really rank higher than Warwick and Bristol. It has a distinguished list of visitors and emeriti (Magee, Nicholas Maxwell, Alan Montefiore, Peter Urbach and Elie Zahar), and has what is probably the strongest phil science dept. in the UK. Faculty includes the likes of Luc Bovens, Nancy Cartwright, Howson, Worrall, and Elliott Sober.
Having said that, Warwick and Bristol are way underrated by Leiter – Warwick in particular – and I’m surprised that neither merits a blip on the Gourmet radar.
Also, UCL seems to be stronger _per_ faculty than King’s. Compare UCL’s Stuart Hampshire, Honderich, Snowdon, Wolff, Michael Otsuka, Sebastian Gardner and Tim Crane – to King’s Donald Gillies, Papineau, Sainsbury, Sorabji and perhaps O’Shaughnessy. Seems fairly clear to me that UCL retains the edge in terms of both numbers and quality.
Jo Wolff 05.01.04 at 9:45 am
Very nice of enthymeme to rank my dept UCL higher than Kings, but in fairness I should say that Hampshire has been emeritus since possibly the 1960’s and Honderich for around 5 years. On the other hand Sorabji, O’Shaughnessy and Gilles have retired from Kings, and Sainsbury is only part-time. One further thing that may have affected KCL’s position is that they submitted some world class linguists as part of the Philosophy submission which may distort the Bertram RAE ranking both in terms of quantity and quality.
One lesson is that often departmental reputations outlast the people on which those reputations are based. The advantage of Leiter is that it is based on who is teaching in the department now, rather than up to seven years ago, as will eventually be the case with current RAE scores.
Chris Bertram 05.01.04 at 10:31 am
“The advantage of Leiter is that it is based on who is teaching in the department now, rather than up to seven years ago, as will eventually be the case with current RAE scores.”
True, Jo, but I think I’m right in saying that the current Leiter ranking is about 2-years-old now, which makes it roughly contemporaneous with the RAE. While Leiter ranks people who were teaching in departments a couple of years back, the RAE will “eventually” go out of date. Not much to choose between them in 2004 then, although Leiter will be a better measure on its next update. The other thing that the RAE has going for it (as against Leiter) is that it is based on a peer-review-panel actually reading the submissions. Leiter is based on peer opinions of fellow professionals and there may well be some reputational bias involved there. (For instance in the case of X who is a “big name” but hasn’t produced much of note recently.)
Jo Wolff 05.01.04 at 11:36 am
Well, Chris, although I have no desire to pick at old sores, I feel I have to here. The myth of the RAE is that a small group of people can conduct a speed-reading peer review of the entire range of philosophical output of the UK. From my discussions with RAE panelists over the years my feeling is that they often have had to read submissions that they are not in a good position to judge (for example, that no journal would ask them to review).
Furthermore the speed with which the panelists have to read the vast volumes of submissions leaves them too dazed to make philosophical judgements except in the narrow specialist areas in which the panelists are genuinely up with the current literature. For the departmental rankings as you suggest Leiter may be even less reliable, as it is a reputational survey, but the area rankings are based on the judgements of people active in sub-fields, and this may be the best guide of all, even if there is no uncontroversial way of turning it into a ranking.
I understand that the process is about to start to produce a new Leiter report. I’m not sure when it will be completed.
Chris Bertram 05.01.04 at 12:33 pm
I’m sure you’re right there Jo. I certainly don’t want to give the RAE more credibility than it deserves and you and I both know what a massively distorting role it has played in British philosophy.
harry 05.01.04 at 2:13 pm
Chris and Jo — you’re both right about the RAE: but wrong (I think) about Leiter. My understanding is that Leiter surveys people’s opinion about other departments. People’s views of *other* departments are *almost always* out of date. EG, my own department contained Allen Buchanan for four years. Hardly anyone else registered he was here till after he left — we had no reputational benefit while he was here, but gained some later. Leiter himself seems indecently up-to-date on these things, but his input must be limited; there’s a significant time lag in his reports, probably as significant as in the RAE.
The other thing is that as jdsm wisely says reputations come from publishing rather than philosophising. RAE, of course, is only about publishing; and Leiter might have the edge in that there are at least some people who are famous for being excellent philosophers who are great to have around. But, again, one of the best philosophers in my own department (the best?) has hardly published for years, although he continues to write, teach, discuss things with colleagues, and is the one person I tell every graduate student they have to take a seminar with if they took the trouble to come here. I doubt we get much reputational benefit from his presence. But there’s nothing can be done about this; ranking requires publically accessible information. I think, in a way, this makes ranking groups of philosophers sillier than ranking individual philosophers. But, of course, ranking is a fact of life.
Th Brits, btw, should simply get rid of the RAE for philoosphy and hire a consultancy to do a survey of non-UK-based philosophers; and bas e the excercise simply on that. It’d be way cheaper and would get equally good if not better results.
Matt 05.01.04 at 2:53 pm
Harry,
I’m pretty sure the problem you mention w/ the Leiter report about Buchanan can’t come up, at least now. As I read the methodology, a _list of current faculty_ is given to the rankers, not a _list of departments_. So, if Buchanan was on the list, you surely got credit for him (if such things were even going then.) As I understand it, the lists don’t include the names of the departments, so as to try and force people to actually look at the lists. (This is all taken from the “methodology” section of the PGR web page.) If anything this sometimes gives more credit to depts who list people w/ tenious connections to the dept., such as the bio-ethics people at Penn.
Jo Wolff 05.01.04 at 3:04 pm
Harry, I entirely take your point that the most important member of department from the point of view of intending graduate students may well be someone who either has stopped publishing or never did. In the recent past we can mention Dreben and Albritton as perhaps the most prominent. I think the most important criticism of all of the RAE is that such people would count as ‘non-research active’ and are likely to come under pressure to publish even if they have nothing they want to commit to print at the moment and even if their time would be better spent, say, supervising graduate students. What I don’t know, though, is whether the US is currently more tolerant of this. I don’t know who your colleague is, but all the names that come to my mind are either retired or dead. But it may be that this confirms your point: this information doesn’t circulate very much.
Michael Otsuka 05.01.04 at 8:59 pm
One big difference between Leiter’s ranking and Chris’s RAE-based ranking is that Chris’s builds in a big advantage to large departments. Chris takes the RAE rating — which is roughly a reflection of the RAE panel’s assessment of the average quality of the work of the philosophers submitted for assessment — and multiplies that by the number of philosophers whose work was submitted. Leiter, by contrast, asks his surveyors to come to an overall judgment of the ‘quality of the faculty’ of a department. Leiter’s surveyors may, if they wish, take size into account, but they need not. While surely at least some of them took overall numbers as well as average quality into account, I doubt that any of them did so in Chris’s mechanical fashion. If they all had, then Notre Dame, which ranks 14th on Leiter’s survey, would surely have ranked above small departments such as Harvard, MIT, and UCLA, which each tied for 8th. This is because Notre Dame’s department is larger than the latter three combined.
The 8 largest UK departments measured simply in terms of the sheer number of philosophers they submitted to the RAE (and ignoring the RAE’s assessment of the quality of their publications) are:
1. Oxford
2. Cambridge
3. Leeds
4. Kings
5. St Andrews
6. UCL
7. Warwick
8. Bristol
Note how closely this size-based ranking correlates with Chris’s RAE ranking. It is, in fact, identical, except that Kings and Leeds swap places.
So Harry it’s probably not owing to any inability on Reading’s part to submit a persuasive RAE report that they score so low on Chris’s RAE table. But rather it’s that Reading’s department is relatively small. In fact 16 departments submitted more philosophers to the RAE than did Reading.
By the way, it appears that, by Chris’s formula, Reading’s RAE ranking should be tied with Durham’s, and Durham ranks 15th, according to Chris.
It is, I think, not entirely coincidental that Reading and Durham both submitted the same number of philosophers to the RAE — i.e., they both submitted fewer people than 16 other Departments. Once again, there’s a fairly close correlation further down the scale between sheer size and Chris’s size-weighted RAE ranking.
So if you think size may not be everything but it matters a great deal, then Chris is your man.
Michael Otsuka 05.02.04 at 8:53 am
In case it’s relevant to my post above, the following is a list of the ten largest UK departments when one counts every philosopher, including those whose work wasn’t submitted for RAE assessment:
1. Oxford
2. Cambridge
3. Leeds
4. Kings
5. UCL (tied)
5. Glasgow (tied)
7. St. Andrews
8. Warwick
9. Edinburgh
10. Bristol
Chris Bertram 05.02.04 at 11:47 am
Mike: Right about Reading/Durham (I’m not sure how I messed up on that). But surely wrong on size, since it is up to UoAs how large a proportion of their staff they submitted. A UoA, such as my own, that excluded nobody and still got a 5 ought to get due credit for that.
I don’t see where you get the data for your second comment, though, since a UoA is not = to a department.
Chris Bertram 05.02.04 at 12:52 pm
Actually Mike, if you think size is unimportant, then the following RAE ranking would seem reasonable: rank first by quality score and then according to the proportion of staff included.
That gives us:
Premier League (5*A)
LSE, Kings and Cambridge.
Nationwide division one(5*B)
Oxford
Nationwide division two(5*C)
Edinburgh
Nationwide division three (5A)
Sheffield, Birkbeck, St Andrews, Bristol
Vauxhall Conference (5B)
Reading, Stirling, Nottingham, Essex, UEA, Durham, Sussex, UCL, Warwick and York.
I think you’ll agree that one of the perverse effects of not taking size into account is the low ranking that UCL would achieve.
Michael Otsuka 05.02.04 at 1:10 pm
Chris,
My second table is derived from the RAE’s submissions data on its web page. It is, you are right, data about ‘units of assessment’ (UofA) rather than ‘departments’. But note that the RAE data that you rely upon in arriving at your RAE ranking of ‘departments’ is also data about ‘units of assessment’ (UofA). So, as I was just following you in eliding the distinction between a department and a UofA, I think your last remark is an instance of the pot calling the kettle black. (Note to non-anoraks: A ‘UofA’ is a construct of the RAE. Philosophy departments and philosophy UofAs are in fact, however, roughly co-extensive, though the latter sometimes includes philosophers in a university who aren’t in the philosophy department.)
I take your point that departments/UofAs should get credit for submitting a greater proportion of their philosophers. And that’s what impelled me to make my second post, which is simply lists the total number of philosophers in a given university, irrespective of whether their work was submitted to the RAE for assessment. Note how much more closely your RAE-derived rankings correlate to that list rather than the following list which is probably as close as we can come, simply on the basis of RAE data, to a ranking of departments based on their assessment of the average level of quality of publications of the members of the department as a whole:
1. Cambridge (tied)
1. Kings (tied)
1. LSE (tied)
4. Oxford
5. Edinburgh
6. Birkbeck (tied)
6. Bristol (tied)
6. Sheffield (tied)
6. St Andrews (tied)
10. Durham (tied)
10. East Anglia (tied)
10. Essex (tied)
10. Nottingham (tied)
10. Reading (tied)
10. Stirling (tied)
10. Sussex (tied)
10. UCL (tied)
10. Warwick (tied)
10. York (tied)
20. Leeds (tied)
20. Middlesex (tied)
(Method: I ranked departments which were rated 5* above those which were rated 5. Among those which were awarded the same rating, I ranked those which submitted a greater proportion of their staff for assessment above those which submitted a lesser proportion.)
Michael Otsuka 05.02.04 at 1:23 pm
Chris: I didn’t notice that you had made another post in the meantime while I was typing my above post. The ‘pot calling the kettle black’ remark is a response to the following comment of yours: ‘I don’t see where you get the data for your second comment, though, since a UoA is not = to a department.’
I don’t think the table on which we’ve just converged distorts on account of not taking size into account. Rather, it distorts on account of giving the same rating of ‘5’ to 16 departments which must have varied quite a bit in terms of the average quality of their submissions.
Jo Wolff 05.02.04 at 4:21 pm
How about a completely different, market based, approach, based on numbers of graduate students who apply? We would have to discount non-academic CV enhancing factors, of course, as well, as attractiveness as a place to live. So to do well, you would have to argue that your department gets loads of applications, but the non-academic visibility of your institution is low and it really isn’t that great living here. In the US this would put Rutgers way ahead, I’d imagine. I don’t want to say much about the UK but I hope my friends at Sheffield won’t take it the wrong way when I say that I think they would probably come top in this table.
noone 05.05.04 at 2:38 am
From what I remember when I was studying philosopy 15 years ago, it was difficult to think of 15 “good” departments, maybe only 7 or 8, but I do remember York University was one of them.
Comments on this entry are closed.