Phil Jones of the Climate Research Unit (CRU) at the University of East Anglia has been much in the news over the last week. Hackers broke into the CRU servers and downloaded a large number of emails and other documents. When I was writing this, a zipped 60MB file containing the stolen material was still available here . It is one of those sites where you have to wait for 45 seconds before pressing the regular download button. They hope that some people will pay to avoid the wait. There is a variety of interesting material in the 1000+ emails. The one that has attracted the most attention is this email sent on 16 November 1999 from Phil Jones to Ray Bradley (Univ of Massachussetts), Mike Mann (University of Virginia) and Malcolm Hughes (University of Arizona):
Dear Ray, Mike and Malcolm,
Once Tim’s got a diagram here we’ll send that either later today or first thing tomorrow.
I’ve just completed Mike’s Nature trick of adding in the real temps to each series for the last 20 years (ie from 1981 onwards) amd from 1961 for Keith’s to hide the decline. Mike’s series got the annual land and marine values while the other two got April-Sept for NH land N of 20N. The latter two are real for 1999, while the estimate for 1999 for NH combined is +0.44C wrt 61-90. The Global estimate for 1999 with data through Oct is +0.35C cf. 0.57 for 1998.
Thanks for the comments, Ray.
Cheers
Phil
[If you download the full set, unzip and look for 0942777075.txt]
This seems to be a non-issue. It looks like a discussion about exactly which figures to plot. Phil is clearly interested in the impression which will be given by the graph and want to make a choice which will support the impression he favours. But there is nothing necessarily wrong with that. He is talking to people he knows well who are familiar with the arguments, so he uses shorthand. “I want to hide the decline” may easily mean “I want to hide the misleading impression of decline which would be given if I used the X figures”. “A trick” just means a technique, it does not necessarily mean a technique which is illegitimate.
A rather different point is made by a retired academic Tim Ball, who complains about the way those of like mind are reviewing each others’ journal articles. I have not had time to look through to see if the emails support that this was a deliberate policy amongst those climate scientists who believe in man-made global warming. But it would be amazing if it was not true. That is one reason why I have always been hostile to peer review. From another point of view it is just one aspect of fashion in science. Clearly it would be better if scientists were not influenced by fashion, but it is inevitable that many of them will be, and it is hard to see what one can do about it.
George Monbiot, writing in the Guardian, picks up on an email of 8 July 2004 from Phil Jones to Mike Mann:
The other paper by MM is just garbage - as you knew. De Freitas again. Pielke is also losing all credibility as well by replying to the mad Finn as well - frequently as I see it. I can’t see either of these papers being in the next IPCC report. Kevin and I will keep them out somehow - even if we have to redefine what the peer-review literature is!
[1089318616.txt]
Monbiot is a campaigner who believes strongly in global warming and thinks international action is urgent, so he is distressed by this type of thing and thinks that Jones should resign forthwith. But again I cannot get excited. The basic problem is that the science has got irretrievably mixed up with the politics. Even though the more sober scientists might be persuaded that we do not understand the area at all well, the overwhelming majority have convinced themselves that urgent action is needed and so the purpose of IPCC reports is no longer the search for truth but the persuading of politicians and journalists. With that background, it is inevitable that they are going to focus on how to get the documents to make the best case possible for the viewpoint they favour.
Eventually these things sort themselves out. The evidence becomes sufficiently overwhelming that new people coming into the field lose interest in bogus theories. But it can take a surprisingly long time. It is not unusual for it to take several decades for a major misconception to get thrown out after clear evidence has become available. The difficulty about climate science is not that global warming is obviously wrong, but that it is not obviously right. It cannot be rebutted with present data, which means that those who have become passionate believers will not easily be persuaded to change their minds.
However, one odd thing does seem to have come out of this flurry of publicity. Apparently, the CRU is a leading player in reconstructing the climate history of the last 150 years. This reconstruction is far from straightforward. The raw data, most recently from satellites, but in earlier decades from weather stations, often has to be substantially adjusted. There has been a great deal of debate about some of these adjustments.
For example, a weather station may be set up on the outskirts of a town. Of the next 50 years the town gradually expands so that by the end of the period the weather station is well inside the town rather than in a field outside. That means that its later readings suffer from the “heat island” effect which makes towns warmer than the surrounding countryside. If one fails to adjust for that then the readings will apparently show global warming (at least in the area of that town) even if the town was getting colder.
Global warming is a small effect. Most people think that the argument is all about how much of the warming is due to human action. But there is also a debate about whether there really is a warming. Despite all the hoopla about vanishing arctic ice and so on (much of which reflects phenomena which are not so much new as newly studied), we are talking about tiny temperature rises over long periods (eg under 1 degree over the last 150 years).
So the kind of adjustments one makes to the raw data may be crucial. A bigger adjustment might completely wipe out the evidence for global warming. Obviously some scientists are interested in checking the CRU adjustments. So over the years many have asked for the raw data, and the CRU apparently refused their requests on a whole variety of different grounds. More recently, those wanting the data have got more aggressive and have started filing formal freedom of information requests. It now emerges that the CRU is unable to comply because it has destroyed the raw data. [I cannot check the CRU site directly because it has apparently gone down under the strain of recent events!]
The story sounds fairly strange, because the data was apparently dumped more than twenty years ago “in the 1980s”. Taking that at face value, it is clearly scandalous. These scientists have been collecting and analysing this data with the help of taxpayer funding. They clearly have a duty to preserve the data and to make it available to other interested researchers.
Conventions on when you have to make data available vary widely over different areas of science. In fields involving fossils, or other lengthy expeditions to dig things up, it seems to be commonplace for those collecting the original data to have an exclusive on it for as long as they wish. Those looking at the Burgess Shale or the Dead Sea Scrolls, for example, both denied outsiders access for decades. In other areas, fairly tight timetables are imposed. In astrophysics data from spacecraft and elaborate ground based telescopes is normally made available 12 months after it is obtained. Clearly some period of exclusivity is reasonable so that those who devote large amounts of time collecting data get the opportunity to be the first to write about it.
But there seems to be little excuse for denying outsiders access to data for 20 years, particularly in a field like global warming where some scientists are advocating that extremely expensive international action be taken on the strength of their recommendations.
The destruction of the raw data seems even harder to justify. The CRU scientists must be mad to think that other scientists are all going to be happy to take their word for the fact that the correct adjustments have been made to the data.