Mann: "Dirty Laundry" from MBH98-99

The Mann et al 1998-99 reconstruction had “steps” (grandiosely called “experiments” by Mann), but the results of the individual steps were never archived, only the splice of 11 steps. For statistical analysis, one needs to have the residuals, which we requested in 2003. Mann refused. At this point in 2003, contrary to North’s allegations, Mann hadn’t provided any source code, any computer programs nor any interpretations of computer programs. All that he had provided us was a URL on his FTP site for the proxy data supposedly used in MBH – a data set that he later claimed was the “wrong” data set and which he deleted in Nov 2003 and a new version of the MBH proxy data was made public. At the point that the residuals were refused, Mann hadn’t spent more than a few minutes responding to requests from us.

The MBH residual series crop up in the Climategate Letters. In July 2003, Mann had sent CRU the very data [Sep 4, 2014 – actually only the 1902-1980 residuals] that he later refused to provide to us. (BTW Osborn also asked Mann for source code and interpretation of matters that he did not understand.) Mann made it very clear to Osborn that the residual series were provided in total confidence, that they were “dirty laundry” which he did not want to “fall into” the wrong hands.

Did Mann refuse to provide the residual series to us because answering our inquiries had taken up so much of his time that he stopped answering? Or was there some other reason?

Michael Mann to Tim Osborn, CRU, July 2003

Attached are the calibration residual series for experiments based on available networks back to: AD 1000, AD 1400, AD 1600… You only want to look at the first column (year) and second column (residual) of the files. I can’t even remember what the other columns are! mike
p.s. I know I probably don’t need to mention this, but just to insure absolutely clarify on this, I’m providing these for your own personal use, since you’re a trusted colleague. So please don’t pass this along to others without checking w/ me first. This is the sort of “dirty laundry” one doesn’t want to fall into the hands of those who might potentially try to distort things…

McIntyre to Mann, December 2003 cc NSF

In MBH98 and MBH99, you refer to analyses of residuals carried out in these studies. Could you please provide me with (a) preferably, a FTP location for the residual series, together an FTP reference for the program generating the residuals; or, (b) in the absence of such FTP location, an email enclosing this information. Your analysis of these residuals was used to estimate confidence intervals in an influential scientific paper.

David Verardo Director, Paleoclimate Program, US National Science Foundation, Dec. 17, 2003 preemptively permitting Mann not to disclose his “dirty laundry”:

Dr. Mann and his other US colleagues are under no obligation to provide you with any additional data beyond the extensive data sets they have already made available. He is not required to provide you with computer programs, codes, etc. His research is published in the peer-reviewed literature which has passed muster with the editors of those journals and other scientists who have reviewed his manuscripts. You are free to your analysis of climate data and he is free to his.

McIntyre to Ziemelis of Nature, August 2004

we are writing to reiterate long-standing requests for data and results from MBH98, which we have already communicated on several occasions. You had stated that these requests would be resolved in the new SI, but unfortunately this is not the case. While you are undoubtedly weary of this correspondence, our original request for disclosure was reasonable and remains reasonable. It is only the unresponsiveness of the original authors that is placing a burden on you and your associates. Some of these items have been outstanding for 7 months. They were not attended to in the new SI and need to be dealt with promptly. … In particular, we still seek … the results of the 11 “experiments” referred to in MBH98, including: (b) the NH temperature reconstruction (11 series from the start of each calculation step to 1980); (c) the residuals (11 series from the start of each calculation step to 1980)… Since their claims of skill in reconstructing past climates depend on these “experiments” and their estimation of confidence intervals is based on the residual series, it is unnecessary to explain why these data are of interest. Again, we have repeatedly requested this data.

Ziemelis to McIntyre, Sept 2004
And with regard to the additional experimental results that you request, our view is that this too goes beyond an obligation on the part of the authors, given that the full listing of the source data and documentation of the procedures used to generate the final findings are provided in the corrected Supplementary Information. (This is the most that we would normally require of any author.)

APPENDIX
Following paragraphs moved from first two paragraphs to appendix on Sep 4, 2014.

Here is Gerald North, Dec 1, 2009 purporting to justify data refusals by the Team:

McIntyre entered the fray by asking for data from Mann and his coauthors in about 2000 [actually 2003, but who expects accuracy from climate scientists]. As I understand it they complied, but the more they complied the more he wanted. He began to make requests of others. He sometimes not only wanted data, but computer programs. When he could not figure out how the programs worked he wanted help. From what they tell me this became so irritating that they stopped answering his emails.

North is giving public credence to this increasingly popular meme among climate scientists. Virtually everything in North’s meme is untrue. Rather than provide a detailed rebuttal, let me suggest an another and far more plausible alternative. Mann and others didn’t want to give data to potential critics. Let me show an actual situation, one where the Climategate Letters provide much new information.

Press Coverage

Please discuss press coverage on this thread, rather than OT comments on other threads. I realize that there are many new readers and this site has been patched together quickly to handle overthrow from Climate Audit. Please observe policies on not discussing policy – I don’t want to discuss or speculate on Copenhagen or cap-and-trade – you can do so elsewhere. Please do not editorialize on ethics. I understand the temptation, but please refrain anyway. There are some words and language that are strictly forbidden. Please avoid being excessively angry or piling on.

Here’s a quick start – there are dozens.
The Times Online
http://www.timesonline.co.uk/tol/news/environment/article6936289.ece

The Daily Express
http://www.dailyexpress.co.uk/posts/view/69623

Still Hiding the Decline

Even in their Nov 24, 2009 statement, the University of East Anglia failed to come clean about the amount of decline that was hidden. The graphic in their statement continued to “hide the decline” in the Briffa reconstruction by deleting adverse results in the last part of the 20th century. This is what Gavin Schmidt characterizes as a “good thing to do”.
Continue reading →

Replicating the “Trick” Diagram

Michael Mann, Dec 2004

No researchers in this field have ever, to our knowledge, “grafted the thermometer record onto” any reconstruction. It is somewhat disappointing to find this specious claim (which we usually find originating from industry-funded climate disinformation websites) appearing in this forum [realclimate].

Phil Jones, Nov 1999

I’ve just completed Mike’s Nature trick of adding in the real temps to each series for the last 20 years (ie from 1981 onwards) and from 1961 for Keith’s to hide the decline.

Gavin Schmidt, Nov 2009

Scientists often use the term “trick” to refer to a “a good way to deal with a problem”, rather than something that is “secret”, and so there is nothing problematic in this at all.

I’ve been able to make a very close emulation of Jones’ 1999 WMO diagram. Continue reading →

“A good way to deal with a problem”

In the UEA statement of Nov 24, 2009, Phil Jones said:

CRU has not sought to hide the decline. Indeed, CRU has published a number of articles that both illustrate, and discuss the implications of, this recent tree-ring decline, including the article that is listed in the legend of the WMO Statement figure. It is because of this trend in these tree-ring data that we know does not represent temperature change that I only show this series up to 1960 in the WMO Statement.”

Here is the corresponding figure in the UEA statement. I’ve added a yellow line for 1960. Although Jones’ statement says that he “only showed this series up to 1960”, the series attributed to “Briffa (1999)” obviously continues past 1960 into the 1990s. Jones said that CRU did not attempt to hide the decline in the Briffa reconstruction. And it is true that earlier articles did not take advantage of “Mike’s trick”. However, although the “real” Briffa reconstruction goes down after 1960, the series in the diagram attributed to “Briffa (1999)” goes up. The decline in the Briffa reconstruction is not shown; it is hidden. Gavin Schmidt of real climate says that this is “a good way to deal with a problem”. I disagree (and recorded this disagreement in a related context in connection with IPCC AR4 as discussed elsewhere.)


WMO Original caption: Northern Hemisphere temperatures were reconstructed for the past 1000 years (up to 1999) using palaeoclimatic records (tree rings, corals, ice cores, lake sediments, etc.), along with historical and long instrumental records. The data are shown as 50-year smoothed differences from the 1961–1990 normal. Uncertainties are greater in the early part of the millennium (see page 4 for further information). For more details, readers are referred to the PAGES newsletter (Vol. 7, No. 1: March 1999, also available at http://www.pages.unibe.ch) and the National Geophysical Data Center (http://www.ngdc.noaa.gov). (Sources of data: P.D. Jones, K.R. Briffa and T.J. Osborn, University of East Anglia, UK; M.E. Mann, University of Virginia, USA; R.S. Bradley, University of Massachusetts, USA; M.K. Hughes, University of Arizona, USA; and the Hadley Centre, The Met. Office).

"UEA succeeds in Quest for secure IT access"

On Nov. 12, 2009, CBR Networking has an article here entitled “UEA succeeds in Quest for secure IT access”.

A university spokesman said:

This gives us peace of mind – for example, we have considerably more confidence that a student is unable to gain unauthorised access to sensitive systems such as the university’s finance system – and simplifies the auditing process.

The "Climategate" Hockey Stick

If anyone’s keeping a tab on “climategate” hits, they have a very Hockey-Stick shaped pattern. A couple of days ago, someone observed that “climategate” hits on Google hit the 10 million mark. They’ve now hit 10.8 million. [Note: I got 94.5 million a couple of minutes ago. Dunno why I got a different answer when I did it again. 10.8 million makes more sense.]

camirror.wordpress.com

It’s December 8th. You’re now looking at the NEW Climate Audit website. No need to go to CAmirror anymore.

Please go to camirror.wordpress.com to accommodate present high volume.

[3 Dec IMPORTANT NOTE: We are now exporting all CA content to a new permanent home. This will take a few hours. Please comment at CAmirror above in the meantime. We cannot guarantee your comments will be automatically ported to the new site.]

Another Curry Editorial

Another good editorial by Judy Curry here.

Dealing with a problem begins by acknowledging it.

Yet another Upside Down Mann out

Science published today yet-another-Mann-et-al-reconstruction:

Michael E. Mann, Zhihua Zhang, Scott Rutherford, Raymond S. Bradley, Malcolm K. Hughes, Drew Shindell, Caspar Ammann, Greg Faluvegi, and Fenbiao N: Global Signatures and Dynamical Origins of the Little Ice Age and Medieval Climate Anomaly, Science 326 (5957), 1256. [DOI: 10.1126/science.1177303].

Seems to me that Mann has re-discovered the Medieval Warm Period.

I had a quick look at the paper, SI, and the code. What seems to be done this time is that the proxy network of Mann et al (2008) is processed with a slightly modified screening of Mann et al (2008), and then the reconstruction is done with a slightly modified RegEM CFR of Mann et al (2007)! Now to answer the question that seems to be on everyone’s lips: yes, Tiljander series are still used as inverted. This can be seen from the positive screening correlation values reported in the file 1209proxynames.xls. In fact, going quickly through the screening code, it seemed to me that they have really “moved on” from the screening employed in Mann et al (2008): only “two-sided test” is used!

%------------------------------------------------------------------
%% below is for selecting full/screened/1856-1925 screened/1926-1995 screened proxy-network
%% replacing "abs(z(4,i))>=0.165"/"abs(z(5,i))>=0.513" in line 75/84 with the followings for your expected proxy-network
%% abs(z(4,i))>=0 / abs(z(5,i))>=0 (full proxy-network)
%% abs(z(4,i))>=0.162 / abs(z(5,i))>=0.496 (screening over 1850-1995)
%% abs(z(6,i))>=0.195 / abs(z(7,i))>=0.602 (screening over 1896-1995)
%--

This means that if a proxy has a strong inverted correlation to the (two-pick?) local temperature, it gets picked – no matter what the physical interpretation is! Since RegEM doesn’t care about the sign, it is now really so that the sign does not matter to them anymore. Anything goes!

I’m speechless.