Question
One of my follow-up FOI questions on Oct 31, 2008 about the gridded Briffa et al MXD data was the following:
I examined Gridbox 7(132.5E 72.5N) in more detail. It contains one series: omoloyla. The gridded series (#7) has values from 1400-1991, but the underlying omoloyla chronology at ITRDB only goes from 1496 to 1991 and the underlying measurement data for omoloyla at ITRDB only has values for the period 1496-1991. Please provide any manuals, computer code, documents or correspondence explaining how the values from 1400-1495 were obtained. If a different omoloyla data set was used for this study than the data set at ITRDB, would you please advise and provide the data actually used in this study. If there are similar discrepancies for other sites, would you please provide a listing of sites for which the version used differs from the ITRDB version.
The reason for asking for manuals, documents or correspondence is this: straightforward questions to the Team don’t get answers. If they don’t want to answer straightforward questions, I’ll do the next thing: go to FOI requests. But under FOI, I’m entitled to ask for documents, not for answers. So I ask for documents, such as manuals. Having refused to answer questions, the Team now takes offence at being asked for documents. The form of request is not onerous: no business accountant would blink at being asked such a question. However, Phil Jones wrote to the Santer 17 complaining as follows:
He now wants to know why some individual series were excluded from the chronologies and why some chronologies were excluded in subsequent analyses. This time they have asked for manuals, computer code and correspondence explaining the exclusions! It seems neverending. If they just did some paleo fieldwork with trees, corals, sediment cores they might understand why some samples are excluded.
As it happens, I have experience in mining exploration programs and I can assure Phil Jones that, contray to this experience enabling me to “understand why some samples are excluded”, it gives me exactly the opposite perspective. It makes it virtually impossible for me to think up valid explanations for “excluding” some samples. It’s illegal in the businesses that I know.
Anyhow, CRU answered as follows:
We have checked our files and no manuals, computer code, documents or correspondence are available. We can confirm, however, that we did not use a different Omoloyla data set and therefore there is no further data to provide.
Briffa has published over 8 articles on his MXD data and yet they have the nerve to say that “no manuals, computer code, documents or correspondence are available”.
Their website has values for Gridbox 7 from 1400-1495 even though there are no measurements from 1400-1495. But they have no idea how these numbers were calculated. And they don’t have any “manuals, computer code, documents or correspondence” explaining how they got these values. Did they just make the numbers up?
And the climate science community gets mad at me for criticizing this crap, rather than the people who deposited it.
Climate Audit 
55 Comments
If you don’t know — You may want to look into the Data Quality Act(DQA 2000)
Some particulars here http://library.findlaw.com/2003/Jan/14/132464.html and here http://en.wikipedia.org/wiki/Data_Quality_Act
It’s just now getting wide implementation and covers the federal government, all it’s grantees and contractors.
One legitmate reason that comes to mind would be something wrong with the core itself, although I would expect such to require meta-information to that effect rather than outright exclusion.
Perhaps it’s worth contacting the journals which published these articles pointing out it has become apparant that not only is there no data for series for this period, but there is also no documented way by which it could have got there.
In some of their papers they state:
“The authors were supported by the UK Natural Environment Research Council (GR3/12107) and by the U.S. Department of Energy (DE-FG02-98ER62601). Additional support came from NOAA’s Office of Global Programs and the DOE’s Office of Energy Research”
Steve. Did your FOI request mention these programs by name and did your request go to all these agencies?
Phil Jones as quoted in the article
Wouldn’t Jones’ conjecture here be rebutted by McIntyre’s Starbucks hypothesis with the recent empirical demonstration that it is possible to visit Starbuck’s and do “paleo fieldwork with trees” on the same day and still have time for a good lunch.
So this is just made up.
QED.
Stuff with no back up is excluded as scientific evidence in US Courts. It does not even get to the jury. There is no proof.
Good work.
What are the repercussions of not complying with a Freedom of Information request? I can’t imagine that it’s a criminal matter. Is the problem just referred to higher bosses? Do I need to write my congressman?
Don’t they realize that hiding ruin their credibility.
I’m very cynic toward climate scientist. If they are so certain of their science they wouldn’t feel threaten by being audited. They would know that they can defend their statement, and nothing else than minor errors would be found.
Instead by refusing to answer or provide the requested materials, they only lead to the the conclusion that they know their work is tragically flawed, either intentionally or not.
Climate science is very sick, since such resistance behavior are valorized by the the scientific community.
Steve’s got them by the short hairs and they’re squealing… LOL What a bunch of losers. The more it’s revealed their methodology stinks the more is revealed they’re making all this up. It’s going to come back and bite them in the ass. Virtual reality has no chance against the real world.
They must have learnt it from Nixon: when questioned, stonewall! What they forget is the results of such behavior.
When a federal agency refuses to comply with a valid FOI request, the requesting party must sue to compel disclosure. If successful, the court can award reasonable attorneys fees and costs of the suit. The court may also impose sanctions upon the non-complying agency.
Re: W F Lenihan (#11),
Steve, I’m just ITCHING to contribute to the legal fees to move forward with THIS suit. Amongst all of us realists, there has to be a lawyer that would be willing to take this on?…
Something like this, if done correctly…would be just the wardrobe malfunction we need.
JimB
This comment applies to this post and many others. What climatic data can be trusted to be “good”? What analytical techniques can be considered “good”? It seems that at every level, from the individuals on the “team” to the IPCC, lousy data is manipulated with equally lousy mathematical techniques to come up with questionable results that the world is supposed to take as the revealed truth. Why should anything involving global warming/climate change/chaos be believed? Why is it so difficult to get any cooperation from these people regarding data or methods?
Would a court of law be a relevant avenue?
Perhaps the Team are blinded by self interest and self belief, but are we blinded by mistrust and cynicism?
Understanding the science is quite simple, compared to understanding human nature.
Lets face it; these guys are scientists. If they’re like me, they have absolutely crap record keeping. It’s a tradition; just keep the data until it’s published, then forget it.
But then, I’m not trying to change the world, just get a promotion. These guys do need to work harder at the documentation. Perhaps you could suggest that in future, they do create an audit trail.
A few things about FOIA requests that I’m sure Steve knows, but many of us may not:
“Finally, the U.S. FOIA process will now look more like that of Mexico and other countries that provide individuals with an alternative to litigation in the event of disputes with government agencies over information requests. The OPEN Government Act will create a new ombuds office at the National Archives and Records Administration (to be named the Office of Government Information Services) to mediate conflicts between agencies and requesters and review FOIA compliance at all federal agencies.”
Apparently, this special office got moved by the current adminstration to fall under the Justice Department, exactly what the authors of the bill creating it were trying to prevent.
Anyone work at CNN or Washington Post?
JimB
Thanks again Steve, for taking the endless hours to demonstrate for the rest of us what is really going in in this broken science. Without your blog there would be skeptics but now there are informed skeptics.
— no files is pure methane producing bovine scatology. I don’t mind mistakes in the data but I hate being lied to.
Americans – please remember that this was a UK FOI.
I’ve made a prior request to DOE for Jones (temperature) data which they funded. DOE said that they did not have themselves any data and that Jones was not obliged under his contract to give them any data, so there was nothing they could do under the legislation.
If their purpose is to be uncooperative, then that’s probably true. IF they wanted to make Jones disgorge the data, I’m sure that they could do that too. But my view was that it was not worth pursuing.
Dear Mathematicians, PhD’s, Scientists and other paleoclimatology laymen,
If you only knew more about trees and coral and mud and core samples and stuff, you would truly know that you are in way over your heads. Paleoclimatology is really really hard, so quit asking how we do it. You will never figure it out. We know what answers we are after and we are going to get then, so we don’t need you poking around.
Sincerely
The Smartest Poeple In The World
We like to call it ‘carp’. It allows an opening to all sorts of fish and fishy jokes.
===============================================
This was a rhetorical question, right?
#22. Yeah. Rutherford et al 2005 was a joint venture between the CRU group and the Mann group. My guess is that the early data came from Mannian infilling by the Mann operation and it’s possible that the Briffa operation doesn’t know what Mann did. I don’t know at this time whether the calculation was done at CRU or in Mann-world. So this surmise might be completely wrong.
#15 and #22; careful planning pre-request and not taking anything short of complete compliance with a request is what is required. We should be able to get our hands on some data or start to get some court decisions that are unfavorable to those that fail to give up the information. And with that some press about those that hid the data. We are not talking about state’s secrets.
Re: Nicholas J Harding (#24),
Nitpicking, but the wording leaves room for data to exist from 1400-95. They merely say what’s not available.
Re: Geoff Sherrington (#25),
This a rather categorical denial. Could some group of structural engineers be able to claim the same for some high rise? The structure was peer reviewed by the local building officials. Could the structural guys be able to burn their calcs up approval of the local authorities? The local building officials (comparable here to journals) apparently are of no help with the archiving of calculations and methods.
This is where the wheels would/should fall off. I would think climate science would be the purest form of civil pursuit.
To hide, obfuscate verification and make a childish mess of the project archive speaks volumes and should resonate loudly among peers (peer review). I know that I couldn’t recommend a paper from a close colleague who couldn’t provide a set of calcs.
The point being that I could never submit any calcs if I didn’t provide a complete and professional copy to anyone who wanted them.
The idea of withholding data and methods from those who fund our research is still very foreign to me. I would think that if I work for the public, in a non classified position, I should bend over backwards for the public.
It has to stink, or at least as smell bad as a freshly dead skunk, that climate science, the purest of civil responsibilities, has been demeaned to this extent.
I am embarrassed for my country, and I apologize. I didn’t know it was this bad.
One could contend that this is only a UK thing. Unfortunately the record indicates otherwise.
Your next step would be to ask for an internal review by the Freedom of Information Officer – if this is denied (or not to your liking) then an appeal to the Information Commissioner will help get the information (although these can take years due to the backlog).
I would imagine that this would come under the stricter Environmental Information Regulations; however it is up to the Freedom of Information Officer to decide on which rules should be followed.
I should also note that you can make anonymous requests (or requests under a pseudonym) if you think that they may be being purposely obtuse due to who you are (the Freedom of Information Act simply asks for a name and an address (which can be an email address) not YOUR name and address! If you (or any of your readers) want to request information anonymously then this website makes things easy for you!
#25; my experience has been that I get the data that I FOIA. The use of discovery can be effective.
Scientists posting on CA HAVE done the field work, wrote their papers, and archived their data.
Even THEY can’t see any logical reason to exclude some data…
Amen!
Let’s see, when was that PR Challenge, and was Phil Jones going?
I still don’t get it. The data from 1400-1495 exists in some form or they would not have published it. Even if they made the data up from whole cloth, the values exist somewhere. What is the provenance of those values? They are saying they do not have any “manuals, computer code, documents or correspondence” but could provenance exist in some other form? I suppose “documents” would include computer files. I do not know what other form it could take. How can they say they have no provenance for the data with their face hanging out like that?
Implicit is the inference that the respondent is telling the truth. However, the answer is vague – “our files” could refer to files belonging to anyone associated with the respondent, “available” could mean immediately available… not, for example, backed up to DVD and hidden in a cupboard in the toilet at home.
If there’s nothing to hide, why is there such a problem with sharing the information? Do people not understand that the truth will always come out in the end? They must be Visual Basic programmers…
Re: John Laidlaw (#32),
“They must be Visual Basic programmers…”
Steady on JL :-), everyone who reads this blog knows that the team are in fact Fortran and latterly Python programmers so stop giving VB programmers a bad name by your misplaced incorrect association with the Team.
KevinUK
Re: KevinUK (#47),
Sorry Kevin – wasn’t trying to besmirch the good name of VB programmers (that would include me, you see :). Merely referring to the old “Shooting Yourself in the Foot” with various programming languages; the thing is that in VB you can shoot yourself in the foot repeatedly, but you’re having so much fun you don’t care… 😉
Why not just ask for the files? You should be able to get the whole shooting match that way. So if there are no files, manuals,computer code, documents, correspondence or storage cds, someone is telling porkies.
In my dealings with FOI in Australia you really want to know how the public servants store their data.
It is really quite simple, all data are stored mentally, so they are always available and can’t be lost. very efficient.
It seems that no matter how the FOI’s are worded, or what you ask for, a couple of things keep coming up:
1. They don’t have any data, records, code, correspondence, files, documents, e-mails (ad nausium) that can explain or verify their work. In most courses, failure to show your work is a failure.
2. Their networking is really good. As soon as a FOI goes out to anybody, the entire team is notified as to what is being requested. Gives them all time to ensure that they really don’t have it (now).
They’ve been doing climate science for so long, with so little data, they’re now able to write papers with no data at all…
snip – editorializing and piling on
You folks all know what we need:
A Mole!
We need someone who can tip Steve McIntyre off to the Asset ID of the external hard disk on which all the secret decoder files are loaded. S/he would perhaps be the brilliant statistician who should have been the Santer 18th or the “x” in MBHx. CA needs an Anonymous Tip email address…
Pretty soon we could start a new bestselling fiction genre. I anticipate titltes like: The Spy Who Came In From the Heat.
If you join the Team, you get a secret decoder ring and the GPS coordinates of the stash where all the data is kept…
Under UK FOI law, you can contact the FOIA officer of the agency and that officer is required to help you frame the request for the information so it is complete and doesn’t violate exemptions. I believe an organization, foia.org.uk, may be able to help as well. They published guides back when the UK and Scotland passed their FOIAs. There is also an environmental information regulation that is even stricter regarding reports, studies and the likes if a link is demonstrated to emissions or environmental matters. Commercial confidentiality doesn’t count. Steve may have done all of this already, but I thought I’d just pass it along in case.
Fred, others, I think it would be naive to believe that such shenanigans are confined to climate science. Science everywhere is rife with politics.
It is possible that their work is created by colliding data and methods with antidata and antimethods. All that would be left from the collisions would be the published papers with all the original data and methods destroyed in the process.
And Max Weber thought the world was undergoing a process of disenchantment. It’s good to see that science is still magical.
snip
And that’s why I find sublime joy in Steve McIntyre’s (et al) work of exposing the Mann Hockey Stick!! They are reaffirming the MWP!
Steve: I’ve drawn no conclusion on the MWP. And lay off the editorializing please.
Does that mean the requested data does not exist in their files, or that it merely is not “available” for the asking?
I would ask them that question directly in order to get the answer on the record.
lol duke of course they have no recollection of the event. If you ask them on record they will say they have no record, its how they roll…
“CA needs an Anonymous Tip email address…”
I remember that some journals and TV shows in the U.S. used to give out coffee mugs for “tips”…
I always wondered who would display said cup after providing an anonymous tip regarding their workplace?
JimB
It’s called Policy Based Evidence Making. I believe Eisenhower warned against it. We seem to be knee deep in it at the moment, across a broad range of different areas.
Financial blog Naked Shorts, via The Big Picture Blog, presents a nifty article from 2001 asking “How’d they do that?” in another context: a $50 billion New York hedge fund whose secret algorithm yielded remarkable returns year after year. Some quotes before I reveal the context:
Now, the context.
Of course this is entirely off-topic, but I thought readers might find it interesting.
Re: Ross McKitrick (#51),
High return, over a relatively short period of time, implies a high risk investment. A secret algorithm implies more risk and possible fraud.
I have heard that the investors were chided to invest by the mantra, not that were not making money on their investments, but that they were not making the highest returns.
The psychology of a consensus on this investment was a driver over those of skeptics’ warnings. While fraud is bad and needs too be punished, I somehow cannot bring forth much sympathy for the dumb asses with at least a million dollars to throw away that failed to do any due diligence.
Our Social Security and government health care systems have been referred to as Ponzi schemes, but here the evidence is there for all to see. But do people see or even want to see?
Ross:
The parallel WSJ article mentions the plaintive voice of one skeptic who no one would listen to. He proved to be correct, while smart guys running hedge funds got smashed. Most of the time, if it is too good to be true – it is too good to be true. Me, I have been largely in cash since the Dow went through 11000 in 2007. I sure felt foolish when it went to 14000 – but now I do not feel so bad. Between the lack of economic fundamentals and the plain excesses of many in the financial community, I am afraid that we are going to be in for a very long and difficult period.
From Ross’ cited article:
Yeeeeeeeeessssss.
It reminds me of Warren Buffett’s dictum:
Now that critical secrets of No. 10 Downing Street are out (see here) I have no doubt that data requests from less consequential figures requested under the FOI procedure will soon be having success.
2 Trackbacks
[…] at least it used to. Apparently, the rules have changed because it’s just too hard. From Yeoman Steve McIntyre, this post in its entirety: One of my follow-up FOI questions on Oct […]
[…] A clear example of the struggle to bring data in to public view is seen in these posts at Climate Audit: here and here. […]