Category Archives: Data

NAS Report on Data and Methods Disclosure

Jeff Id on the Air Vent has written a post pointing out the recent publication online of a report by the Committee on Ensuring the Utility and Integrity of Research Data in a Digital Age from the National Academy of Sciences: Ensuring the Integrity, Accessibility, and Stewardship of Research Data in the Digital Age. I […]

More Z-Score Opportunism

We’ve frequently observed that the reduction of data to standard deviation units (z-scores) is often associated with seemingly opportunistic orientation of the data sets. Often this is buried in the multivariate methodology. Principal components and RegEM can both function to opportunistically provide orientations to “proxies”. In Mann 2008, we saw pretty examples of proxies being […]

Steig’s “Corrections”

Roman M has already done one post on the impact of the Harry error. Ryan O has also done so [see comment here]. As has Steig. I show below some graphics that I’ve just done on AWS recon trends. At Steig’s website, he now states: awsreconcorrected.txt is a correction to the above file, using corrected […]

Deconstructing the Steig AWS Reconstruction

So how did Steig et al. calculate the AWS reconstruction? Since we don’t have either the satellite data or the exact path they followed using the RegEM Matlab files, we can’t say for sure how the results were obtained. However, using a little mathemagic, we can actually take the sequences apart and then calculate reconstructed […]

More on Voodoo Correlations

Mann said: Although 484 (~40%) pass the temperature screening process over the full (1850–1995) calibration interval, one would expect that no more than ~150 (13%) of the proxy series would pass the screening procedure described above by chance alone. Reader DC said: Of the 484 proxies passing the 1850-1995 significance test, 342 also passed both […]

R – the choice for serious analysis

While Steve is a little “under the weather” (it must be all the snow that Al Gore sent him), I thought I’d mention an interesting article in the New York Times which sings the praises of the programming language R. R is similar to other programming languages, like C, Java and Perl, in that it […]

Briffa and Sodankyla Church

The old Sodankyla church was built in 1689. Nine cores from beams at this church have been measured and archived. Briffa 2008 used one of 9 cores. Why only one of 9? Your guess is as good as mine.

Downloading KNMI Model Data

Lucia has been experimenting with model data downloaded from KNMI and I thought that I’d try to experiment with this a little from time to time. Unlike Benjamin Santer, Ph.D. of the U.S. federal Lawrence Livermore Labs, who refused to provide any assistance whatever in providing the data used in Santer et al, Geert Oldenburgh, […]

Santer Refuses Data Request

On Oct 20, 2008, I sent Santer the following request: Dear Dr Santer, Could you please provide me either with the monthly model data (49 series) used for statistical analysis in Santer et al 2008 or a link to a URL. I understand that your version has been collated from PCMDI ; my interest is […]

An R Package by a CA Reader Solves the Z Problem

CA reader, Nicholas, an extremely able computer analyst, has helped me with a number of problems with downloading data in compressed formats into R. One of the most annoying and heretofore unsolved problems was how to get Z files into R without having to handle them manually – a problem that I revisited recently when […]


Get every new post delivered to your Inbox.

Join 2,881 other followers