Climate Audit

by Steve McIntyre

 

The Supra-Long Finnish Chronology #2

This post is going to be a bit more interesting than my last one, where I was getting some preliminary information out of the way. The post here draws heavily on Mauri Timonen's 2009 PPT, which explains how their 7500-year long chronology is obtained. I'm also going to get to some results which will intrigue many readers.

In small lakes in Finnish Lapland, there are hundreds of submerged Scots pine logs that can be thousands of years old. (BTW the countryside and topography of these photographs looks very familiar to a Canadian). On the left below is a picture of an underwater logs (later determined to be from about 2000 BC); on the right is a montage of pictures showing the recovery of the logs and the taking of sample disks: these obviously give better data than pencil thin drill holes where perpendicularity is hard to maintain and where the pith is not known for certain.

   

More »

The Finnish "Supra-Long" Chronology #1

Over the past 30 years, Finnish dendrochronologists have developed a "supra-long" tree ring chronology now stretching back (Helama et al 2008) to 7600BP, well into the Holocene Optimum. Earlier versions of this chronology have been reported in many articles (e.g. Helama et al 2002, Eronen et al 2002 and references back into the 1990s plus articles here. Among other things, the chronology has been used to date changes in the treeline, which, in turn, has been used to estimate past temperatures. More »

Royal Meteorological Society Considers Data Archiving

A little progress on this front since my last post on this issue.

I received a pleasant note from Glenn McGregor acknowledging the changes to my note, in which he said that he would ask the publisher of IJC, the Royal Meteorological Society, to provide a statement of their data archiving policy. Given that the policy is set by the Royal Meteorological Society, rather than the editor, our issue is really with the Royal Meteorological Society.

Bishop Hill (and a couple of others) wrote to the Royal Meteorological Society about their lack of policy and it is now on the agenda of their next meeting. He reports the following answer:

Thanks for your note. I've had a couple of emails relating to this discussion and the position currently is as Prof McGregor mentioned. As I have mentioned to others who have emailed in, I'm very happy to consider the requirement for a clear policy statement and as such I have put this on the agenda for the next meeting of the Society's Scientific Publishing Committee, at which all the Editors of the Society's journals are members. 

It seems odd that they have no policy, but they don't. So let's hope that they develop one. For what it's worth, Climatic Change instituted a data policy as a result of my acting as a reviewer.

In early 2004, in my capacity as a reviewer, I asked for supporting data and code. Schneider said that, in 28 years of the journal, no reviewer had ever made such a request. Needless to say, that didn't impress me as a reason not to make the request. He said that it would require a decision of their editorial board, so I asked him to obtain such a decision. They then agreed on data but not code. I then asked for supporting data under the new policy, which the authors (MBH) refused to provide and the manuscript disappeared from sight (in the mean-time, they made a check-kiting citation to it in Mann and Jones 2005, so that accomplished what they wanted.) It's such a stupid game.

However, the exercise was not entirely pointless. I asked for data from Thompson and this resulted in the scraps of information on Dunde, Dasuopu and Guliya now available digitally.

A few more letters to the Royal Meteorological Society wouldn't hurt. And give a little support to Bishop Hill as well.

Briffa and Sodankyla Church

The old Sodankyla church was built in 1689. Nine cores from beams at this church have been measured and archived. Briffa 2008 used one of 9 cores. Why only one of 9? Your guess is as good as mine. More »

M&M Return

PNAS writes:

Dear Mr. McIntyre,

We are pleased to inform you that the PNAS Editorial Board has given final approval of your letter to the Editor for online publication. The author(s) of the published manuscript have been invited to respond to your feedback. If they provide a response, it may appear online concurrently with your letter.

This refers, of course, to our comment on Mann et al 2008.

Phil. Trans. B

I have some happier news to report from Phil Trans B, which, unlike the International Journal of Climatology, has a data policy and takes it seriously. Phil Trans B is a science journal published by the Royal Society as opposed to a climate science journal published by the Royal Meteorological Society.

Last summer, I reported that I had requested that Briffa archive data for Briffa et al 2008, pursuant to policies of Phil Trans B. I received a cordial note at the time from the editor that they took their policies seriously and would follow up on it. They responded cordially when I followed up on several occasions and said that they were working on it (and, given that they were dealing with core Team members, this is no small undertaking) and hoped to have the data by the end of the year.

A couple of days ago, I was notified by Phil Trans B that the first installment (Scandinavian data) was online here and that the authors had undertaken to have the balance online "in the New Year".

All in all, a very professional response from Phil Trans B, placing the surly response from International Journal of Climatology in rather stark contrast and perhaps highlighting rather neatly the questionable data standards that are deemed acceptable by the Royal Meteorological Society and some climate scientists.

I've done a quick look at the data available so far: there are spline and RCS chronologies, which appear to match the figure, and measurement data for Tornetrask/Finland combined. I'll discuss the data on another occasion.

Glenn McGregor: Data Archiving not required by the International Journal of Climatology

After nearly 2 months and several inquiries, the editor of the International Journal of Climatology has finally said that they do not require authors to provide supporting data.

Given that funding agencies rely on academic journals to ensure that authors archive data (improperly abdicating their own responsibilities), the moral of this should be that the National Science Foundation and similar agencies should no longer consider the International Journal of Climatology as a qualified publication for the purposes of completing publication obligations under the terms of NSF grants. More »

Gavin and the Big Red Dog

A few posts ago, I used the term "'fingerprint'" (in quotations) in connection with the big red spot that one commonly sees in the upper tropical troposphere in contour plots of projected temperature trends by latitude. On an earlier occasion, we'd talked about Ross McKitrick's "T3" ( here.) More »

Iowa

Alex Trbek: Your Double Jeopardy category today is Iowa. Connect each quotation to Iowa. (Info Note: Jeopardy is long-running quiz show hosted by Alex Trbek.)

For $400, please connect the following quotation to Iowa:

You're all doomed to perdition. You're all goin' to the painful, stinkin', scaldin', everlastin' tortures of a fiery hell, created by God for sinners, unless, unless, unless you repent.

For $800, please connect the following quotation to Iowa:

Mephistopheles would carry off shrieking not only the robber barons, but, unfortunately and permanently, all life on the planet.

Contestants, no editorializing on religion is permitted. Please don't use Google. Anyone can look up anything on Google, so what does that prove.

How Al Gore Saved Christmas

Obviously it's impossible to avoid the old chestnuts on our TV sets these days. I saw the original version of Miracle on 34th St for the umpteenth time the other day, noticing something for the first time that is a sign of the times. The judge's political handler, advising him of the political risks of the case, warned him that a decision against Kris Kringle would draw the ire of toy-makers, all unionized and all voters. How quaint.

It's also impossible to avoid the snow. We got hit with another snow storm yesterday and, for the first time in my life, I was pondering whether I should be thinking about planning my snow banks so that I'd have a place for the snow later in the season. (Through my life, it's never been an issue in Toronto, we don't get that much snow as we're in a bit of a shadow and what we get tends to come and go.) But last year we had snow banks into April and it became hard to figure out where to put the snow.

While thinking about this, I pondered about how Al Gore saved Christmas for us in Toronto, a story that's been told before, but it's the season for old stories.

Long ago (2006), in the bad old days before IPCC AR4, Toronto got its lowest snowfall in a century. Lake level declines were sure to follow. Would water supplies for lattes be threatened? Even the unthinkable now seemed possible and even likely.

Nobody knew what do. Except for one little girl. (Hey, it's a story.) She wrote to a famous ju-ju man in the South asking him to come north and cast a magic spell and make the snow return.

The ju-ju man heard the plea of the little girl. He quickly decided that the situation was far worse than even the little girl thought. This needed his most powerful magic and, so in 2007, he visited Toronto not just once, not just twice but three times.

The magic worked! Soon Toronto was covered up in winter snow. The ju-ju man could only save part of the 2007 winter, but by 2008, his magic was in full force. Yesterday's snow made 2008 snowfall the highest since 1883, with a few days still on the clock.

And it was all due to that one little girl.

As for me, my arms ache from shoveling snow. I think that the ju-ju man might overdid his spell a little. I'd have been OK with just one incantation.

2008

Merry Christmas to all of you. And to Mike, Gavin, Jim, Ben and and all those who have worked so hard to provide us with interesting statistical entertainment during the past year.

Downloading KNMI Model Data

Lucia has been experimenting with model data downloaded from KNMI and I thought that I'd try to experiment with this a little from time to time.

Unlike Benjamin Santer, Ph.D. of the U.S. federal Lawrence Livermore Labs, who refused to provide any assistance whatever in providing the data used in Santer et al, Geert Oldenburgh, the KNMI scientist responsible for their public interface, is pleasant and cooperative though it seems that they aren't used to automated data inquiry of the type that I expect to do.

Their webpage is designed for manual retrieval, but it can be pinged so that data can be directly downloaded into R. KNMI had no objections to me trying to do this and Oldenburgh helped as much as he could. I've managed to write a neat little retrieval script that picks up ensemble combinations but I'm stumped as to how to retrieve individual runs. It looks like it should be possible; KNMI has no objection to my doing so; maybe one of the computer-oriented readers can solve this little puzzle.

Here's what I can do so far.

The access point are cgi commands in the URL that instruct the KNMI computer to compile averages. This works very quickly. Examples of these commands are:

climexp.knmi.nl/get_index.cgi?email=yourname@you&field=tas_bcc_cm1_20c3m&standardunits=true

or

climexp.knmi.nl/get_index.cgi?email=yourname@you&field=tas_bcc_cm1_20c3m&standardunits=true&lat1=-20&lat2=20&lon1=0&lon2=360

If you insert this sort of URL in your browser, it will ping the KNMI computer to produce ensemble temperature averages for the region specified by the lat-long (default - global.) The HTML page that is produced contains information on the location of the sought data file. The information can be grep'ed from the HTML page and a new URL can be constructed where the ensemble average is located. This file can be read fairly easily - there's an annoying comment at the end of the file that requires extra handling, but this is programmed easily enough. I've inserted the program below.

The ensemble averages is fine. Here's where I get stuck on reading individual runs. Go to climexp.knmi.nl and then ping Scenario Runs on the right frame under Select A Field. Now as an example, check the radio button under tas for BCC_CM1 and click Select Field.

If you click Make Time Series in the first panel, this will make the ensemble average, producing a new page. Above the third panel in the new page is a hyperlink "raw data" which contains a time series of anomaly data. This is what I can retrieve with the script below.

If you now go back to the previous page, you'll see hyperlinks at the bottom of the page which produce results from each of two different runs. If you click the hyperlink of "analyse ensemble member 1 separately", it will generate a webpage looking just like the one we just had, except this time if you click Make Time Series in the first panel, it produces the results of this run located in a webpage structured as before.

I presume that there is a cgi command generated by one of these links, but I haven;t been able to figure out the structure. Maybe one of the computer programmers who visits here can figure it out.

Here are my scripts. Please paste in a real email address in the appropriate spot below (requested by Oldenburgh) so that usage of the access tools can be reported.

##FUNCTIONS
read.ensemble=function(model,scenario,prefix=myprefix,region="GL",suffix= "&standardunits=true") {
if (region=="TRP") {suffix="&standardunits=true&lat1=-20&lat2=20&lon1=0&lon2=360";suffix2="0-360E_-20-20N"}
if (region=="NH") {suffix="&standardunits=true&lat1=0&lat2=90";suffix2="0-360E_0-90N"}
if (region=="SH") {suffix="&standardunits=true&lat1=-90&lat2=0";suffix2="0-360E_-90-0N"}
if (region=="arctic") {suffix="&standardunits=true&lat1=60&lat2=90";suffix2="0-360E_60-90N"}
if (region=="antarctic") {suffix="&standardunits=true&lat1=-90&lat2=60";suffix2="0-360E_-90-60N"}
if (region=="GL") {suffix="&standardunits=true";suffix2="0-360E_-90-90N"}

url=paste(paste(prefix,model,scenario,sep="_"),suffix,sep="")
#http://climexp.knmi.nl/get_index.cgi?email=yourname@you&field=tas_bcc_cm1_20c3m&standardunits=true
# "http://climexp.knmi.nl/get_index.cgi?email=yourname@you&field=tas_bcc_cm1_20c3m&standardunits=true&lat1=-20&lat2=20&lon1=0&lon2=360"
my_info=download_html(url)
grep("raw data",my_info)
y= my_info[grep("raw data",my_info)][3]
# "raw data, "
n=nchar(y)
loc=file.path("http://climexp.knmi.nl",substr(y,10,n-16))
Sys.sleep(2)
test=readLines(loc)
count=as.numeric(substr(test[1],19,26))+1
writeLines(substr(test[3:length(test)],1,20),"temp.dat")
test=read.table("temp.dat");
x=test[1,1];x
read.ensemble=ts(test[,2],start= c(floor(x),round( 12* (x%%1),0)+1),freq=12)
read.ensemble}

download_html =function(url) {
download.file(url, "temp.html");
html_handle < - file("temp.html", "rt");
html_data <- readLines(html_handle);
close(html_handle);
unlink("temp.html");
return(html_data);
}

Here is a sample use. This can easily be modified for bulk retrieval.

knmi.info=read.csv("http://www.climateaudit.org/data/models/knmi.info.csv",sep="\t")
scenario="20c3m"
temp=(knmi.info$scenario==scenario);sum(temp) #24
id=unique(knmi.info$alias[temp]);K=length(id) #24
email="yourname@you" #
myprefix=paste("http://climexp.knmi.nl/get_index.cgi?email=",email,"&field=tas",sep="")
i=1; test=read.ensemble(model=id[i],scenario,region="GL"));

Reblog this post [with Zemanta]

CA Tip Jar

Amount:

Website(Optional):

CA Forum

Pages

Categories

Articles

Blogroll

Favorite posts

Links

Weblogs and resources

Archives

Search

 

Recent Posts

Recent Comments

The Finnish "Supra-Long" Chronology #1:

Gavin and the Big Red Dog:

The Supra-Long Finnish Chronology #2:

Wordpress upgrade imminent:

Royal Meteorological Society Considers Data Archiving:

2008 Tropical Temperatures:

M&M Return:

Sea Ice - End of Game Analysis:

Briffa and Sodankyla Church:

Unthreaded #31:

Glenn McGregor: Data Archiving not required by the International Journal of Climatology:

Adsense

Meta

Bad Behavior has blocked 4000 access attempts in the last 7 days.