Two interesting new proxy studies out recently, one with a meticulous archive, one without.
Kinnard et al 2011 (Nature) here is a proxy reconstruction using 69 proxies to reconstruct Arctic sea ice. It contains a comprehensive archive: all proxies as used as archived; all code is archived. Three of the coauthors are Canadians, including David Fisher, who’s had a commendable history of archiving and distributing data even before web-based solutions. (Fisher’s CDs of data were the core of the ice core collections in MBH98 and Mann et al 2008).
Christiansen and Ljungqvist (Clim Past Disc) here is a reconstruction using 91 proxies (all plotted). Although Ljungqvist has recently made two substantial archives collating recent proxies, for some reason, the present study lacks such an archive. Like Kinnard, it uses a procedure said by the authors to be innovative (but without code.) The combination of no archive and no source code detracts from the ability to efficiently analyse the article. I’ve written to Ljungqvist hoping that they will remedy the situation (and I’m hopeful that they will). Unless they do, I don’t plan to consider this article.
Back to Kinnard. The article uses a complicated multivariate method (Partial Least Squares). The authors provide information on their procedures, but overlook one of the most important aspects: at the end of the day, Partial Least Squares, like other methods, results in a vector of weights for the various proxies. While the authors present maps showing loadings for different PCs, unfortunately they didn’t connect the dots to carry out the linear algebra to extract the weights. It will take a while to analyse.
The D’Arrigo Proxies
In 2005, I tried to get the component chronologies (and measurement data) for D’Arrigo et al 2006 (of which Rob Wilson was a co-author, responsible for much if not most of the analysis, but not in control of archiving decisions.) Unfortunately, six years later, the D’Arrigo-Wilson chronologies remained unarchived.
Kinnard used 11 tree ring chronologies, of which 9 were attributed to D’Arrigo et al 2011 (one to Grudd; one to a third party.) The attribution to Grudd is incorrect: this series also comes from D’Arrigo et al. To my knowledge, this is the first time that these chronologies from D’Arrigo et al 2006 have been archived. (Definite progress here – CA readers will recall that Nature required Moberg to archive third party data sets even if the originating author hadn’t archived the data. Nice to see this happening without a complaint being required.)
Unfortunately, the authors seem to have jumbled 7 of the series, so that the wrong location is attached. (The sites are transposed in the style of the incorrect location of the MBH98 instrumental precipitation data used as temperature proxies.) I noticed this when I plotted up their Tornetrask version which looks as follows. This doesn’t look like the Grudd Tornetrask series at all – as any knowledgeable reviewer would have known. It looks like a Yamal version.
Figure 1. Series 68 in the Kinnard file. Site 68 in the information is Tornetrask.
As CA readers are aware, the Polar Urals series of D’Arrigo et al 2006 was actually Yamal (though the core counts illustrated in their figure came from Polar Urals.).
Figure 2. “Polar Urals” series from D’Arrigo et al 2006. (Actually Yamal with Polar Urals core counts.)
Here is Kinnard series 68 plotted in a similar style – showing that the two series are identical.
Figure 3. Kinnard Series 68 in D’Arrigo style.
Here is the complete transposition (as archived. It’s possible that it’s an archiving error rather than a substantive error):
Tornetrask – relocated to Central Northwest Territories;
Forgfjorddalen, Norway – relocated to Yakutia, Siberia
Central Northwest Territories, Canada – relocated to Taymir, Siberia
Yakutia, Siberia – relocated to Polar Urals, west Siberia
Taymir, Siberia – relocated to Yukon, Canada
Yamal, Siberia – relocated to Tornetrask, Sweden
Yukon, Canada – relocated to Forgfjorddalen, Norway
If the error in their archive exists in their data as used, these erroneous locations will obviously affect spatial maps of loadings and weights, to the extent that these proxies are used. This sort of error should have been observable almost immediately to anyone familiar with the proxies.
Over and above the transposition error, Kinnard et al have incorrectly used the Yamal chronology as the “Polar Urals” chronology (with Polar Urals core counts). In fairness to Kinnard et al, D’Arrigo et al incorrectly labeled the Yamal chronology as Polar Urals and then refused to issue a Corrigendum acknowledging the error.
Kinnard et al do not discuss the discrepancy between the divergence problem and the chronologies selected in D’Arrigo et al. Senior author D’Arrigo told the NAS panel that you have to pick cherries if you want to make cherry pie. The large population Briffa et al 1998 showed declining ring widths in a very large population of high-latitude sites (the divergence problem). The tree ring sites selected by Kinnard are also high-latitude sites, but on balance go up. The inconsistency between the decline in the large population and the rise in the small subset suggests biased selection at some point in the process – an issue not addressed by Kinnard. By blending the tree ring results with other proxies, the information from proxy class separately is not shown. I’ll try to extract this on another occasion.
Climate Audit 
25 Comments
I took a look of Kinnard et al last weekend, and it took me less than 10 minutes to notice something disturbing: before calibration they infill and use Mann’s lowpass filter (with end point effects) to “smooth” the proxies. You see the effect by plotting the original proxies (SI data 1) along with the smoothed (SI data 2). Here’s series #58 (blue orignal — red “infilled” and “5yr smoothed”):
The archieve does not contain all code. With a lot of trouble and googling (I suppose no reviewer tried to run the code…) I was able to get the main code to run. However, the archieve is missing code for the infilling and smoothing step.
IMO, this study really needs a closer audit.
Well, no one can say you are cruel.
You could have highlighted this odd infilling on the Monday following their release on a long weekend.
Very decent of you to give them a week to bask in their ‘glory’ .
Certainly a sporting approach to give a chance to let one of their ‘peers’ flag this.
I guess none of them noticed anything fishy!
Yikes!
RR
I guess life’s so much easier when data and code aren’t archived so pesky readers can’t possibly spot transpositions and other silly mistakes.
Speaking of which who did Nature select as reviewers, Kinnard’s aunts so everything passed through always with flying colors?
There is some fascinating stuff on the Yamal if you seach for “tree line”.
Especially this one
http://www.ecowho.com/foia.php?file=1553.txt&search=tree+line
“subject: copy to a safe place!!and leave original there”
Evidence of higher temperatures earlier in the Holocene-check.
Evidence of MWP, 750AD-1450AD-check.
No evidence of moving polar timberline to the north during last century-check.
See, I can do climatology, too.
================
Some Finns have a very interesting perspective on YAMAL.
LinkText Here
Always the same question, the same question. Naive or disingenuous?
Why not both, both?
============
Because if you have proof of disingenuity, and you just say “Both”, then those who don’t want the story to be “both” just gloss over all the disingenuity and talk exclusively about the naivete.
After a bit of that, they try to segue into “I couldn’t have deliberately done anything that bad; I’m too stupid!”
And the legislation and treaties roll on….
Saying “both” when the “naivete” part is comparatively irrelevant is actually giving them a verbal weapon to use against their critics.
RTF
Garden of Yamal;
Seventeen living larches,
Poisoned cherry tree.
============
Once again basic mistake that would not be acceptably for a undergraduate students essay or dissertation , included no-doubt students at the authors work with , are passed over in published research. Is the standard of science in this area really that low ?
Steve- its easy enough to make this sort of error. (And it might just be in their SI and not in their calculations.) If the error is in fact embedded in the calcs and it makes a difference, it’s unfortunate.
BTW as I go through the data, Kinnard et al have assembled a lot of data that hasn’t been otherwise available.
It remains the case that academics continue to make mistakes in their published work which they would not accept from their own students. Remember this is supposed to be a ‘Gold standard ‘ a level which people are supposed to aspire too . Is it really to much to ask them to meet a standard which would be expected of an undergraduate in their studies , the answer to often in climate science seems to be yes . They were told this is the ‘best of the scientific knowledgeable ‘ in the area and you can some see the area as a bit of a joke .
Haven’t had a detailed look at either yet.
But is Christiansen and Ljungqvist based on Ljungqvist et al., 2011 that’s also under discussion at Clim. Past
http://www.clim-past-discuss.net/7/3349/2011/cpd-7-3349-2011.html ?
they seem to be related. No original data in the SI to Ljung et al either as far as I can tell,
Yeah, I haven’t found any either, but I’ve only spent 15-20min so far. I think they’re going along the lines that they’ve listed what proxies they used & they’re already in the public domain. But, I think I saw on my first reading that they had to digitise some of the proxies!
On the plus side, your campaigning over bristlecones/Yamal seems to be finally making SOME headway… Anonymous Reviewer #1 seems to recognise they’re problematic, although still seems to have contempt for “so called sceptics”.
In their reply to C. Lemmen, they say that they’re planning on archiving their data on the WDC for Paleo, if they’re published. Maybe they’re planning the same for Christiansen and Ljungqvist.
I don’t know whether that would include the proxies & code or not. It looks like they’ve tried submitting this before, so maybe they’re reluctant to give away their archive & then have their paper rejected… I agree it does make it harder to review the paper though.
KnR – it seems obvious: paleo is the science, paleo are the techniques 🙂
I would appreciate anyone’s comments on this email I discovered from Briffa and some unorthodox uncertainty integration.
http://strata-sphere.com/blog/index.php/archives/17701
I am no statistician, but what Briffa proposed (and admitted to) seems to be a bomb shell.
I had a look at e-mail 3436. It has nothing to do with Briffa. Are you sure that’s the right number?
Buy, anyway from your blog post, it sounds like he’s talking about Osborn & Briffa, 2006: http://scholar.google.com/scholar?cluster=6739401972907860694&hl=en&as_sdt=0,5
There are problems with it, but actually the ones you mention aren’t my major problem with it. Here’s a discussion Steve gave on it at the time: https://climateaudit.org/2006/02/09/review-of-osborn-and-briffa-2006/
LOL! Blog Lurker – you are correct! My dyslexia strikes again.
#3468
That email was in Climategate 1 – 1138995069.txt. It discusses a complicated figure being drafted for AR4. I dont see it as especially worrying.
Good catch AJ. You really need to find out if that is related to be published work , but the attitude and intent is shows is damning enough.
Maybe look at what publications Briffa was invovled with at that time and see it you can see evidence of what he describes. He gives quite an accurate description so it may be possible to recognise it.
Steve M,
We deal in different industries. In the space business this kind of clouding of the results would be a shock.
Then again, when we look at errors and probabilities we tend to be concerned with things like how much time do we have to self-destruct a launch before it can kill people living nearby. The physics dictates the cone of safety as a rocket ascends. The farther it goes the more time to respond. But we have to get that probability cone right.
In those cases, screwing up the precision is truly criminal.
I have concluded my standards are probably to high for such mundane things as comparing tree rings between the last 50 years and 1500 years ago…
AJ,
The lack of statistical or scientific rigour in paleoclimate science… or climate science for that matter… shocks many of us, when we start to “peek under the bonnet”. But, if you’re shocked by that particular discussion, maybe it would be better for your sanity if you don’t look any further!!! 😉
I don’t recall offhand which figure he’s referring to. But, it most likely was for Chapter 6 of the IPCC 2007 Working Group 1 report (the “4AR” Steve refers to). If you’re interested in finding out more about it, have a read of Osborn & Briffa, 2006 first (you can find a .pdf in the link I gave you above). He used a similar logic there. You might not agree with it. But, you’ll understand his thinking a bit better. Then, you can have a look through the section of Chapter 6 in the IPCC report for the section on millennial temperature change. The figure you’re inquiring about is probably there.
But, to be honest, there are far more troubling difficulties with that chapter. You’re rightly concerned about the error bars associated with estimates. But, measurement error bars are only relevant if your measurements actually mean something!!! 😉
You’ll be more interested when you find out what their measurements are of. Maybe start with the “Yamal” controversy. There’s a brief summary at Bishop Hill here: http://bishophill.squarespace.com/blog/2009/9/29/the-yamal-implosion.html .
He makes a few mistakes & misrepresentations, but a lot of what he says is valid.
P.S. Look up the difference between “accuracy” and “precision”. You seem to be using them interchangeably, but they’re quite different.
P.P.S. Be careful not to get to drawn into conspiracy theories. Most of these guys, e.g., Briffa, etc. genuinely seem to believe a lot of what they’re saying.
The most recent reconstruction shown in the B. Christiansen and F. C. Ljungqvist paper does do a great service to the interested observers by showing the individual components and proxies that are used in the construction of the reconstruction. What bothers me about these reconstructions and taking the composite result seriously is that that the individual proxies vary greatly in responses that are shown over time. It appears to me that we are expected to accept that putting these greatly differing pictures together in some average composite reveals a truth about the past climate and specifically temperature.
With the amount of individual proxy response variation over time I would have to think that either the CIs for the final reconstruction would have to reach from floor to ceiling or that a large number of the proxies are not responding or responding weakly to temperature over time and should not be used in a reconstruction. Obviously for the second consideration to be addressed would require selecting the “correct” proxies to use. That the paper above and that from Loehle and McCulloch can show differing past temperatures relative to current times than those in many other reconstructions (with those other reconstructions also varying one from another ) only shows me that a selection process of proxies can significantly change the picture of past temperatures but that that says little about the validity of using the proxies as thermometers.
Steve,
Another dendro compilation, this one from China, I’m sure you’ve seen on WUWT or elsewhere. China has it’s own agenda, so I’m suspect of this one too. But I noticed the error bars in the first fig shown here: http://wattsupwiththat.com/2011/12/07/in-china-there-are-no-hockey-sticks/#more-52667
Oddly symmetrical, for instance the error around the spike at 400 AD is equal above and below the average temp even though the calculate data point is very high above average. Seems bizarre.
MattE
2 Trackbacks
[…] low-frequency variability. Climate of the Past, 8(2):765–786, 2012. [abstract] [PDF] [NASA copy] [Discussion on CA noted a lack of complete archives and […]
[…] isotope proxy they for some unknown reason decided to add some tree rings and walla hockey stick. https://climateaudit.org/2011/12/03/k…-chronologies/ https://climateaudit.org/2011/12/05/k…ic-o18-series/ Kinnard would have been a good study if they […]