<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:georss="http://www.georss.org/georss" xmlns:geo="http://www.w3.org/2003/01/geo/wgs84_pos#" xmlns:media="http://search.yahoo.com/mrss/"
		>
<channel>
	<title>Comments on: Steig 2009&#8242;s Non-Correction for Serial Correlation</title>
	<atom:link href="http://climateaudit.org/2009/02/26/steig-2009s-non-correction-for-serial-correlation/feed/" rel="self" type="application/rss+xml" />
	<link>http://climateaudit.org/2009/02/26/steig-2009s-non-correction-for-serial-correlation/</link>
	<description>by Steve McIntyre</description>
	<lastBuildDate>Fri, 24 May 2013 16:51:46 +0000</lastBuildDate>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.com/</generator>
	<item>
		<title>By: Steig and the International Man of Mystery &#171; Climate Audit</title>
		<link>http://climateaudit.org/2009/02/26/steig-2009s-non-correction-for-serial-correlation/#comment-252448</link>
		<dc:creator><![CDATA[Steig and the International Man of Mystery &#171; Climate Audit]]></dc:creator>
		<pubDate>Mon, 17 Jan 2011 12:11:15 +0000</pubDate>
		<guid isPermaLink="false">http://www.climateaudit.org/?p=5341#comment-252448</guid>
		<description><![CDATA[[...] from Hu McCulloch, covered by Pielke Jr here and Jeff Id here. Hu&#8217;s original post is here and the most recent CA discussion here. Hu&#8217;s complaint is [...]]]></description>
		<content:encoded><![CDATA[<p>[...] from Hu McCulloch, covered by Pielke Jr here and Jeff Id here. Hu&#8217;s original post is here and the most recent CA discussion here. Hu&#8217;s complaint is [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: The Steig Corrigendum &#171; Climate Audit</title>
		<link>http://climateaudit.org/2009/02/26/steig-2009s-non-correction-for-serial-correlation/#comment-248804</link>
		<dc:creator><![CDATA[The Steig Corrigendum &#171; Climate Audit]]></dc:creator>
		<pubDate>Sat, 11 Dec 2010 12:48:39 +0000</pubDate>
		<guid isPermaLink="false">http://www.climateaudit.org/?p=5341#comment-248804</guid>
		<description><![CDATA[[...] In an entirely unrelated development, Steig et al have issued a corrigendum in which they reproduce (without attribution) results previously reported at Climate Audit by Hu McCulloch (and drawn to Steig&#8217;s attention by email) &#8211; see comments below and Hu McCulloch&#8217;s post here. [...]]]></description>
		<content:encoded><![CDATA[<p>[...] In an entirely unrelated development, Steig et al have issued a corrigendum in which they reproduce (without attribution) results previously reported at Climate Audit by Hu McCulloch (and drawn to Steig&#8217;s attention by email) &#8211; see comments below and Hu McCulloch&#8217;s post here. [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: The First Difference Method &#171; Climate Audit</title>
		<link>http://climateaudit.org/2009/02/26/steig-2009s-non-correction-for-serial-correlation/#comment-239842</link>
		<dc:creator><![CDATA[The First Difference Method &#171; Climate Audit]]></dc:creator>
		<pubDate>Fri, 20 Aug 2010 02:36:46 +0000</pubDate>
		<guid isPermaLink="false">http://www.climateaudit.org/?p=5341#comment-239842</guid>
		<description><![CDATA[[...] Simply averaging anomalies relative to each station&#8217;s mean (as in the much-discussed Steig et al 2009 study of Antarctic temperatures) greatly understates any trend there may be in the data, while [...]]]></description>
		<content:encoded><![CDATA[<p>[...] Simply averaging anomalies relative to each station&#8217;s mean (as in the much-discussed Steig et al 2009 study of Antarctic temperatures) greatly understates any trend there may be in the data, while [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Ryan O</title>
		<link>http://climateaudit.org/2009/02/26/steig-2009s-non-correction-for-serial-correlation/#comment-178206</link>
		<dc:creator><![CDATA[Ryan O]]></dc:creator>
		<pubDate>Mon, 16 Nov 2009 18:23:30 +0000</pubDate>
		<guid isPermaLink="false">http://www.climateaudit.org/?p=5341#comment-178206</guid>
		<description><![CDATA[Re: &lt;a href=&quot;#comment-365577&quot; rel=&quot;nofollow&quot;&gt;Hu McCulloch (#158)&lt;/a&gt;, My bad.  If you do a truncated SVD on just the 42 locations you get different spatial weights than if you do a truncated SVD on the full 5509 locations and extract the 42 . . . but you&#039;re not doing any truncation because you&#039;re not doing SVD in the first place.  I&#039;m just so used to the SVD methods now . . . :)
.
I did masks that follow the traditional delineations if you find it helpful.
.
Peninsula:  A line from Cape Adams to the mainland south of the Eklund Islands ( http://en.wikipedia.org/wiki/Antarctic_peninsula ).
.
West:  West Antarctica is that portion of Antarctica lying on the Pacific Ocean side of the Transantarctic Mountains.  ( http://en.wikipedia.org/wiki/West_Antarctica )
.
East is everything else.  I also did a mask for just the Ross Sea.  These are refined from what I did earlier.  The full West Antarctic mask is simply &quot;mask.west.a&quot; plus &quot;mask.ross&quot; and east would be all grid cells not allocated in these masks.
.
mask.pen=c(1:114, 117:128, 140:152, 166:181, 195:208, 223:235, 250:260, 278:287, 310:317, 345:350, 383:386, 420:422, 457:459)
.
mask.west.a=c(115, 116, 129:139, 153:165, 182:194, 209:222, 236:249, 261:277, 288:309, 318:344, 351:382, 387:419, 423:456, 460:495, 497:535, 538:575, 578:615, 620:657, 663:700, 707:743, 752:787, 797:832, 843:878, 891:924, 938:970, 988:1020, 1043:1074, 1101:1131, 1163:1184, 1187:1192, 1227:1246, 1252:1256, 1292:1310, 1357:1374, 1424:1442, 1493:1505, 1560:1567, 1628:1634, 1696:1701, 1765:1770, 1835:1840, 1907:1912, 1978:1982, 2049:2053, 2120:2123, 2191:2194, 2262:2265, 2335:2337, 2407:2410, 2482:2483)
.
mask.ross=c(1185:1186, 1247:1251, 1311:1319, 1375:1383, 1443:1449, 1506:1516, 1568:1582, 1635:1649, 1702:1717, 1771:1785, 1841:1854, 1913:1925, 1983:1996, 2054:2066, 2124:2136, 2195:2206, 2266:2277, 2338:2348, 2411:2416, 2418:2419, 2484:2486)
.
mask.west=c(mask.west.a, mask.ross)]]></description>
		<content:encoded><![CDATA[<p>Re: <a href="#comment-365577" rel="nofollow">Hu McCulloch (#158)</a>, My bad.  If you do a truncated SVD on just the 42 locations you get different spatial weights than if you do a truncated SVD on the full 5509 locations and extract the 42 . . . but you&#8217;re not doing any truncation because you&#8217;re not doing SVD in the first place.  I&#8217;m just so used to the SVD methods now . . . <img src='http://s0.wp.com/wp-includes/images/smilies/icon_smile.gif' alt=':)' class='wp-smiley' /><br />
.<br />
I did masks that follow the traditional delineations if you find it helpful.<br />
.<br />
Peninsula:  A line from Cape Adams to the mainland south of the Eklund Islands ( <a href="http://en.wikipedia.org/wiki/Antarctic_peninsula" rel="nofollow">http://en.wikipedia.org/wiki/Antarctic_peninsula</a> ).<br />
.<br />
West:  West Antarctica is that portion of Antarctica lying on the Pacific Ocean side of the Transantarctic Mountains.  ( <a href="http://en.wikipedia.org/wiki/West_Antarctica" rel="nofollow">http://en.wikipedia.org/wiki/West_Antarctica</a> )<br />
.<br />
East is everything else.  I also did a mask for just the Ross Sea.  These are refined from what I did earlier.  The full West Antarctic mask is simply &#8220;mask.west.a&#8221; plus &#8220;mask.ross&#8221; and east would be all grid cells not allocated in these masks.<br />
.<br />
mask.pen=c(1:114, 117:128, 140:152, 166:181, 195:208, 223:235, 250:260, 278:287, 310:317, 345:350, 383:386, 420:422, 457:459)<br />
.<br />
mask.west.a=c(115, 116, 129:139, 153:165, 182:194, 209:222, 236:249, 261:277, 288:309, 318:344, 351:382, 387:419, 423:456, 460:495, 497:535, 538:575, 578:615, 620:657, 663:700, 707:743, 752:787, 797:832, 843:878, 891:924, 938:970, 988:1020, 1043:1074, 1101:1131, 1163:1184, 1187:1192, 1227:1246, 1252:1256, 1292:1310, 1357:1374, 1424:1442, 1493:1505, 1560:1567, 1628:1634, 1696:1701, 1765:1770, 1835:1840, 1907:1912, 1978:1982, 2049:2053, 2120:2123, 2191:2194, 2262:2265, 2335:2337, 2407:2410, 2482:2483)<br />
.<br />
mask.ross=c(1185:1186, 1247:1251, 1311:1319, 1375:1383, 1443:1449, 1506:1516, 1568:1582, 1635:1649, 1702:1717, 1771:1785, 1841:1854, 1913:1925, 1983:1996, 2054:2066, 2124:2136, 2195:2206, 2266:2277, 2338:2348, 2411:2416, 2418:2419, 2484:2486)<br />
.<br />
mask.west=c(mask.west.a, mask.ross)</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Kenneth Fritsch</title>
		<link>http://climateaudit.org/2009/02/26/steig-2009s-non-correction-for-serial-correlation/#comment-178205</link>
		<dc:creator><![CDATA[Kenneth Fritsch]]></dc:creator>
		<pubDate>Mon, 16 Nov 2009 17:58:38 +0000</pubDate>
		<guid isPermaLink="false">http://www.climateaudit.org/?p=5341#comment-178205</guid>
		<description><![CDATA[Re: &lt;a href=&quot;#comment-365577&quot; rel=&quot;nofollow&quot;&gt;Hu McCulloch (#158)&lt;/a&gt;,

As I recall Steig admits that he gets the Peninsula trend wrong, but waves that off by stating it is small price to pay for getting the rest of Antarctica correct and besides we know that the Peninsula is heating up due to all the measurements we have of that area.

The main thesis of the Steig paper, in my judgment, was that counter to treating the Peninsula of Antarctica as a special and isolated climate area, one could show that the warming of the Peninsula had spread into West (especially) and East Antarctica.

Showing that the Peninsula is warming at a much faster rate than the remaining 95% of the Antarctica area and to even the exclusion of much warming in that larger area would not have made the cover of Nature. If the authors artifically spread some of that Peninsula warming to West Antarctica their conclusion as captured by Nature is misleading.]]></description>
		<content:encoded><![CDATA[<p>Re: <a href="#comment-365577" rel="nofollow">Hu McCulloch (#158)</a>,</p>
<p>As I recall Steig admits that he gets the Peninsula trend wrong, but waves that off by stating it is small price to pay for getting the rest of Antarctica correct and besides we know that the Peninsula is heating up due to all the measurements we have of that area.</p>
<p>The main thesis of the Steig paper, in my judgment, was that counter to treating the Peninsula of Antarctica as a special and isolated climate area, one could show that the warming of the Peninsula had spread into West (especially) and East Antarctica.</p>
<p>Showing that the Peninsula is warming at a much faster rate than the remaining 95% of the Antarctica area and to even the exclusion of much warming in that larger area would not have made the cover of Nature. If the authors artifically spread some of that Peninsula warming to West Antarctica their conclusion as captured by Nature is misleading.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Hu McCulloch</title>
		<link>http://climateaudit.org/2009/02/26/steig-2009s-non-correction-for-serial-correlation/#comment-178204</link>
		<dc:creator><![CDATA[Hu McCulloch]]></dc:creator>
		<pubDate>Mon, 16 Nov 2009 16:28:37 +0000</pubDate>
		<guid isPermaLink="false">http://www.climateaudit.org/?p=5341#comment-178204</guid>
		<description><![CDATA[RE Ryan O #157,
  I&#039;m not quite sure what you mean.  Computing the full 5509x5509 covariance matrix and then extracing the 42x5509 submatrix you need should be equivalent to just computing that submatrix in the first place, without having to use up .2 GB or so of memory for the full matrix.  AVHRR covariances between unoccupied gridsquares can easily be computed, but aren&#039;t necessary for inferring unoccupied square temperature anomalies from occupied square anomalies.

  In any event, Steig&#039;s results are obviously wrong -- given this data, there has to be more trend in the peninsula than in W. Ant., but he has it the other way around.

  I ended up modifying Steig&#039;s literal regional definitions a little to make them more reasonable -- I included the tip of the peninsula and its entire west coast in &quot;Peninsula&quot; rather than cutting it off at 60 dW and above some latitude as Steig said he did.  I also included a few degrees in all directions from the S pole in &quot;East Ant&quot;, rather than allowing &quot;W Ant&quot; to come right up to the pole as Steig said he did.  I think I used 3 degrees, but maybe 5.

  See the BAS map of &quot;Antarctic Peninsula&quot; at &lt;a href=&quot;http://wattsupwiththat.com/2009/11/14/every-cloud-has-a-silver-lining-antarctica-glacier-retreat-creates-new-carbon-dioxide-store/&quot; rel=&quot;nofollow&quot;&gt;http://wattsupwiththat.com/2009/11/14/every-cloud-has-a-silver-lining-antarctica-glacier-retreat-creates-new-carbon-dioxide-store/&lt;/a&gt; for a conventional definition.   They go all the way down to 75S (not 72S like Steig), and then impose an 80W boundary.  I just used Steig&#039;s 72S, plus an eastern boundary somewhere to exclude the tip of Thurston Island.

  If Steig really did impose the 65dS north boundary that he describes.  that would have eliminated the strongly trending King George Island stations, and might account somehow for his weak Peninsula trend.  (Just a guess.)]]></description>
		<content:encoded><![CDATA[<p>RE Ryan O #157,<br />
  I&#8217;m not quite sure what you mean.  Computing the full 5509&#215;5509 covariance matrix and then extracing the 42&#215;5509 submatrix you need should be equivalent to just computing that submatrix in the first place, without having to use up .2 GB or so of memory for the full matrix.  AVHRR covariances between unoccupied gridsquares can easily be computed, but aren&#8217;t necessary for inferring unoccupied square temperature anomalies from occupied square anomalies.</p>
<p>  In any event, Steig&#8217;s results are obviously wrong &#8212; given this data, there has to be more trend in the peninsula than in W. Ant., but he has it the other way around.</p>
<p>  I ended up modifying Steig&#8217;s literal regional definitions a little to make them more reasonable &#8212; I included the tip of the peninsula and its entire west coast in &#8220;Peninsula&#8221; rather than cutting it off at 60 dW and above some latitude as Steig said he did.  I also included a few degrees in all directions from the S pole in &#8220;East Ant&#8221;, rather than allowing &#8220;W Ant&#8221; to come right up to the pole as Steig said he did.  I think I used 3 degrees, but maybe 5.</p>
<p>  See the BAS map of &#8220;Antarctic Peninsula&#8221; at <a href="http://wattsupwiththat.com/2009/11/14/every-cloud-has-a-silver-lining-antarctica-glacier-retreat-creates-new-carbon-dioxide-store/" rel="nofollow">http://wattsupwiththat.com/2009/11/14/every-cloud-has-a-silver-lining-antarctica-glacier-retreat-creates-new-carbon-dioxide-store/</a> for a conventional definition.   They go all the way down to 75S (not 72S like Steig), and then impose an 80W boundary.  I just used Steig&#8217;s 72S, plus an eastern boundary somewhere to exclude the tip of Thurston Island.</p>
<p>  If Steig really did impose the 65dS north boundary that he describes.  that would have eliminated the strongly trending King George Island stations, and might account somehow for his weak Peninsula trend.  (Just a guess.)</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Ryan O</title>
		<link>http://climateaudit.org/2009/02/26/steig-2009s-non-correction-for-serial-correlation/#comment-178203</link>
		<dc:creator><![CDATA[Ryan O]]></dc:creator>
		<pubDate>Mon, 16 Nov 2009 15:26:12 +0000</pubDate>
		<guid isPermaLink="false">http://www.climateaudit.org/?p=5341#comment-178203</guid>
		<description><![CDATA[Re: &lt;a href=&quot;#comment-365492&quot; rel=&quot;nofollow&quot;&gt;Hu McCulloch (#155)&lt;/a&gt;, A couple of quick notes . . . the spatial structure is different if you compute the 42x5509 covariance matrix rather than computing the 5509x5509 matrix and extracting the 42 locations.  The latter approach is what we (effectively) ended up doing, as it provides better cross validation statistics.  I say effectively because the optimal number of retained AVHRR eigenvectors (in terms of cross validation statistics) is approximately 80 and the statistics change very little between using 80 and all 288.
.
Jeff Id did a similar exercise using trending anomalies (so we could have a sanity check that does not depend on any fancy infilling algorithms and PCA).  I don&#039;t remember off the top of my head which post it is at tAV.
.
BTW . . . did you use Steig&#039;s geographic definitions or more fine-tuned ones?]]></description>
		<content:encoded><![CDATA[<p>Re: <a href="#comment-365492" rel="nofollow">Hu McCulloch (#155)</a>, A couple of quick notes . . . the spatial structure is different if you compute the 42&#215;5509 covariance matrix rather than computing the 5509&#215;5509 matrix and extracting the 42 locations.  The latter approach is what we (effectively) ended up doing, as it provides better cross validation statistics.  I say effectively because the optimal number of retained AVHRR eigenvectors (in terms of cross validation statistics) is approximately 80 and the statistics change very little between using 80 and all 288.<br />
.<br />
Jeff Id did a similar exercise using trending anomalies (so we could have a sanity check that does not depend on any fancy infilling algorithms and PCA).  I don&#8217;t remember off the top of my head which post it is at tAV.<br />
.<br />
BTW . . . did you use Steig&#8217;s geographic definitions or more fine-tuned ones?</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Hu McCulloch</title>
		<link>http://climateaudit.org/2009/02/26/steig-2009s-non-correction-for-serial-correlation/#comment-178202</link>
		<dc:creator><![CDATA[Hu McCulloch]]></dc:creator>
		<pubDate>Sat, 14 Nov 2009 16:47:35 +0000</pubDate>
		<guid isPermaLink="false">http://www.climateaudit.org/?p=5341#comment-178202</guid>
		<description><![CDATA[RE Dr. Michael Koch, #153,
  Best of luck with your forthcoming book, but I&#039;m afraid you&#039;re greatly overstating my own contribution to the Steig Antarctica subject.  My only claim to &quot;fame&quot; here is to find that Steig et al somewhat overstated the significance of their results by neglecting to take the elementary precaution of testing and correcting for serial correlation in their time series residuals.

As it happens, the key W. Ant. trend for their full period of study was still significant (though less strongly) after this was corrected (as replicated in the subsequent Steig Corrigendum), so I can&#039;t be said to have reversed their conclusions.

Of course, you&#039;re welcome to cite discussion here by Kenneth Fritsch of the robustness of Steig&#039;s results to shorter time periods, and by Ryan O, the two Jeffs and RomanM on Steig&#039;s use of RegEM, but please attribute those findings to their respective authors.]]></description>
		<content:encoded><![CDATA[<p>RE Dr. Michael Koch, #153,<br />
  Best of luck with your forthcoming book, but I&#8217;m afraid you&#8217;re greatly overstating my own contribution to the Steig Antarctica subject.  My only claim to &#8220;fame&#8221; here is to find that Steig et al somewhat overstated the significance of their results by neglecting to take the elementary precaution of testing and correcting for serial correlation in their time series residuals.</p>
<p>As it happens, the key W. Ant. trend for their full period of study was still significant (though less strongly) after this was corrected (as replicated in the subsequent Steig Corrigendum), so I can&#8217;t be said to have reversed their conclusions.</p>
<p>Of course, you&#8217;re welcome to cite discussion here by Kenneth Fritsch of the robustness of Steig&#8217;s results to shorter time periods, and by Ryan O, the two Jeffs and RomanM on Steig&#8217;s use of RegEM, but please attribute those findings to their respective authors.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Hu McCulloch</title>
		<link>http://climateaudit.org/2009/02/26/steig-2009s-non-correction-for-serial-correlation/#comment-178201</link>
		<dc:creator><![CDATA[Hu McCulloch]]></dc:creator>
		<pubDate>Sat, 14 Nov 2009 15:37:08 +0000</pubDate>
		<guid isPermaLink="false">http://www.climateaudit.org/?p=5341#comment-178201</guid>
		<description><![CDATA[RE Ryan O, #154,
  Please do send it along.  My e-mail is mcculloch dot 2 at osu dot edu.

I was able to get some interesting results using Steig&#039;s AVHRR data plus the manned stations, but without using RegEM or PCA, simply by computing a covariance matrix from the avhrr file, associating each of the 42 (or fewer  -- see below) manned stations with its avhrr cell, and then projecting the value of each avhrr cell for each month from that month&#039;s available stations.

Unfortunately, my scripts went down in a disk failure (backup! backup!), and I&#039;m too busy with something else to reconstruct them now, but here are some of my observations:

1.  Several of the stations are not within 50 km of any of the 50-km AVHRR gridsquares representing the ice cap.  Several (6 or so) are on K George Is in the S. Shetland Is, about 100 km away from the coast, so I just assigned them to the nearest gridsquare, which happened to also contain O&#039;Higgins on the Peninsula.  Others (S. Orkneys etc) were 700-2000 km from the nearest avhrr grid square, so I declared these unusable.

2. Stations sharing gridsquares effectively are multiple observations on the same temperature by my model, and so may as well just be averaged together to a single record for that gridsquare (as available).

3.  The only covariances that are required are those between the (somewhat fewer than) 42 gridsquares with station data and the 5509 gridsquares.  Therefore at most only a 42x5509 covariance matrix needs to be in memory.  This is fortunate, since 5509 x 5509 is getting pretty unwieldy.

4.  Plotting the covariances of several key stations -- Byrd, Scott-Amundsen, McMurdo, O&#039;Higgins, Russkaya, Adelaide, etc with the entire continent shows plausible and useful patterns -- there is generally close correlation up close, with decaying correlation as distance increases, but the AVHRR correlations clearly show that the Transantarctic Range is a big barrier to weather -- Byrd correlates with W. Ant, but not S. Pole, while S. Pole correlates with E. Ant but not W. Ant.  O&#039;Higgins (plus S. Shetlands) doesn&#039;t correlate much with W. Ant, but Adelaide (which shares its cell with another station whose name I don&#039;t recall) does correlate at least with the adjacent part of W. Ant., and has a long record.  So Steig&#039;s AVHRR strategy does have a lot to be said for it over simple Kriging.  Lubos did find that distance has a lot of explanatory power for correlation, but the AVHRR correlations should be even better.

5. Ordinary demeaning of the station data will virtually eliminate any continental time trend, since there are very few stations that cover the entire period (Scott-Amundsen at the S pole being a notable exception).  If there is a continental trend (which we must be open to if we wish to determine empirically whether or not there is one!), demeaning each station relative to its own observation period will bias the results towards no trend (either way).  In order to preserve any trend signal that is present (while allowing the trend to vary with location and therefore region), it is necessary to compute what I call &lt;i&gt;trending anomalies&lt;/i&gt;, ie. fit each station&#039;s data to a time trend passing through 0 at the middle of the period (month 300.5), with seasonal dummies adding to zero for each month of the year, and add the residuals to the trendline. &lt;i&gt;(sentence corrected 10:57 AM EST)&lt;/i&gt;

A station like Byrd, which has a distinct uptrend during its 15 years or so of reporting early in the 50-year study period, will therefore end up having distinctly negative trending anomalies, but would have anomalies averaging to zero using simple demeaning.  Since it dominates W. Ant while it existed, this will make a big difference for the regional trend.

The resulting extrapolated trending anomalies will contain a lot of spurious noise, but that will just be part of the noise in the final reconstruction, and should just average out or cause big CI&#039;s if it is not for real.

6. The peninsula trend ends up much stronger than Steig found, since his 3 PC RegEM approach blurs the detailed covariance information obtainable from the AVHRR file.  W. Ant ends up with a bigger point estimate than Steig found, but weaker than the peninsula, and much more localized toward the peninsula and away from McMurdo than Steig finds.  I didn&#039;t get around to scrutinizing its significance, but it probably was significant.  E. Ant wasn&#039;t doing much.

But of course replicating and scrutinizing Steig&#039;s findings with his own RegEM methodology, which is your goal, is also worth doing and publishing.]]></description>
		<content:encoded><![CDATA[<p>RE Ryan O, #154,<br />
  Please do send it along.  My e-mail is mcculloch dot 2 at osu dot edu.</p>
<p>I was able to get some interesting results using Steig&#8217;s AVHRR data plus the manned stations, but without using RegEM or PCA, simply by computing a covariance matrix from the avhrr file, associating each of the 42 (or fewer  &#8212; see below) manned stations with its avhrr cell, and then projecting the value of each avhrr cell for each month from that month&#8217;s available stations.</p>
<p>Unfortunately, my scripts went down in a disk failure (backup! backup!), and I&#8217;m too busy with something else to reconstruct them now, but here are some of my observations:</p>
<p>1.  Several of the stations are not within 50 km of any of the 50-km AVHRR gridsquares representing the ice cap.  Several (6 or so) are on K George Is in the S. Shetland Is, about 100 km away from the coast, so I just assigned them to the nearest gridsquare, which happened to also contain O&#8217;Higgins on the Peninsula.  Others (S. Orkneys etc) were 700-2000 km from the nearest avhrr grid square, so I declared these unusable.</p>
<p>2. Stations sharing gridsquares effectively are multiple observations on the same temperature by my model, and so may as well just be averaged together to a single record for that gridsquare (as available).</p>
<p>3.  The only covariances that are required are those between the (somewhat fewer than) 42 gridsquares with station data and the 5509 gridsquares.  Therefore at most only a 42&#215;5509 covariance matrix needs to be in memory.  This is fortunate, since 5509 x 5509 is getting pretty unwieldy.</p>
<p>4.  Plotting the covariances of several key stations &#8212; Byrd, Scott-Amundsen, McMurdo, O&#8217;Higgins, Russkaya, Adelaide, etc with the entire continent shows plausible and useful patterns &#8212; there is generally close correlation up close, with decaying correlation as distance increases, but the AVHRR correlations clearly show that the Transantarctic Range is a big barrier to weather &#8212; Byrd correlates with W. Ant, but not S. Pole, while S. Pole correlates with E. Ant but not W. Ant.  O&#8217;Higgins (plus S. Shetlands) doesn&#8217;t correlate much with W. Ant, but Adelaide (which shares its cell with another station whose name I don&#8217;t recall) does correlate at least with the adjacent part of W. Ant., and has a long record.  So Steig&#8217;s AVHRR strategy does have a lot to be said for it over simple Kriging.  Lubos did find that distance has a lot of explanatory power for correlation, but the AVHRR correlations should be even better.</p>
<p>5. Ordinary demeaning of the station data will virtually eliminate any continental time trend, since there are very few stations that cover the entire period (Scott-Amundsen at the S pole being a notable exception).  If there is a continental trend (which we must be open to if we wish to determine empirically whether or not there is one!), demeaning each station relative to its own observation period will bias the results towards no trend (either way).  In order to preserve any trend signal that is present (while allowing the trend to vary with location and therefore region), it is necessary to compute what I call <i>trending anomalies</i>, ie. fit each station&#8217;s data to a time trend passing through 0 at the middle of the period (month 300.5), with seasonal dummies adding to zero for each month of the year, and add the residuals to the trendline. <i>(sentence corrected 10:57 AM EST)</i></p>
<p>A station like Byrd, which has a distinct uptrend during its 15 years or so of reporting early in the 50-year study period, will therefore end up having distinctly negative trending anomalies, but would have anomalies averaging to zero using simple demeaning.  Since it dominates W. Ant while it existed, this will make a big difference for the regional trend.</p>
<p>The resulting extrapolated trending anomalies will contain a lot of spurious noise, but that will just be part of the noise in the final reconstruction, and should just average out or cause big CI&#8217;s if it is not for real.</p>
<p>6. The peninsula trend ends up much stronger than Steig found, since his 3 PC RegEM approach blurs the detailed covariance information obtainable from the AVHRR file.  W. Ant ends up with a bigger point estimate than Steig found, but weaker than the peninsula, and much more localized toward the peninsula and away from McMurdo than Steig finds.  I didn&#8217;t get around to scrutinizing its significance, but it probably was significant.  E. Ant wasn&#8217;t doing much.</p>
<p>But of course replicating and scrutinizing Steig&#8217;s findings with his own RegEM methodology, which is your goal, is also worth doing and publishing.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Ryan O</title>
		<link>http://climateaudit.org/2009/02/26/steig-2009s-non-correction-for-serial-correlation/#comment-178200</link>
		<dc:creator><![CDATA[Ryan O]]></dc:creator>
		<pubDate>Thu, 12 Nov 2009 17:14:54 +0000</pubDate>
		<guid isPermaLink="false">http://www.climateaudit.org/?p=5341#comment-178200</guid>
		<description><![CDATA[Re: &lt;a href=&quot;#comment-356178&quot; rel=&quot;nofollow&quot;&gt;Hu McCulloch (#152)&lt;/a&gt;, Thanks.  Duh.  Nic Lewis corrected me on this as well.
.
BTW, I was wondering if you might be interested in reviewing and commenting on the paper once I have a draft completed.  Right now, I&#039;m at about 70% complete on the main paper and 20% complete on the Supplemental Information.]]></description>
		<content:encoded><![CDATA[<p>Re: <a href="#comment-356178" rel="nofollow">Hu McCulloch (#152)</a>, Thanks.  Duh.  Nic Lewis corrected me on this as well.<br />
.<br />
BTW, I was wondering if you might be interested in reviewing and commenting on the paper once I have a draft completed.  Right now, I&#8217;m at about 70% complete on the main paper and 20% complete on the Supplemental Information.</p>
]]></content:encoded>
	</item>
</channel>
</rss>
