<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:georss="http://www.georss.org/georss" xmlns:geo="http://www.w3.org/2003/01/geo/wgs84_pos#" xmlns:media="http://search.yahoo.com/mrss/"
		>
<channel>
	<title>Comments on: Some Data and Scripts for BS09</title>
	<atom:link href="http://climateaudit.org/2009/08/09/some-data-and-scripts-for-bs09/feed/" rel="self" type="application/rss+xml" />
	<link>http://climateaudit.org/2009/08/09/some-data-and-scripts-for-bs09/</link>
	<description>by Steve McIntyre</description>
	<lastBuildDate>Tue, 21 May 2013 15:32:22 +0000</lastBuildDate>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.com/</generator>
	<item>
		<title>By: Scientists Debunk Global Warming - Green Living - Sustainable living, ecology, conservation, local agriculture - Page 9 - City-Data Forum</title>
		<link>http://climateaudit.org/2009/08/09/some-data-and-scripts-for-bs09/#comment-210277</link>
		<dc:creator><![CDATA[Scientists Debunk Global Warming - Green Living - Sustainable living, ecology, conservation, local agriculture - Page 9 - City-Data Forum]]></dc:creator>
		<pubDate>Fri, 18 Dec 2009 17:37:49 +0000</pubDate>
		<guid isPermaLink="false">http://www.climateaudit.org/?p=6774#comment-210277</guid>
		<description><![CDATA[[...]  [...]]]></description>
		<content:encoded><![CDATA[<p>[...]  [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: snowmaneasy</title>
		<link>http://climateaudit.org/2009/08/09/some-data-and-scripts-for-bs09/#comment-190840</link>
		<dc:creator><![CDATA[snowmaneasy]]></dc:creator>
		<pubDate>Tue, 18 Aug 2009 19:00:14 +0000</pubDate>
		<guid isPermaLink="false">http://www.climateaudit.org/?p=6774#comment-190840</guid>
		<description><![CDATA[Any comments on Dr.Scafetta&#039;s latest paper in Journal of Atmospheric and Solar-Terrestial Physics (3-August 2009)...Empirical analysis of the Solar contribution to global mean air surface temperature change ???
http://nl.sitestat.com/elsevier/elsevier-com/s?sciencedirect&amp;ns_type=clickout&amp;ns_url=http://www.sciencedirect.com/science?_ob=GatewayURL&amp;_origin=IRSSCONTENT&amp;_method=citationSearch&amp;_piikey=S1364682609002089&amp;_version=1&amp;md5=b11a528b6b4f4723612f26f9355a7f4f]]></description>
		<content:encoded><![CDATA[<p>Any comments on Dr.Scafetta&#8217;s latest paper in Journal of Atmospheric and Solar-Terrestial Physics (3-August 2009)&#8230;Empirical analysis of the Solar contribution to global mean air surface temperature change ???<br />
<a href="http://nl.sitestat.com/elsevier/elsevier-com/s?sciencedirect&#038;ns_type=clickout&#038;ns_url=http://www.sciencedirect.com/science?_ob=GatewayURL&#038;_origin=IRSSCONTENT&#038;_method=citationSearch&#038;_piikey=S1364682609002089&#038;_version=1&#038;md5=b11a528b6b4f4723612f26f9355a7f4f" rel="nofollow">http://nl.sitestat.com/elsevier/elsevier-com/s?sciencedirect&#038;ns_type=clickout&#038;ns_url=http://www.sciencedirect.com/science?_ob=GatewayURL&#038;_origin=IRSSCONTENT&#038;_method=citationSearch&#038;_piikey=S1364682609002089&#038;_version=1&#038;md5=b11a528b6b4f4723612f26f9355a7f4f</a></p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Kenneth Fritsch</title>
		<link>http://climateaudit.org/2009/08/09/some-data-and-scripts-for-bs09/#comment-190839</link>
		<dc:creator><![CDATA[Kenneth Fritsch]]></dc:creator>
		<pubDate>Thu, 13 Aug 2009 16:55:16 +0000</pubDate>
		<guid isPermaLink="false">http://www.climateaudit.org/?p=6774#comment-190839</guid>
		<description><![CDATA[Mark T, your replies have been helpful in pointing me to my confusion and lack of understanding of wavelet analysis.  I read the following three links which helped me better understand wavelet analysis and appreciate why Scafetta and West might apply this type of analysis to TSI and temperature time series  and, of course, better understand the comments that you have made previously in this discussion.

Would you have any better references for a layperson attempting to understand enough about wavelet analysis to make better sense of the Scafetta and West paper?

Can you link me to other climate studies where wavelet analysis was used?

Once a wavelet analysis is carried out what is the end game?  Can you give examples? It appears from reviews that I have read that Scafetta and West were doing pattern matching of TSI and temperatures proxies.  Is that often part of the analysis in wavelet analyses?  Obviously I need to read more on wavelet analysis.

A Fifteen Minutes Introduction of Wavelet Transform and Applications, by Paul C. Liu:

http://www.iaa.ncku.edu.tw/~jjmiau/15Wavelet.pdf

A book review of “An introduction to wavelet analysis”, by David F. Walnut:

http://www.math.uiowa.edu/~jorgen/walnut.pdf

Wavelet analysis of chaotic time series by J.S. Murgu´ıa and E. Campos-Cant´on:

http://www.ejournal.unam.mx/rmf/no522/RMF52211.pdf]]></description>
		<content:encoded><![CDATA[<p>Mark T, your replies have been helpful in pointing me to my confusion and lack of understanding of wavelet analysis.  I read the following three links which helped me better understand wavelet analysis and appreciate why Scafetta and West might apply this type of analysis to TSI and temperature time series  and, of course, better understand the comments that you have made previously in this discussion.</p>
<p>Would you have any better references for a layperson attempting to understand enough about wavelet analysis to make better sense of the Scafetta and West paper?</p>
<p>Can you link me to other climate studies where wavelet analysis was used?</p>
<p>Once a wavelet analysis is carried out what is the end game?  Can you give examples? It appears from reviews that I have read that Scafetta and West were doing pattern matching of TSI and temperatures proxies.  Is that often part of the analysis in wavelet analyses?  Obviously I need to read more on wavelet analysis.</p>
<p>A Fifteen Minutes Introduction of Wavelet Transform and Applications, by Paul C. Liu:</p>
<p><a href="http://www.iaa.ncku.edu.tw/~jjmiau/15Wavelet.pdf" rel="nofollow">http://www.iaa.ncku.edu.tw/~jjmiau/15Wavelet.pdf</a></p>
<p>A book review of “An introduction to wavelet analysis”, by David F. Walnut:</p>
<p><a href="http://www.math.uiowa.edu/~jorgen/walnut.pdf" rel="nofollow">http://www.math.uiowa.edu/~jorgen/walnut.pdf</a></p>
<p>Wavelet analysis of chaotic time series by J.S. Murgu´ıa and E. Campos-Cant´on:</p>
<p><a href="http://www.ejournal.unam.mx/rmf/no522/RMF52211.pdf" rel="nofollow">http://www.ejournal.unam.mx/rmf/no522/RMF52211.pdf</a></p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Calvin Ball</title>
		<link>http://climateaudit.org/2009/08/09/some-data-and-scripts-for-bs09/#comment-190838</link>
		<dc:creator><![CDATA[Calvin Ball]]></dc:creator>
		<pubDate>Thu, 13 Aug 2009 02:45:59 +0000</pubDate>
		<guid isPermaLink="false">http://www.climateaudit.org/?p=6774#comment-190838</guid>
		<description><![CDATA[&lt;blockquote&gt;Even white noise will occasionally produce a match, further complicating the analysts life!&lt;/blockquote&gt;

Which is how we get Allahfish and Mary on toast. And this:
]]></description>
		<content:encoded><![CDATA[<blockquote><p>Even white noise will occasionally produce a match, further complicating the analysts life!</p></blockquote>
<p>Which is how we get Allahfish and Mary on toast. And this:</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Mark T</title>
		<link>http://climateaudit.org/2009/08/09/some-data-and-scripts-for-bs09/#comment-190837</link>
		<dc:creator><![CDATA[Mark T]]></dc:creator>
		<pubDate>Wed, 12 Aug 2009 16:56:46 +0000</pubDate>
		<guid isPermaLink="false">http://www.climateaudit.org/?p=6774#comment-190837</guid>
		<description><![CDATA[Re: &lt;a href=&quot;#comment-352653&quot; rel=&quot;nofollow&quot;&gt;Kenneth Fritsch (#148)&lt;/a&gt;,
&lt;blockquote&gt;What if one had a time series from a chaotic system and applied wavelet theory to it? &lt;/blockquote&gt;
That&#039;s what you would use it for, actually.  As I hinted at, however, you have to be wary when you get &quot;hits&quot; that don&#039;t repeat or are not otherwise regular.  The same applies for Fourier analysis, too (which bender and I have discussed at length.)  Even white noise will occasionally produce a match, further complicating the analysts life!

&lt;blockquote&gt;Is there something in the wavelet analysis that avoids or mitigates this problem?&lt;/blockquote&gt;
Uh, not really, but each stage of the wavelet decomposition has a specific bandwidth, so you won&#039;t &quot;match&quot; to a single pattern but a range of frequencies.  This is not unlike a Fourier transform, btw, which has a range of frequencies in each &quot;bin.&quot;  The difference, of course, is that the wavelet decomposition also provides time localization (as I described above) whereas a single Fourier Transform only has one time index: everywhere in the series.
.
I think, btw, that you would note that even what you are doing would result in a range of frequencies/signals that provide a result, too.  The correlator receiver, useful for CDMA communication systems, is similar.  Consider all the effort that went into finding codes that do NOT have a range of signals that correlate well with your desired signal!
.
Mark]]></description>
		<content:encoded><![CDATA[<p>Re: <a href="#comment-352653" rel="nofollow">Kenneth Fritsch (#148)</a>,</p>
<blockquote><p>What if one had a time series from a chaotic system and applied wavelet theory to it? </p></blockquote>
<p>That&#8217;s what you would use it for, actually.  As I hinted at, however, you have to be wary when you get &#8220;hits&#8221; that don&#8217;t repeat or are not otherwise regular.  The same applies for Fourier analysis, too (which bender and I have discussed at length.)  Even white noise will occasionally produce a match, further complicating the analysts life!</p>
<blockquote><p>Is there something in the wavelet analysis that avoids or mitigates this problem?</p></blockquote>
<p>Uh, not really, but each stage of the wavelet decomposition has a specific bandwidth, so you won&#8217;t &#8220;match&#8221; to a single pattern but a range of frequencies.  This is not unlike a Fourier transform, btw, which has a range of frequencies in each &#8220;bin.&#8221;  The difference, of course, is that the wavelet decomposition also provides time localization (as I described above) whereas a single Fourier Transform only has one time index: everywhere in the series.<br />
.<br />
I think, btw, that you would note that even what you are doing would result in a range of frequencies/signals that provide a result, too.  The correlator receiver, useful for CDMA communication systems, is similar.  Consider all the effort that went into finding codes that do NOT have a range of signals that correlate well with your desired signal!<br />
.<br />
Mark</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: lucia</title>
		<link>http://climateaudit.org/2009/08/09/some-data-and-scripts-for-bs09/#comment-190836</link>
		<dc:creator><![CDATA[lucia]]></dc:creator>
		<pubDate>Wed, 12 Aug 2009 15:17:24 +0000</pubDate>
		<guid isPermaLink="false">http://www.climateaudit.org/?p=6774#comment-190836</guid>
		<description><![CDATA[JeffId--
I communicated with Gavin, Rasmus and by email.  I have a current version of Rasmus&#039;s code with the modifications based on what they think Nicola meant in Pielke&#039;s thread. But... I promised not to circulate that and had described what I hoped to explore using their code. I&#039;m interested in their tests of Nicola&#039;s method using synthetic solar and surface temperatures modeled white noise and I want to see what happens if I tweak that a bit. (I also explained I am not good with R, so it may take me a while.)]]></description>
		<content:encoded><![CDATA[<p>JeffId&#8211;<br />
I communicated with Gavin, Rasmus and by email.  I have a current version of Rasmus&#8217;s code with the modifications based on what they think Nicola meant in Pielke&#8217;s thread. But&#8230; I promised not to circulate that and had described what I hoped to explore using their code. I&#8217;m interested in their tests of Nicola&#8217;s method using synthetic solar and surface temperatures modeled white noise and I want to see what happens if I tweak that a bit. (I also explained I am not good with R, so it may take me a while.)</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Kenneth Fritsch</title>
		<link>http://climateaudit.org/2009/08/09/some-data-and-scripts-for-bs09/#comment-190835</link>
		<dc:creator><![CDATA[Kenneth Fritsch]]></dc:creator>
		<pubDate>Wed, 12 Aug 2009 14:44:33 +0000</pubDate>
		<guid isPermaLink="false">http://www.climateaudit.org/?p=6774#comment-190835</guid>
		<description><![CDATA[Re: &lt;a href=&quot;#comment-352568&quot; rel=&quot;nofollow&quot;&gt;Mark T (#141)&lt;/a&gt;,

Thanks again Mark for taking the time to reply to my questions.  I think the point that you make in this comment is what I was looking for:

&lt;blockquote&gt;How do we know what to expect in TSI/temperature series? We don&#039;t, but if similarities show up in both, I would not have a problem if someone claimed a connection. I&#039;d expect them to describe the relationship, however, and would also be wary of any cause-effect attribution without some really, really good evidence.&lt;/blockquote&gt;

From your question here I see that my original question was poorly worded:

&lt;blockquote&gt;I think &quot;spurious&quot; in the sense of a statistical correlation is an incorrect usage of the word here. Note, however, that filtering does represent a correlation of the data with the impulse response of the filter itself. What do you mean by &quot;incorrect assumptions have been made about the generation of the signal?&quot; Basically, if the data has energy at the frequencies represented by the particular wavelet stage, it will be resolved.&lt;/blockquote&gt;

What if one had a time series from a chaotic system and applied wavelet theory to it?

What I sometimes see in pattern matching (not necessarily using wavelet analysis) is that the data set to be matched is cherry picked, or at least has the potential for such a selection, from several available series and then any discrepencies are more or less hand waved away. The end result can then a reasonably nice looking match with which I have trouble for the reason that you eluded to in the first excerpt above.  Is there something in the wavelet analysis that avoids or mitigates this problem?]]></description>
		<content:encoded><![CDATA[<p>Re: <a href="#comment-352568" rel="nofollow">Mark T (#141)</a>,</p>
<p>Thanks again Mark for taking the time to reply to my questions.  I think the point that you make in this comment is what I was looking for:</p>
<blockquote><p>How do we know what to expect in TSI/temperature series? We don&#8217;t, but if similarities show up in both, I would not have a problem if someone claimed a connection. I&#8217;d expect them to describe the relationship, however, and would also be wary of any cause-effect attribution without some really, really good evidence.</p></blockquote>
<p>From your question here I see that my original question was poorly worded:</p>
<blockquote><p>I think &#8220;spurious&#8221; in the sense of a statistical correlation is an incorrect usage of the word here. Note, however, that filtering does represent a correlation of the data with the impulse response of the filter itself. What do you mean by &#8220;incorrect assumptions have been made about the generation of the signal?&#8221; Basically, if the data has energy at the frequencies represented by the particular wavelet stage, it will be resolved.</p></blockquote>
<p>What if one had a time series from a chaotic system and applied wavelet theory to it?</p>
<p>What I sometimes see in pattern matching (not necessarily using wavelet analysis) is that the data set to be matched is cherry picked, or at least has the potential for such a selection, from several available series and then any discrepencies are more or less hand waved away. The end result can then a reasonably nice looking match with which I have trouble for the reason that you eluded to in the first excerpt above.  Is there something in the wavelet analysis that avoids or mitigates this problem?</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: John S.</title>
		<link>http://climateaudit.org/2009/08/09/some-data-and-scripts-for-bs09/#comment-190834</link>
		<dc:creator><![CDATA[John S.]]></dc:creator>
		<pubDate>Wed, 12 Aug 2009 14:36:56 +0000</pubDate>
		<guid isPermaLink="false">http://www.climateaudit.org/?p=6774#comment-190834</guid>
		<description><![CDATA[Conscientious time-series analysts have their own version of the Hippocratic oath: Do no harm to the data.  Trend removal, linear or polynomial, introduces artificial signal components with an negative sign. This may be prescribed for a strongly trending series in order to avoid an artificial sawtooth in the cyclical padding inherent in any DFT analysis.  It is totally unnecessary, however, in bona fide bandpass filtering, which removes the lowest frequencies without assuming any arbitrary form and never extends beyond the boundaries of data.

It would be nice to see Scafetta provide the frequency response function of each bandpass he employed.  It is too painful, however, to watch this thread descend into an uncomprehending mangle of analytic concepts. Adios!]]></description>
		<content:encoded><![CDATA[<p>Conscientious time-series analysts have their own version of the Hippocratic oath: Do no harm to the data.  Trend removal, linear or polynomial, introduces artificial signal components with an negative sign. This may be prescribed for a strongly trending series in order to avoid an artificial sawtooth in the cyclical padding inherent in any DFT analysis.  It is totally unnecessary, however, in bona fide bandpass filtering, which removes the lowest frequencies without assuming any arbitrary form and never extends beyond the boundaries of data.</p>
<p>It would be nice to see Scafetta provide the frequency response function of each bandpass he employed.  It is too painful, however, to watch this thread descend into an uncomprehending mangle of analytic concepts. Adios!</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Nick Stokes</title>
		<link>http://climateaudit.org/2009/08/09/some-data-and-scripts-for-bs09/#comment-190833</link>
		<dc:creator><![CDATA[Nick Stokes]]></dc:creator>
		<pubDate>Wed, 12 Aug 2009 09:50:47 +0000</pubDate>
		<guid isPermaLink="false">http://www.climateaudit.org/?p=6774#comment-190833</guid>
		<description><![CDATA[Re: &lt;a href=&quot;#comment-352619&quot; rel=&quot;nofollow&quot;&gt;Nick Stokes (#145)&lt;/a&gt;, I said Fourier when strictly it is of course a wavelet analysis. But the issues are the same, and equally disconnected from the use of detrending in correlation.]]></description>
		<content:encoded><![CDATA[<p>Re: <a href="#comment-352619" rel="nofollow">Nick Stokes (#145)</a>, I said Fourier when strictly it is of course a wavelet analysis. But the issues are the same, and equally disconnected from the use of detrending in correlation.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Nick Stokes</title>
		<link>http://climateaudit.org/2009/08/09/some-data-and-scripts-for-bs09/#comment-190832</link>
		<dc:creator><![CDATA[Nick Stokes]]></dc:creator>
		<pubDate>Wed, 12 Aug 2009 09:45:59 +0000</pubDate>
		<guid isPermaLink="false">http://www.climateaudit.org/?p=6774#comment-190832</guid>
		<description><![CDATA[Re: &lt;a href=&quot;#comment-352533&quot; rel=&quot;nofollow&quot;&gt;Steve M(#137)&lt;/a&gt;,
OK, I&#039;ve looked into the von Storch/Zorita issue. It&#039;s obviously a heated debate from the past that I don&#039;t have any wish to revive. But it is a very different situation. With BS09 etc we have a straightforward Fourier analysis, where the case for detrending is clearcut in terms of properly representing features of the data that are known to be inappropriately represented by sinusoids in time. You need to augment the set of basis functions, and detrending in effect adds the set of low order polynomials.

With VZ, MBH et al, the issues are totally different. They are not representing a time series in sinusoids. Instead they are calibrating by correlating instrumental readings with proxies. If you detrend you answer a different question - what is the correlation between the residuals after detrending? Which question is appropriate depends entirely on what you are looking for. If you believe the trends should be included in the correlation, then detrending weakens the test. I believe this was the Ammann et al view. As I understand, VZ et al believed that some of the trend in the proxies may have been unrelated to climate, so testing the correlation of residuals was safer. I have not looked into this thoroughly, and don&#039;t have a view as to who is right. It&#039;s just a  totally different aspect of detrending.]]></description>
		<content:encoded><![CDATA[<p>Re: <a href="#comment-352533" rel="nofollow">Steve M(#137)</a>,<br />
OK, I&#8217;ve looked into the von Storch/Zorita issue. It&#8217;s obviously a heated debate from the past that I don&#8217;t have any wish to revive. But it is a very different situation. With BS09 etc we have a straightforward Fourier analysis, where the case for detrending is clearcut in terms of properly representing features of the data that are known to be inappropriately represented by sinusoids in time. You need to augment the set of basis functions, and detrending in effect adds the set of low order polynomials.</p>
<p>With VZ, MBH et al, the issues are totally different. They are not representing a time series in sinusoids. Instead they are calibrating by correlating instrumental readings with proxies. If you detrend you answer a different question &#8211; what is the correlation between the residuals after detrending? Which question is appropriate depends entirely on what you are looking for. If you believe the trends should be included in the correlation, then detrending weakens the test. I believe this was the Ammann et al view. As I understand, VZ et al believed that some of the trend in the proxies may have been unrelated to climate, so testing the correlation of residuals was safer. I have not looked into this thoroughly, and don&#8217;t have a view as to who is right. It&#8217;s just a  totally different aspect of detrending.</p>
]]></content:encoded>
	</item>
</channel>
</rss>
