Saturday, March 06, 2010

Another Scientist Commends Mann et al. '08 -- Tiljander Notwithstanding

Last week, Roger Pielke Sr. headlined a critical email on his site, Guest Post By Chick Keller On The Content and Tone Of My Weblog. Dr. Keller is the retired Director of the Los Alamos National Laboratory Branch of the University of California’s Institute of Geophysics and Planetary Physics (IGPP). He's made significant contributions to the peer-reviewed literature on climate change (PDF).

While I am not a regular reader of Pielke's blog, such efforts to establish dialog among 'Consensus scientists,' 'skeptics,' and 'lukewarmers' are commendable. Given my own interests, I was most taken by the following paragraph from Chick Keller's post.


What about global and NH temperatures in the past 2,000 years? It’s just not good science to dismiss all this very careful work with — well I’m uncomfortable with the way they match proxy and instrumental data. Here a careful read of the National Academy of Sciences PNAS paper in 2008 (see Mann et al. 2008) on the best work done to date on this is in order (as well as comparison with the several other different and mostly independent treatments of the subject by other authors–bore hole results, Moberg’s wavelet combination of low and high frequency proxies, Lonnie Thompson’s mountain glacier work, etc). Pretty hard to just dismiss out of hand all these people and their rather similar results.
"See Mann et al. 2008" is a link to the PDF of the Mann group's high-profile paleoclimate paper in the high-impact, peer-reviewed journal Proceedings of the National Academy of Sciences of the USA. This is of course the work that sparked a controversy because of its use of the four lakebed sediment data series from Lake Korttajarvi, Finland -- the "Tiljander proxies."

In the excerpted text, Chick Keller makes four claims about Mann et al (2008).
1. Very careful work

2. It's not good science to dismiss... the way they match proxy and instrumental data.

3. Here a careful read of... the best work done to date on [temperatures of the past 2,000 years] is in order.

4. Pretty hard to just dismiss out of hand all these people and their rather similar results.
I don't agree. The treatment by the Mann group of the Lake Korttajarvi sediment proxies provides a good explanation of why. In this recent comment at the Center for Inquiry Forum, I offered a precise formulation of this issue, and invited journalist Chris Mooney to ask Prof. Mann for his views (Mooney declined [12 Mar. 10 link corrected]). Here are those two questions, reprinted.
Background

In September 2008, Dr. Mann’s group published an important paper on Earth’s temperature history for the past 2,000 years in the prominent peer-reviewed journal Proc. Natl. Acad. Sci. USA. Temperature signals were extracted from many long-term data series, such as tree rings and ice cores. The paper has been strongly criticized for its inclusion of the lakebed sediments characterized by Finnish geologist Mia Tiljander. Critics claim that the four Tiljander proxies are uncalibratable due to contamination of the temperature signal by local activities, from the 1700s to the present. Critics also claim that the PNAS paper mistakenly uses two of the Tiljander proxies in an upside-down orientation, such that “warmer” information is added to the paleotemperature reconstructions as “colder”, and vice versa. In his Response published in PNAS in February 2009, Dr. Mann called these criticisms “bizarre,” but he did not explicitly rebut them.

Questions

1. Can the four Tiljander proxies be calibrated to the instrumental temperature record that spans 1850 to 1995?

2. Do the PNAS paper’s reconstructions use the temperature information in the “tiljander-2003-xraydenseave” and “tiljander-2003-lightsum” series in a manner that is consistent with the interpretation offered by Mia Tiljander in her 2003 paper?
My answers to these two questions are as follows.
1. No.
2. No.
Here's additional background. A compilation of literature and data links to this issue is here. Relevant blog posts are linked here. One useful entry point to understanding the contrasting stances of Consensus advocates and skeptics is this digest of the first Stoat blog post devoted to the issue. My opinion as to "why it matters" is covered in The Null Hypothesis. Jeff Id of the Air Vent has gone beyond Tiljander to discuss the underlying statistical approach taken by Prof. Mann's group.

With that in mind, I offer these comments on Chick Keller's four points concerning Mann et al (2008).

1. Mann et al (2008) is not careful work.  It's slipshod work.  The use of the Tiljander proxies is far from the only major error in the paper.  It's just the glaringly obvious one.  But experiences at Stoat, Lucia's Blackboard and elsewhere have shown that there's no point in discussing more complex topics if we can't first agree on simple concepts like, "Yes, the number sentence '2+2=4' is true, while '2+2=5' is false."

2. It is good science to dismiss the way Mann et al (2008) matched proxy and instrumental data.  The Tiljander proxies are uncalibratable to the instrumental record.  Their misuse proves that these Mann group methods are grossly in error.  Did Mann et al make additional mistakes at the data-compilation step? Yes, almost certainly -- but they are subtler, thus not worth considering at this point.

3. To state that Mann et al is "the best work done to date on [temperatures of the past 2,000 years]" is not meant as a very harsh criticism of this field. Alas, I must take it that way.  How did this paper pass peer review and editorial scrutiny?  Why is it that in the 18 months since publication, not one "mainline" climate scientist has uttered a peep in public about it? The answers, whatever they are, cannot reflect well on practices in this branch of science.

4. As far as "dismissing out of hand" -- I've been seeking out logical, data-based defenses of Mann et al's use of the Tiljander proxies for months. I have encountered none.  (Readers are urged to provide candidate links in the comments to this post.)

I invite Chick Keller to rebut these sharp criticisms of Mann et al. (2008). In particular (and as with Mann et al advocate Boris at Lucia's Blackboard), I'm glad to offer him a guest post here, or a prominent link to his discussion of these questions at another location.

A Stark Choice

If Chick Keller is right, high-quality paleoclimate reconstructions such as those in Mann et al (2008) can supply us with useful context for evaluating the likely effects on climate of the rising concentration of CO2. Many who share Dr. Keller's point of view also strongly believe that critics are muddying the waters with irrelevant, trivial, and incorrect objections -- perhaps out of an understandable but misguided effort to avoid facing what's needed to mitigate the climate-change threat.

If I'm right, Mann et al (2008) is not simply a fatally-flawed study that's overdue for correction or retraction. Because its worst flaws are obvious, its privileged treatment by journal editors, peer-reviewers, the paleoclimate community, and AGW Censensus science-bloggers should serve as a bright red flag. Some practices have gone very amiss in paleoclimatology. Until those problems are identified and addressed, no reconstruction of the past two millenia's climate should be accorded our trust.

Which is it? The best way to find out is through clear, respectful debates on the issues.

I've emailed Chick Keller a link to this post.

4 comments:

  1. Dear Sir,

    As a an armchair scientist and fan of the scientific method, I would like to commend you on your methodical, rational, and courteous treatment of this subject and those you debate. I first encountered your dialogue on "Point of Inquiry", and was very pleased to see another who believes respectful dialogue is necessary to get to the truth at the heart of this debate. You did not rise to the bait offered by many around the blogosphere, of insult, insinuation, and distraction, but persevered with an analysis of the science (or lack thereof) available on the subject, and your take on what it means to be skeptical in this circumstance. Keep up the good work.

    ReplyDelete
  2. Dear Mr./Ms. Amac,

    I realize it's off topic, but I'd like to echo the sentiments of the first commenter on this thread. I too have been lurking on climate blogs for several months, and I've come to appreciate and learn a lot from your intelligent questions and unceasingly polite tone.

    As you have so much to bring to the discussion, I'm very happy to discover that you have a blog. I'll be checking back frequently.

    Best Regards,
    Kevin Davis

    ReplyDelete
  3. Thanks for the kind words, Kevin. It's 'Mr.,' though this pseudonym doesn't offer much help there. As of checking back, er, 'infrequently' might be a better strategy.

    I've been surprised and dismayed at how doggedly partisans will hold on to a comfortable preconceived notion; the inability to see Tiljander as Uncalibratable and Upside-Down is a poster child of this phenomenon for AGW Consensus scientists and advocates.

    Not really a blog, this site is more of a collection of links and arguments to aid people in evaluating the claims of Mann et al (PNAS, 2008).

    If Prof. Mann ultimately decides to correct the record with de minimis re-calculations, I'll look more closely at the underlying methodology of the paper, as Jeff Id has done at "the Air Vent." As The Null Hypothesis suggests, the problems with Mann et al (2008) don't end with this one data set.

    For now, the site's modest role is to point out that calibrated proxies should be calibratable, and that proxies should be used Right-Side-Up, whether calibrated or not. Those seem like simple enough points...

    ReplyDelete
  4. RE: Amac #3--

    "Those seem like simple enough points..."

    Indeed. The misuse of the Tiljander sediments seems to be such an obvious mistake that, when I saw intelligent people like Dr. Connolley defending it so adamantly, I thought that my own understanding must be lacking somewhere. It took me a long time to conclude that my initial impression was correct: it really isn't very complicated.

    I appreciate how you try to remain focused on the actual scientific issues, but I can't help but to be a bit fascinated by the behavioral aspect to the whole discussion. Perhaps psychologists will be studying this as a phenomenon in a decade or two.

    Best Regards,
    Kevin Davis

    ReplyDelete