Cooking the Books on 'Global Warming?' Are the Numbers Fudged?

by mgmirkin | November 17, 2008 at 07:44 pm
962 views | 46 Recommendations | 11 comments

Photos

'Global Warming' Hockey Stick (Graph)

'Global Warming' Hockey Stick (Graph)

see larger image

uploaded by mgmirkin

It seems that, of late, the global warming debate has become a divisive issue at home and abroad. Global warming advocates claim to have irrefutably proven that man is the primary cause of warming trends seen in data from around the world. This may be true, but not in the way that advocates had thought... Have the numbers been fudged and the public misled (unintentionally or otherwise)?

The latest volley from the global warming denier crowd seems to be damaging the credibility of the leading climate change advocate, Dr. James Hansen and the studies on climate change coming out of the GISS (Goddard Institute for Space Studies).

The debate has raged for several years now, starting largely with the 2005 'debunking,' by global warming deniers, of the so-called 'hockey stick graph' lauded by AGW (Anthopogenic [human-caused] Global Warming) proponents.

The hockey stick debate is about two things. At a technical level it concerns a well-known study that characterized the state of the Earth’s climate over the past thousand years and seemed to prove a recent and unprecedented global warming. I will explain how the study got the results it did, examine some key flaws in the methodology and explain why the conclusions are unsupported by the data. At the political level the emerging debate is about whether the enormous international trust that has been placed in the IPCC was betrayed. The hockey stick story reveals that the IPCC allowed a deeply flawed study to dominate the Third Assessment Report, which suggests the possibility of bias in the Report-writing process. In view of the massive global influence of IPCC Reports, there is an urgent need to bias-proof future assessments in order to put climate policy onto a new foundation that will better serve the public interest.

In the 'debunking,' it was purportedly shown that the algorithm used to construct the 'hockey stick graph' "concludes that a hockey stick is the dominant pattern [in sample data] even in pure noise."

In 10,000 repetitions on groups of red noise, we found that a conventional PC [Principle Component] algorithm almost never yielded a hockey stick shaped PC1 [first PC], but the Mann algorithm yielded a pronounced hockey stick-shaped PC1 over 99% of the time. The reason is that in some of the red noise series there is a ‘pseudo-trend’ at the end, where a random shock causes the data to drift upwards, and before it can decay back to the mean the series comes to an end. The Mann algorithm efficiently looks for those kinds of series and flags them for maximum weighting. It concludes that a hockey stick is the dominant pattern even in pure noise.

More recently, it seems that studies of old meteorological information contained in historical logs of Britain's Royal Navy from the time of Lord Nelson and Captain Cook have shown distinct warming trends not unlike today's global warming.

The problem, of course, is that back in their day there was no 'industrialized world' spewing tons of carbon dioxide and methane emissions into the atmosphere (the cause assumed for today's purported global warming). In other words, AGW could not have been the cause of warming trends during that time period. They are instead assumed to be natural in origin.

Scientists have uncovered a treasure trove of meteorological information contained in the detailed logs kept by those on board the vessels that established Britain's great seafaring traditition including those on Nelsons' Victory and Cook's Endeavour.

Every Royal Naval ship kept a detailed record of climate including air pressure, wind strength, air and sea temperature and major meteorological disturbances.

A group of academics and Met Office scientists has unearthed the records dating from the 1600s and examined more than 6,000 logs, which have provided one of the world's best sources for long-term weather data.

Their studies have raised questions about modern climate change theories. A paper by Dennis Wheeler, a geographer based at Sunderland University, recounts an increasing number of summer storms over Britain in the late 17th century.

Many scientists believe that storms are caused by global warming, but these were came during the so-called Little Ice Age that affected Europe from about 1600 to 1850.

The records also suggest that Europe saw a spell of rapid warming, similar to that experienced today, during the 1730s that must have been caused naturally.

A more recent set of data on another 'greenhouse gas,' methane, has surprised scientists. It seems that methane in the atmosphere has risen dramatically across the globe. But it did so in such a short amount of time and so ubiquitously [in both hemispheres simultaneously] that it appears to contradict current theories assigning blame to humans for its atmospheric abundance.

Boston (MA) - Scientists at MIT have recorded a nearly simultaneous world-wide increase in methane levels. This is the first increase in ten years, and what baffles science is that this data contradicts theories stating man is the primary source of increase for this greenhouse gas. It takes about one full year for gases generated in the highly industrial northern hemisphere to cycle through and reach the southern hemisphere. However, since all worldwide levels rose simultaneously throughout the same year, it is now believed this may be part of a natural cycle in mother nature - and not the direct result of man's contributions.

It seems that several key factors in AGW are slowly being eroded away by larger scientific data sets and closer scrutiny.

One thing does seem very clear, however; science is only beginning to get a handle on the big picture of global warming. Findings like these tell us it's too early to know for sure if man's impact is affecting things at the political cry of "alarming rates." We may simply be going through another natural cycle of warmer and colder times - one that's been observed through a scientific analysis of the Earth to be naturally occurring for hundreds of thousands of years.

In the most recent news story, additional damning evidence about a "surreal scientific blunder" and statements about the quality control process at GISS seem to have come to light.

A surreal scientific blunder last week raised a huge question mark about the temperature records that underpin the worldwide alarm over global warming. On Monday, Nasa's Goddard Institute for Space Studies (GISS), which is run by Al Gore's chief scientific ally, Dr James Hansen, and is one of four bodies responsible for monitoring global temperatures, announced that last month was the hottest October on record.

This was startling. Across the world there were reports of unseasonal snow and plummeting temperatures last month, from the American Great Plains to China, and from the Alps to New Zealand. China's official news agency reported that Tibet had suffered its "worst snowstorm ever". In the US, the National Oceanic and Atmospheric Administration registered 63 local snowfall records and 115 lowest-ever temperatures for the month, and ranked it as only the 70th-warmest October in 114 years.

So, on the one hand, GISS tells us that October was the hottest October on record. On the other hand, unusually cold snaps were seen routinely and many new records [for cold] were set in the USA.

Quite a discrepancy! Who do we believe?

It seems there was a ghost in the machine. Or rather some of October's temperature readings were the ghosts of September past.

So what explained the anomaly? GISS's computerised temperature maps seemed to show readings across a large part of Russia had been up to 10 degrees higher than normal. But when expert readers of the two leading warming-sceptic blogs, Watts Up With That and Climate Audit, began detailed analysis of the GISS data they made an astonishing discovery. The reason for the freak figures was that scores of temperature records from Russia and elsewhere were not based on October readings at all. Figures from the previous month had simply been carried over and repeated two months running.

How does the computer programmer saying go? Ahh yes: "Garbage In, Garbage Out." Output is limited by the quality of the input. If you put nonsense starting numbers in, you get nonsense ending numbers back out.

What did GISS have to say of the gaffe?

A GISS spokesman ... explained that the reason for the error in the Russian figures was that they were obtained from another body, and that GISS did not have resources to exercise proper quality control over the data it was supplied with. This is an astonishing admission: the figures published by Dr Hansen's institute are not only one of the four data sets that the UN's Intergovernmental Panel on Climate Change (IPCC) relies on to promote its case for global warming, but they are the most widely quoted, since they consistently show higher temperatures than the others.

Astonishing indeed! If GISS is the most commonly cited source on global warming, one should darn well think that they would put an emphasis on 'proper quality control.' This isn't a fly-by-night operation. This is a major department of a major agency, and one whose reports are used to decide world policy! Proper quality control should be the first thing on their minds...

It gets more surreal:

The error was so glaring that when it was reported on the two blogs - run by the US meteorologist Anthony Watts and Steve McIntyre, the Canadian computer analyst who won fame for his expert debunking of the notorious "hockey stick" graph - GISS began hastily revising its figures. This only made the confusion worse because, to compensate for the lowered temperatures in Russia, GISS claimed to have discovered a new "hotspot" in the Arctic - in a month when satellite images were showing Arctic sea-ice recovering so fast from its summer melt that three weeks ago it was 30 per cent more extensive than at the same time last year.
Of Dr. Hansen, the Telegraph article is rather sharply critical:
If there is one scientist more responsible than any other for the alarm over global warming it is Dr Hansen, who set the whole scare [train in motion] back in 1988 with his testimony to a US Senate committee chaired by Al Gore. Again and again, Dr Hansen has been to the fore in making extreme claims over the dangers of climate change ... Yet last week's latest episode is far from the first time Dr Hansen's methodology has been called in question. In 2007 he was forced by Mr Watts and Mr McIntyre to revise his published figures for US surface temperatures, to show that the hottest decade of the 20th century was not the 1990s, as he had claimed, but the 1930s.

If nothing else, this indicates a need for independent review (true peer review) of the science behind 'global warming.' That includes access to data sets, computer algorithms, etc. Such cooperation between peers has not been forthcoming in several past instances, not least of all the 'hockey stick graph' incident:

In the Spring of 2003, Stephen McIntyre requested the MBH98 data set from Mann. He is not a scientist or an economist, he was just curious how the graph was made and wanted to see if the raw data looked like hockey sticks too. After some delay Mann arranged provision of a file which was represented as the one used for MBH98. One of the first things Stephen discovered was that the PCs used in MBH98 could not be replicated. In the process of looking up all the data sources and re-building Mann’s data set from scratch, Steve discovered a quite a few errors concerning location labels, use of obsolete editions, unexplained truncations of available series, etc.
In his initial response, Mann argued that we had studied the wrong data set—in other words that the one he provided had mistakes in it and we ought instead to have used one in a newly-identified FTP archive at his university. Over the next month we examined his FTP archive and discovered that, in fact, it corresponded almost exactly to the file we had originally been working with. However it differed in important ways from the description of the data set in the original Nature paper. We supplied a list of these discrepancies to Nature and after their own investigation they ordered a Corrigendum from Mann et al.
Mann also objected that we did not exactly replicate his computational steps or sequence of proxy rosters. No one had ever replicated his results, and we now know others had tried but were also unsuccessful. To date we are the closest anyone has been able to come in print. We were not bothered by Mann’s response on this point, but it did seem pointless to differ over trivial issues. So we requested his computational code to eliminate these easily-resolved differences. To our surprise he refused to supply his computer code, a stance he maintains to today.
As for the proxy sequence, in building his PCs it turns out he had spliced together a number of different series in order to handle segments with missing data in the earliest part of the analysis. This was not explained in his Nature paper so Steve had not implemented it in the emulation program. We requested identification of the splicing sequence, which Mann refused to provide ...
It is still not possible to identify the final form of the data used in MBH98 since it requires forming sequences of spliced proxy PC segments and Mann has given conflicting counts of the number of underlying vectors involved. Still, Steve’s emulation program is very close to reproducing the original hockey stick, and is as close as anyone is able to get in the absence of cooperation from Mann and his colleagues.

While a certain amount of professional wrangling may be acceptable with respect to getting credit for ideas, copyrights, trademarks, trade secrets, it seems that science underlying public policy decisions should be utterly and completely transparent. It should be available for review and for independent analysis by qualified professionals, rather than sequestered away from public scrutiny and its results delivered without question from on high.

It seems that the deniers' science is beginning to win a few converts as well. Ross McKitrick quotes several prominent physicists and others who have been swayed by the new analyses of the 'hockey stick graph.'

Since our work has begun to appear we have enjoyed the satisfaction of knowing we are winning over the expert community, one at a time. Physicist Richard Muller of Berkeley studied our work last year and wrote an article about it:

"[The findings] hit me like a bombshell, and I suspect it is having the same effect on many others. Suddenly the hockey stick, the poster-child of the global warming community, turns out to be an artifact of poor mathematics."
Recently Stephen McIntyre and I received an email from Dr. Hendrik Tennekes, retired director of the Royal Meteorological Institute of the Netherlands. He wrote to convey comments he wished to be communicated publicly:

“The IPCC review process is fatally flawed. The behavior of Michael Mann is a disgrace to the profession…The scientific basis for the Kyoto protocol is grossly inadequate.”

Other less middle-of-the-road sources have insinuated that not only is there bad science involved, but a political and/or economic agenda as well.

Whether such “mistakes” are made in genuine error or are part of a politicized push for man-made global warming to be universally accepted, and the evidence clearly suggests that latter is the case, the fact is that we can no longer tolerate the cry that “the debate is over” on man-made global warming in light of such gargantuan falsehoods.

Likewise, the push for carbon emissions to be reduced by 80 per cent or more, a figure that would completely cripple western economies and lower living standards to a near third world level, can no longer be accepted as a reasonable course of action now that the primary authority on man-made global warming, the UN IPCC, has been proven to be using fraudulent data to make its case.

So, where do we go from here? It seems that more study is definitely required on the 'global warming' front. Moreover, any results should also have the associated underlying data sets and algorithms made publicly available as well, lest poor mathematics lead any more scientists astray down the garden path, alarming citizens, and governments in the process and suggesting radical environmental and economic changes that may be completely unnecessary or even detrimental.

Update:
650 World Class Scientists Say Global Warming is Nonsense

recommend This comment thread is now closed
0
forthebetta

it was warmer 1000 years ago, and it's colder now than the average temperature since the ice age.  you only hear about the ice caps melting in the summer when they seasonally melt.

global warming is not just a hoax, it's a joke to those who've studied climate change over time, as in the natural cycles which show that there is no threat anytime soon.

if Obama seriously caps greenhouse gases, making electricity rates "necessarily skyrocket" all in the name of "global warming"....  i hope he gets impeached.

0
Paschen

Great read, As always very insightful. Thank you for posting it.

0
mgmirkin

Thanks!

I think the whole subject is interesting. Not least of all for its commentary on the state of science.

On the one hand, I think it's sad that there's occasions where peers can be hostile toward one another or uncooperative. Especially where peer review is concerned. There's a greater need for transparency and disclosure, especially with regard to such a sensitive subject and when policy is being formed based upon assessments.

On the other hand, it's awesome to see folks like Watts, McIntyre, et al attempting to still carry on with peer review of a high quality. It seems there's still hope for the system, despite the systems occasionally being broken (as in the case of Mann's refusal to cooperate or divulge the algorithms and splicing used in his models).

So, it's a mixed bag. If nothing else, it's a great topic for open debate, both on GW/AGW and on science in general (how it should operate, how scientists should comport themselves, etc.)... Could be a great discussion for a science class, to get kids involved in the debate (either in the specific or general terms mentioned above).

Regards,
~Michael Gmirkin

0
Amy Judd

This is crazy - I have a hard time believing it actually. Why would they do this?

Personally, I am sure man is responsible.


0
mgmirkin

Why would who do what?

Why would skeptics try to independently audit the numbers used to create global policy at the highest levels of government?
Why would those responsible for such numbers to begin with take less care than might be expected in ensuring data integrity and quality assurance?
Why would politicians push an agenda (environmentally, economically)?

As far as "man's responsibility," I suppose it depends on who you believe and how much faith you put in the particular numbers and graphs created by both sides of the issue. I find the PDF paper I linked to about he hockey stick graph to be pretty easily readable and to at least cast a modicum of doubt on the 'hockey stick graph,' assuming the assertion is true  that the algorithms used in its creation do in fact select for just such a pattern, regardless of the sets of input data fed into the system. Likewise, other recent discoveries seem to point to some natural cycles that have little to do with man.

In any event, it seems the debate isn't "settled" just yet... It's a big, hairy, complex issue. ;o]

0
Paschen

I did take part though in some off this research and we certainly did not cook up the numbers what so ever. 70% and more are most likely due to Human factors alone.

0
mememine69

So, do I tell my child that suicide is an option in her future? Global warming is a fact? Ok, so it is. Now YOU greensheep pedlers of misery and feel good self importance tell her to her face.

Dad: See that mean person over there with the sign that says THE END IS NEAR.? Well she has stolen your future. So has he. They would rather you suffer an unimaginable hell on earth and starve on a dead planet than give up their exercise in new age arcissism. And dear if you become a liberal, be a real liberal. Be a liberal that the doubts, questions and challenges authority and does not bow and surrender to it like these enviro sheep who are scared to think for themselves.

UFO's, Y2K, WMD's, AGW ...............................................

0
mgmirkin

Please, don't take this the wrong way, but what ARE you on about?

First of all, UFOs, Y2K and WMDs have nothing to do with the story.

Nowhere in the article did it state that global warming is a fact. To the contrary, it calls into question the very existence of 'global warming' on the basis of several studies showing AGW supporters' data to be flawed or misrepresented as well as evidence of natural cycles that have nothing to do with mankind.

Why would anyone tell a child that suicide is an option?
Who is the YOU you are shouting at in CAPS LOCK? Certainly not ME, as the article is clearly not in support of AGW, or GW in general. Personally, I think it's a flawed theory. Heck, back in the middle of last century, the biggest fear was 'global cooling'... Funny how times and attitudes change.

Anyway... Guess I'm not seeing the point of the rant except 'to rant'. ;o]

Just my 2c.

0
Emilio Lizardo

Impressive post. Thank you for it !

0
mgmirkin

Not a problem. Thought it might be of interest...

Keep on keeping on!
~Michael Gmirkin

0
mgmirkin

It seems one of the sites that hosted the McKitrick PDF went down. It was working as of the writing of the story. Archival copy of the paper can be found here:

(What is the ‘Hockey Stick’ Debate About?)
http://web.archive.org/web/20080308060752/http://www.climatechangeissues.com/files/PDF/conf05mckitrick.pdf

Regards,
~Michael Gmirkin

This story was created over 3 months ago, the comment thread is now closed.

What is NowPublic?

NowPublic lets people work together to cover news events around the world.

Find out more

Crowd Power

Paschen
First Flagged at 9:49 PM, Nov 17, 2008 by Paschen
These members have powered this story:

Most Recommended Stories in Environment

Recommendations (46)

Most recently recommended by:
 

closeSign in to NowPublic

is reporting from