One of the most common statements made in an attempt to support claims that AGW is not real concerns climate models. People have made all sorts of statements about how global warming is not real because all of the models have failed. This is a false statement in many ways. But, it has been made so many times that I want to address it in some depth.
First False Argument:
The first way this is a false argument is that climate science is not about modeling. Models, in the modern sense of the word, are mathematical representations of something to help us understand things. In the case of climate models, they help us to understand an extremely complex system involving a multitude of different processes. But, those processes will continue to do what they want with, or without, the models.
Nature is what it is and is not sitting around waiting for a model to tell it what to do!
If is it raining outside and I have a model that predicts rainfall, is the actual rain outside going to change depending on what my model says? No! Of course, not! Then, why in the world would you think that the study of possibly the most complex process on the entire planet is all about a model?
We have many tools and models are important ones. But, they are not the only tools we use. There are satellites, sonobuoys, various kinds of thermometers, ice cores, sea floor cores, lacustrine cores, coral cores, weather balloons, tree rings and many more tools. The science is not dependent on just one of them.
Climate science is the study of all of these processes involved in making our climate. But, the climate will do what it does, and our study or understanding of that doesn't change the reality. Global warming is all about the real world stuff going on with our planet's climate. It is not about models or papers or discussions at a conference. Those are things we do in the study of the science. Global warming is the reality of nature independent of anything we do or say.
Second False Argument
The second way the argument is false is that it is assumed that if the models are not 'accurate' (without any definition of what that means), then the models are invalid and climate science is invalid. This is so preposterous that it truly shows the mindset of anyone saying it, and that mindset is a desperate attempt to reject science.
What about weather models? Is meteorology invalid because weather models are not accurate? Do you ever bother to check the weather forecast? Do you check to see if you need to take an umbrella with you today? Do you check to see if its going to be cold or hot? Do you go to the supermarket and get some food when they say a big snowstorm is coming in? Have you ever made a single decision based on the weather forecast?
Why?
Weather forecasts come from meteorology models and we all know that the weather forecast is not very accurate. Does that mean meteorology is fake? Does that mean there are a bunch of meteorologists promoting a false science in order to keep their government grants coming? Does that mean there are a bunch of people that have deluded themselves and are following meteorologists like sheep? Of course, not!
So, if this line of reasoning is false with regard to meteorology and weather models, why is it valid for climate science and climate models?
Third False Argument
I have had people actually pull out model results from 20, even 30 years ago and point to them as evidence that man made global warming isn't real. First, review the first and second false arguments above to see why this is not even a valid argument to begin with. But, this is its own brand of false argument all by itself.
Let's go back to the weather forecast. Which would you rather have, the weather forecasting of today, or the weather forecasting of 1980? What's that you said? You said you would prefer the weather forecasting of today?
Why?
Could it be that you recognize that there have been advances in the weather modeling over the last 30 years? That meteorologists have tools and data bases they didn't have 30 years ago? That the science of meteorology has advanced and we understand the weather better today than we did 30 years ago? Those would all be correct conclusions and, yes, the weather models of today are much better than the models of 1980, along with the forecasts we get from them.
Then, why would anyone suppose the climate science models would be any different? Why would anyone suppose that the climate models of 2014 are not any better than the climate models of 1980, or 1990, or even 2000? The science is advancing. We are getting new tools and the data base is growing. Our understanding of the science is improving. Just as with the meteorology models, the climate models are getting better all the time.
The fact that models improve with time does not invalidate models, it serves as validation. It shows we are increasing our understanding and that we are making progress. And, it certainly, in no way, is any kind of evidence that AGW is not real.
Fourth False Argument
The fourth false argument centers around the conclusion that a climate model that does not give an accurate forecast on the global average temperature is 'wrong.' This is not the case. There are many different models and they do different things. Read this statement from the IPCC AR5 report on modeling:
The models used in climate
research range from simple energy balance models to complex Earth
System Models (ESMs) requiring state of the art high-performance
computing. The choice of model depends directly on the scientific question
being addressed (Held, 2005; Collins et al., 2006d). Applications include
simulating palaeo or historical climate, sensitivity and process
studies for attribution and physical understanding, predicting near-term
climate variability and change on seasonal
to decadal time scales,
making projections of future climate change over the coming century or
more and downscaling such projections to provide more detail at
the regional and local scale. Computational cost is a factor in all of
these, and so simplified models (with reduced complexity or spatial
resolution) can be used when larger ensembles or longer integrations are
required. Examples include exploration of parameter sensitivity or
simulations of climate change on the millennial or longer time scale. Here, we provide a brief overview of the climate models evaluated in this
chapter.
IPCC AR5, Chapter 9 - Evaluation of Models
As you can see, there are lots of different kinds of models and you can't evaluate them all the same way.
Besides, a model that gives a result that does not conform with observed results can still be very valuable. Models are built on our understanding of physics. If we understand the situation correctly, then they should reflect the reality. When they don't reflect reality as well as we would like that tells us there is something we are missing. This can be extremely valuable.
The important point to remember is that there are lots of different models and they do lots of different things. You cannot judge all of them by the same standard.
I will have more to say on that topic below.
Fifth False Argument
The fifth way this is a false argument is that contrarians and deniers criticize the models and cite them as proof that we shouldn't do anything about global warming, but don't develop any models of their own to support their claims.
Why is that? Why is it the people criticizing models can't produce any models to support their claims? The only thing they can do is criticize, but they can't produce anything of their own. If, as they claim, you can get models to do anything, why have they not done so? Where is the Heartland Institute's model? Where is Craig Idzo's model? Where is Richard Lindzen's model?
Mr. Roy Spencer has, in fact, produced a model he claims shows global warming is nothing more than a naturally occurring event. Unfortunately, the only way Mr. Spencer could get it to work is to use false inputs. The results are very different when real data is used.
Here is a nice review of his work that really shows how he keeps manipulating things until he gets the desired result.
So, why don't we see forecasts from denier models that accurately forecast the climate?
And, more importantly, why have they avoided this question? What are they trying to hide from the public?
The answer is tragically simple - Because they can't!
It is easy to sit there and say the models are no good when you can't do it yourself. The last thing any denier ever wants to do is to try and develop a model that ends up giving results counter to their claims. That really would be a case of Frankenstein's monster. The denier model that turned on its creator.
So, the next time you here some contrarian or denier going on about climate models, ask them one question - Where are the alternative models that support the contrarian claims? Be prepared for the silence.
Sixth False Argument
The sixth way this is a false argument is because contrarians and deniers are actually lying about model errors. How many times have you seen this plot? It even states right on the graphic, "Over 95% of Climate Models Agree: The Observations Must be Wrong"
To be clear, this plot shows the results of 90 different models (all of the colored lines) with the average plotted as the black, dotted line. The green dotted line is the global average surface temperature measured using surface instruments. The blue dotted line is the global average surface temperature measured using satellite born instruments.
You may play with the climate model outputs for yourself at
this site here.
One particular
contrarian site states, "Unfortunately, climate models — ones that can accurately and
consistently predict global temperatures in the not-so-distant future —
simply don’t exist in the present." The message is certainly being spread. But, is it a valid message? Let's check into this plot and find out.
I had a serious question about this plot the moment I saw it - the IPCC
data page only lists 59 models but this plot has results from 90 models, so where did these other 31 models plotted here come from? It is true that there might be other models that are not listed on the IPCC page, but why doesn't this graphic list them or give a link to a list of them? This made me curious about this plot. Where did it come from and what are these plots it shows? Ultimately, I have to wonder if it was falsified. It would not be the first time denier organizations promulgated false statements.
And, you know what I found? It was falsified!
To no surprise, I found the chart originated with Roy Spencer, a denier with a record of falsifying his research. His original chart can be
found here. In his posting he states he plotted the results of 90 climate models, but I cannot find a list of those models anywhere. But, analysis of the plot has shown he falsified the data by misaligning it. And, the evidence indicates it was done deliberately.
This is how Mr. Spencer falsified the graph. The data is plotted versus some baseline. Normally, we use a baseline based on some average to smooth out the large amount of variability observed from year to year. Picking a large number of years as the baseline average prevents one weird year from skewing the average. Using a small number of years allows one particular year to throw off the data. We normally use a 30-year average. Mr. Spencer used a 5-year average. Why would he do that when he is well-versed in this methodology? And, why did he use the particular baseline he selected: 1979 - 1983? Well, one result of using a five-year average based on the 1979-1983 period is that it resulted in a misalignment of the data. You can read the analysis
here.
Here is what happens when the alignment is done incorrectly and then redone correctly:
Quite a change. And, isn't it amazing that the selection of the five-year baseline served to support the claims of the denier organizations?
But, there is still more problems with Mr. Spencer's work. Take a look at his original plot of the 90 models above and you can see the UAH data (the blue line) is consistently significantly lower than the HadCRUT4 data (the green line). But, look at the plot just above this paragraph graphing both of these data sets. The UAH data is not consistently higher, the reality is they are actually very close, especially when aligned using a proper baseline. One more indication that Mr. Spencer deliberately falsified the graph.
This plot here shows the two temperature plots the same as above, but adds the results of the CMIP5 model. The first shows the results of Mr. Spencer's improper alignment, while the second shows what happens when you use a proper alignment. The difference is pretty dramatic. Clearly, the model results are MUCH better than Mr. Spencer would like you to believe.
It is amazing to see how many mistakes this guy makes and how each and every one of those mistakes works to confirm his desired conclusion. You would think, by the law of averages, that at least some of those errors would work against his desired conclusion. This all leads me to the conclusion that Mr. Spencer intentionally and deliberately falsified this plot in order to undermine climate science and support the conclusion he wants.
Ultimately, the question has to be, why is Mr. Spencer falsifying his results? If the science really supported what he claimed, it would not be necessary to falsify his data. There can be one, and only one, answer to this question - Spencer has a desired outcome that is not supported by science, so he will do whatever is necessary to obtain that conclusion with his work rather than change his beliefs.
And, that is the penultimate definition of a denier.
If the models are as wrong as the deniers claim, why do they have to lie about them?
Seventh False Argument:
The seventh way this is a false argument is that the models are actually much more accurate than contrarians would like
you to know. As we have seen, when someone tells you the models have all failed they are
selling you a bad bill of goods. But, the accuracy of the models is really
the heart of the whole issue, isn't it? We know the deniers are lying about the inaccuracies, but just how accurate are they?Take a look at this plot of the AR4 models and the actual recorded data. The models look pretty good to me.
To no surprise, there is plenty of literature out there on this subject.
Some of it in the form of refereed papers in scientific journals, some
of it in more popular forms. I'll be using both. Let's start with some of
the scientific papers because they make some points that I want to use
later. The link to the paper is provided as well as each paper's abstract.
Performance metrics for climate models, by P. J. Gleckler, K. E. Taylor and C. Doutriaux, published in the Journal of Geophysical Research - Atmospheres,
, Issue D6, 27 March 2008
Abstract
[1] Objective
measures of climate model performance are proposed and used to assess
simulations of the 20th century, which are available from the Coupled
Model Intercomparison Project (CMIP3) archive. The primary focus of this
analysis is on the climatology of atmospheric fields. For each variable
considered, the models are ranked according to a measure of relative
error. Based on an average of the relative errors over all fields
considered, some models appear to perform substantially better than
others. Forming a single index of model performance, however, can be
misleading in that it hides a more complex picture of the relative
merits of different models. This is demonstrated by examining individual
variables and showing that the relative ranking of models varies
considerably from one variable to the next. A remarkable exception to
this finding is that the so-called “mean model” consistently outperforms
all other models in nearly every respect. The usefulness, limitations
and robustness of the metrics defined here are evaluated 1) by examining
whether the information provided by each metric is correlated in any
way with the others, and 2) by determining how sensitive the metrics are
to such factors as observational uncertainty, spatial scale, and the
domain considered (e.g., tropics versus extra-tropics). An index that
gauges the fidelity of model variability on interannual time-scales is
found to be only weakly correlated with an index of the mean climate
performance. This illustrates the importance of evaluating a broad
spectrum of climate processes and phenomena since accurate simulation of
one aspect of climate does not guarantee accurate representation of
other aspects. Once a broad suite of metrics has been developed to
characterize model performance it may become possible to identify
optimal subsets for various applications.
What they are saying:
This paper was published in 2008, so it is examining the CMIP3 (Coupled Model Intercomparison Project 3. A coupled model is one that combines more than one model to get a single result), instead of the newer CMIP5, but it is still a valid paper. What they are doing is trying to examine the forecasts of the model to see how accurate it is. This is much more difficult with climate models than with weather models. With a weather model you are getting a solid feedback every single day. It takes a lot longer to get performance feedback with climate models. And, what does that feedback mean? How do you evaluate it.
So, they came up with a grading system for a number of different variables and they graded the models accordingly. They made a very interesting statement:
"Forming a single index of model performance, however, can be
misleading in that it hides a more complex picture of the relative
merits of different models."
This is consistent with what I said above under Fourth False Argument.
Note this statement from the paper:
Although the value of climate model metrics has been recognized for some time [e.g., Williamson, 1995],
there are reasons why climate modelers have yet to follow the lead of
the NWP community. First, a limited set of observables (e.g., surface
pressure anomalies) have proven to be reliable proxies for assessing
overall NWP forecast skill, whereas for climate models, examination of a
small set of variables may not be sufficient. Because climate models
are utilized for such a broad range of research purposes, it seems
likely that a more comprehensive evaluation will be required to
characterize a host of variables and phenomena on diurnal,
intraseasonal, annual, and longer times scales. To date, a succinct set
of measures that assess what is important to climate has yet to be
identified.
Later, they state,
"We note that even the “better” models score below average in the
simulation of some fields, while the “poorer” models score above average
in some respects (especially in the tropics)"
The overall conclusion is that it is not easy to evaluate models, and they state,
"Finally, in spite of the increasing use of metrics in the evaluation of
models, it is not yet possible to answer the question often posed to
climate modelers: “What is the best model?” The answer almost certainly
will depend on the intended application."
But, if it is so difficult, how is it possible for the deniers to conclusively say they all fail? Where are the evaluation metrics they use to reach that conclusion? That should be a gigantic red flag for anyone listening the denier claims about climate models - scientists have difficulty coming up with evaluations of models, but contrarians don't. Hmmm.
Let's try another paper.
How reliable are climate models?, by JOUNI RÄISÄNEN in Tellus A
, Volume 59, Issue 1, pages 2–29, January 2007