a look to the future: forecasting the 2004 presidential election

4
A Look to the Future: Forecasting the 2004 Presidential Election Author(s): Brad Lockerbie Source: PS: Political Science and Politics, Vol. 37, No. 4 (Oct., 2004), pp. 741-743 Published by: American Political Science Association Stable URL: http://www.jstor.org/stable/4488898 . Accessed: 14/06/2014 06:19 Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at . http://www.jstor.org/page/info/about/policies/terms.jsp . JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide range of content in a trusted digital archive. We use information technology and tools to increase productivity and facilitate new forms of scholarship. For more information about JSTOR, please contact [email protected]. . American Political Science Association is collaborating with JSTOR to digitize, preserve and extend access to PS: Political Science and Politics. http://www.jstor.org This content downloaded from 185.2.32.134 on Sat, 14 Jun 2014 06:19:06 AM All use subject to JSTOR Terms and Conditions

Upload: brad-lockerbie

Post on 20-Jan-2017

214 views

Category:

Documents


2 download

TRANSCRIPT

A Look to the Future: Forecasting the 2004 Presidential ElectionAuthor(s): Brad LockerbieSource: PS: Political Science and Politics, Vol. 37, No. 4 (Oct., 2004), pp. 741-743Published by: American Political Science AssociationStable URL: http://www.jstor.org/stable/4488898 .

Accessed: 14/06/2014 06:19

Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at .http://www.jstor.org/page/info/about/policies/terms.jsp

.JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide range ofcontent in a trusted digital archive. We use information technology and tools to increase productivity and facilitate new formsof scholarship. For more information about JSTOR, please contact [email protected].

.

American Political Science Association is collaborating with JSTOR to digitize, preserve and extend access toPS: Political Science and Politics.

http://www.jstor.org

This content downloaded from 185.2.32.134 on Sat, 14 Jun 2014 06:19:06 AMAll use subject to JSTOR Terms and Conditions

A Look to the Future: Forecasting the

2004 Presidential Election

by Brad Lockerbie, University of Georgia

Forecasting provides the opportunity to put one's self to the test. Are our models of

voting behavior accurate? It is easy to retrofit an explanation for what has happened in the past. Taking a chance on a forecast that can go wrong does not afford us that luxury. Fore- casting can also teach a lesson in humility. Over the last decade, political scientists have been willing to gamble on their models. We have had some success. Everyone on the fore- casting panel at the 1996 APSA Annual Meet- ing correctly forecast a Clinton victory. The forecasting of the 2000 presidential election was clearly a lesson in humility (at least for this author). None of the authors of this sym- posium forecast a Bush victory. Moreover, many forecast a rather substantial victory for Al Gore.'

Despite the problems inherent in forecast- ing, it still has considerable value.2 Assuming we move beyond the simplistic World Series, longest name, and tallest candidate rules, we can actually test our theories of voting behav- ior. Forecasting also implies that the further

before an event we offer the forecast, the more its potential value. A forecast a day or two before the election probably does not offer us much insight beyond

what we can get from the news the night be- fore the election. The earlier the forecast the greater the value. Compare a weather fore- caster who offers the forecast of a tornado that will hit in five minutes versus a fore- caster who offers the forecast a few hours, or days, in advance. Which one has done a better job? Which one has provided a more useful service?

Influences on Election Outcomes Several factors are quite reasonably thought

to be related to presidential election outcomes. Many of the forecasting models take the state of the economy into account. Virtually all of these take some measure of how the economy has performed in the past (Abramowitz 2000; Campbell 2000; Fair 1988; Holbrook 2000; Lewis-Beck and Tien 2000; Lewis-Beck and Wrighton 1994; Lockerbie 2000; Norpoth 2000; Wlezien and Erikson 2000). Several in the forecasting industry have also begun to take into account that voters' economic expec- tations (Lewis-Beck and Tien 2000; Lockerbie 2000; Norpoth 2000; Wlezien and Erikson 2000). While both likely play a role in why

people vote the way they do and why elec- tions turn out like they do, my own work, both in forecasting and individual level vote choice models (Lockerbie 1992; 2000), shows that prospective evaluations are stronger. In the interest of parsimony (given that I have so few cases), it makes sense to trim the number of variables in the model. Consequently, I make use of a prospective item from the In- dex of Consumer Sentiment in the Survey of Consumer Attitudes and Behavior that con- cerns what people think will happen to their personal finances over the next year (denoted Next Year Worse).3 To make the forecast well in advance of the actual event, I make use of the responses from the first quarter of the election year. Specifically, the question asks "Now looking ahead-do you think that a year from now you (and your family living here) will be better off financially, or worse off, or about the same as now?" The percent- age stating the next year will be worse is the score for this variable. This item clearly fo- cuses on the individual and on the future. There is one problem with this item; it makes no statement of attribution of responsibility. The respondents could think their finances are going to improve through the dint of their own efforts or decline due to other events, such as because their boss was just found out to have improperly made use of company as- sets. Kramer (1983) and Lockerbie (1992; 2002) argue that for the economy to influence political attitudes and behaviors, there should be some sense of attribution to political ac- tors. We can take some comfort in that the problem with the item used here is that it bi- ases us against finding a relationship.

Aside from the economy, we should also take into account the potential for an incum- bency advantage or penalty. Some might argue that when a president seeks reelection, he might have an advantage. Voters might be willing to give the individual the chance to fully implement his program. One term might not be enough. A third term for a party is an- other thing. After eight years, voters might ex- perience party fatigue. Also, it will not be the leader of the party seeking a third term, Mla Franklin Roosevelt. Instead, it will be (or at least in recent history it has been) the incum- bent vice president. At this point voters might be looking for a change, or at least sympa- thetic to the arguments of the opposition party. Similarly, even if the incumbent vice president is victorious, voters might not be in- clined to give one party 16 years of uninter- rupted power. Consequently, the model em- ploys a variable (denoted Term Two and Beyond) to account for this possibility. This is

PSOnline www.apsanet.org 741

This content downloaded from 185.2.32.134 on Sat, 14 Jun 2014 06:19:06 AMAll use subject to JSTOR Terms and Conditions

Table 1 Forecasting the 2004 Presidential Election Ordinary Least Squares Estimates for Incumbent Party Share of Two-Party Vote: 1956-2000a

Independent Variable b Std. Err. Significance

Constant 65.02 1.73 .01 Term Two and Beyond -8.59 1.37 .01 Next Year Worse -.77 .13 .01 R-squared .87 N 12 a All variables are as described in the appendix. The significance level employed here and throughout the manuscript is one-tailed.

scored 0 if the incumbent president, or his party, is seeking his first reelection. It is scored 1 in all other years.

Presidential Election Outcomes How well does this model forecast when confronted with

the data? The equation in Table 1 shows the results of regress- ing the two-party vote share of the incumbent party on the two independent variables.4 With an R-squared of .87, the equation fits the data reasonably well. Both independent vari- ables are statistically significant and in the expected direction. First, the more pessimistic the nation is about personal fi- nances, the worse the incumbent party does when seeking re- election. The incumbent party loses approximately three-quar- ters of a percentage point of the two-party popular vote for every one percentage point increase in people who are pes- simistic. The range on this item is from a low of 6 in 1956, 1964, and 2000. The high on this variable is 25.33 in 1980.5 Moving from the minimum to the maximum translates to a more than 14-point swing in vote share. Second, the party that hopes for reelection after winning two consecutive elections has a rough road to hoe. The coefficient on this item indicates that when a party seeks to move beyond two terms, it loses on average almost nine percentage points. Given the relative closeness of American presidential elections, this is not an in- consequential sum.

Out-of-Sample Forecasts

How good a job does the equation do? Are the results driven by one aberrant year? Instead of using the entire data set and the equation for the entire data set to assess the verisimilitude of the model, I make use of out-of-sample fore- casts. I simply reestimate the equation with the year I wish to forecast (or, since it as after the fact, ex post forecast) ex- cluded. In other words, I remove one year from the data set, reestimate the equation, and then evaluate the equation. I then take the actual values for the independent variables for the ex- cluded year and plug them into the equation to generate the forecast for that year. This procedure allows two things. First, we can assess the stability of the model by looking at the co- efficients for the variables with a single year excluded at a time. Do the coefficients change dramatically? Does the statis- tical significance of the variables change with a single year excluded? Second, how good a job does the model do in fore- casting the excluded year.

Table 2 shows the equations used to generate the out-of- sample forecasts. The first thing to note is the stability of the coefficients. With the exception of the equation with 1980

Table 2 Out-of-Sample Equations

Next Term Year Two and

Year Worse Beyond Constant R-Squared

1956 -.82 -9.31 66.22 .89 1960 -.77 -8.37 65.11 .87 1964 -.75 -8.36 64.63 .84 1968 -.78 -8.32 65.13 .87 1972 -.74 -7.78 63.97 .89 1976 -.77 -8.62 65.04 .86 1980 -.53 -8.89 63.26 .85 1984 -.76 -8.25 64.62 .86 1988 -.75 -9.18 64.86 .90 1992 -.79 -8.90 65.32 .85 1996 -.78 -9.14 65.67 .89 2000 -.78 -8.29 65.22 .87

Note. With the exception of 1980 Next Year Worse, everything is significant at the .01 level one-tailed. Next Year Worse is significant at the .05 level one-tailed for 1980.

excluded, the coefficients for the economic variable are within one-half a standard error. In fact, with the exception of the equations excluding 1956 and 1980, the coefficients are within one-seventh of a standard error. For the equation excluding 1980, the coefficient is within two standard errors. We should note that this is the year that the economic item hovers at the edge of statistical significance. Nonetheless, it does hover on the good side of the line. Turning to the time in the White House variable, the coefficients are within one standard error in every instance. Regardless of the year excluded, the R-squared never falls below .84. Looking at the R-squareds also shows us a great deal of similarity; the range on the R-squareds is only .06.

We should also look at the point estimates to ascertain how good a job the equation forecasts. With the out-of-sample equations, we can test.their forecasting ability without using the data points we are forecasting to generate the forecast we are examining. The model performs reasonably well. Given the timing of the forecast, the typical forecasting error is remark- ably small (mean = 2.50, median = 1.98). There are two elec- tions that are misforecast: 1960 and 1968. Even here, the

Table 3 Accuracy of Out-of-Sample Forecasts

Year Actual Vote Forecasted Vote Absolute Error

1956 57.80 61.28 3.48 1960 49.90 51.31 1.41 1964 61.30 60.14 1.16 1968 49.60 51.37 1.77 1972 61.79 57.32 4.47 1976 48.90 48.73 0.17 1980 44.70 49.89 5.19 1984 59.20 57.28 1.92 1988 53.90 50.17 3.73 1992 46.50 45.04 1.46 1996 54.74 57.89 3.15 2000 50.17 52.21 2.04 Mean 2.50 Median 1.98

742 PS October 2004

This content downloaded from 185.2.32.134 on Sat, 14 Jun 2014 06:19:06 AMAll use subject to JSTOR Terms and Conditions

forecast errors are not terribly large. In 1960, the error is less than one and one-half percentage points. In 1968, the error is less than two percentage points.

Forecast 2004 How does 2004 look? Plugging the values for the independ-

ent variables (Next Year Worse = 9.67 and Term Two and Beyond = 0) into the equation yields a forecast of 57.6% of the two party vote for President Bush.

How certain should we be of the forecast for 2004? There are several ways in which one can look at this. First, note that for the equation to mis-forecast the victor, it would have to be off by more than seven percentage points. Given that the largest error from the 12 out-of-sample forecasts so far is just over five percentage points, we can, following Campbell (2000, 29), argue that we have a less than one in 12 chance of being wrong in the prediction of a Bush victory. We can also make use of the confidence interval around the predic- tion, as suggested by Beck (2000, 164). Since the forecast shows Bush winning with 57.6% of the two-party vote and the standard error of the forecast is 2.51, the t value of 3.03 tells us that the confidence is somewhat better than 99%, one- tailed. In short, two of the standard tests of certainty lead one

to believe with a high degree of confidence that Bush will win reelection.

Conclusion

This forecast speaks to our models of voting behavior. Many of the economic models of voting behavior argue that voters look to the future when casting ballots. While we can- not make direct statements about individuals from aggregates, the findings here are wholly consistent with the hypothesis that voters are looking to the future when casting ballots. Voters might be asking "What will you do for me?"

What does all of the preceding tell us? Elections appear to be predictable events. By taking a few bits of information that are available well before the campaign, we can forecast the outcome of elections quite well. These items are set well be- fore the campaign begins in earnest. We can measure the time a party has controlled the White House as the previous elec- tion is called in the media. The item that comes from the election year itself is the measure of voters' expectations con- cerning their personal financial well-being, and this is avail- able before the parties' conventions. In short, we can make quite accurate forecasts before the parties have officially nomi- nated their standard bearers.

Notes 1. Technically, we did get it right. After all, we were forecasting the

popular vote, which Al Gore did win. 2. See Campbell and Garand (2000) for a discussion of the utility of

political forecasting. 3. Thanks to John Prechtel at the University of Georgia for obtaining

the latest data from Rebecca McBee Bono at the Survey of Consumers at the University of Michigan. The earlier data is available at the web site <http://www.sca.isr.umich.edu/>

4. Given the small size of the data set and the potential for an outly- ing case to make a difference, I reran the analysis using least median squares regression. The results are largely the same. Consequently, the results are not likely to be the result of making use of one particular statistical technique.

5. The mean is 9.79 and the standard deviation is 5.22.

References Abramowitz, Alan I. 2000. "Bill and Al's Excellent Adventure: Forecasting

the 1996 Election." In Before the Vote: Forecasting American National Elections, eds., James E. Campbell and James C. Garand. Thousand Oaks: Sage Publications, 47-56.

Beck, Nathaniel. 2000. "Evaluating Forecasts and Forecasting Models of the 1996 Presidential Election." In Before the Vote: Forecasting American National Elections, eds., James E. Campbell and James C. Garand. Thousand Oaks: Sage Publications, 161-168.

Campbell, James E. 2000. "The Science of Forecasting Presidential Elec- tions." In Before the Vote: Forecasting American National Elections, eds., James E. Campbell and James C. Garand. Thousand Oaks: Sage Publications, 169-188.

Campbell, James E., and James C. Garand. 2000. "Forecasting U.S. National Elections." In Before the Vote: Forecasting American National Elections, eds., James E. Campbell and James C. Garand. Thousand Oaks: Sage Publications, 3-16.

Fair, Ray C. 1988. "The Effect of Economic Events on Votes for Presi- dent: 1984 Update." Political Behavior 10: 168-179.

Holbrook, Thomas M. 2000. "Reading the Tea Leaves: A Forecasting Model of Contemporary Presidential Elections." In Before the Vote: Forecasting American National Elections, eds., James E. Campbell and James C. Garand. Thousand Oaks: Sage Publica- tions, 119-133.

Kramer, Gerald H. 1983. "The Ecological Fallacy Revisited: Aggregate versus Individual-level Findings on Economics and Elections." American Political Science Review 77:92-111.

Lewis-Beck, Michael S., and Charles Tien. 2000. "The Future in Forecast- ing: Prospective Presidential Models." In Before the Vote: Forecasting American National Elections, eds., James E. Campbell and James C. Garand. Thousand Oaks: Sage Publications, 83-102.

Lewis-Beck, Michael S., and J. Mark Wrighton. 1994. "A Republican Congress? Forecast for 1994." Public Opinion 1:14-16.

Lockerbie, Brad. 1992. "Prospective Voting in Presidential Elections, 1956-1988." American Politics Quarterly 20:308-325.

Lockerbie, Brad. 2000. "Election Forecasting: A Look to the Future." In Before the Vote: Forecasting American National Elections, eds., James E. Campbell and James C. Garand. Thousand Oaks: Sage Publications, 133-144.

Lockerbie, Brad. 2002. "Party Identification: Constancy and Change." American Politics Research 30:384-405.

Norpoth, Helmut. 2000. "Of Time and Candidates: A Forecast for 1996." In Before the Vote: Forecasting American National Elections, eds., James E. Campbell and James C. Garand. Thousand Oaks: Sage Publications, 57-82.

Wlezien, Christopher, and Robert S. Erikson. 2000. "Temporal Horizons and Presidential Election Forecasts." In Before the Vote: Forecasting American National Elections, eds., James E. Campbell and James C. Garand. Thousand Oaks: Sage Publications, 103-118.

PSOnline www.apsanet.org 743

This content downloaded from 185.2.32.134 on Sat, 14 Jun 2014 06:19:06 AMAll use subject to JSTOR Terms and Conditions