Reproducibility in forecasting research

Boylan, John E., Goodwin, Paul, Mohammadipour, Maryam ORCID logoORCID: and Syntetos, Aris A. (2015) Reproducibility in forecasting research. International Journal of Forecasting, 31 (1) . pp. 79-90. ISSN 0169-2070 [Article] (doi:10.1016/j.ijforecast.2014.05.008)

PDF - Final accepted version (with author's formatting)
Available under License Creative Commons Attribution-NonCommercial-NoDerivatives 4.0.

Download (367kB) | Preview


The importance of replication has been recognised across many scientific disciplines. Reproducibility is a necessary condition for replicability, because an inability to reproduce results implies that the methods have not been specified sufficiently, thus precluding replication. This paper describes how two independent teams of researchers attempted to reproduce the empirical findings of an important paper, ‘‘Shrinkage estimators of time series seasonal factors and their effect on forecasting accuracy’’ (Miller & Williams, 2003). The two teams proceeded systematically, reporting results both before and after receiving clarifications from the authors of the original study. The teams were able to approximately reproduce each other’s results, but not those of Miller and Williams. These discrepancies led to differences in the conclusions as to the conditions under which seasonal damping outperforms classical decomposition. The paper specifies the forecasting methods employed using a flowchart. It is argued that this approach to method documentation is complementary to the provision of computer code, as it is accessible to a broader audience of forecasting
practitioners and researchers. The significance of this research lies not only in its lessons for seasonal forecasting but also, more generally, in its approach to the reproduction of
forecasting research.

Item Type: Article
Keywords (uncontrolled): Forecasting practice, Replication, Seasonal forecasting, Empirical research
Research Areas: A. > Business School > International Management and Innovation
Item ID: 14522
Notes on copyright: © 2014. This author's accepted manuscript version is made available under the CC-BY-NC-ND 4.0 license
Useful Links:
Depositing User: Maryam Mohammadipour
Date Deposited: 08 Apr 2015 16:09
Last Modified: 29 Nov 2022 23:02

Actions (login required)

View Item View Item


Activity Overview
6 month trend
6 month trend

Additional statistics are available via IRStats2.