• Medientyp: E-Book
  • Titel: The Anatomy of Out-of-Sample Forecasting Accuracy
  • Beteiligte: Borup, Daniel [VerfasserIn]; Coulombe, Philippe Goulet [VerfasserIn]; Rapach, David [VerfasserIn]; Schütte, Erik Christian Montes [VerfasserIn]; Schwenk-Nebbe, Sander [VerfasserIn]
  • Erschienen: [S.l.]: SSRN, 2022
  • Erschienen in: FRB Atlanta Working Paper ; No. 2022-16
  • Umfang: 1 Online-Ressource (54 p)
  • Sprache: Englisch
  • DOI: 10.2139/ssrn.4278745
  • Identifikator:
  • Schlagwörter: variable importance ; out-of-sample performance ; Shapley value ; loss function ; machine learning ; inflation
  • Entstehung:
  • Anmerkungen: Nach Informationen von SSRN wurde die ursprüngliche Fassung des Dokuments November 16, 2022 erstellt
  • Beschreibung: We develop metrics based on Shapley values for interpreting time-series forecasting models, including “black-box” models from machine learning. Our metrics are model agnostic, so that they are applicable to any model (linear or nonlinear, parametric or nonparametric). Two of the metrics, iShapley-VI and oShapley-VI, measure the importance of individual predictors in fitted models for explaining the in-sample and out-of-sample predicted target values, respectively. The third metric is the performance-based Shapley value (PBSV), our main methodological contribution. PBSV measures the contributions of individual predictors in fitted models to the out-of-sample loss and thereby anatomizes out-of-sample forecasting accuracy. In an empirical application forecasting US inflation, we find important discrepancies between individual predictor relevance according to the in-sample iShapley-VI and out-of-sample PBSV. We use simulations to analyze potential sources of the discrepancies, including overfitting, structural breaks, and evolving predictor volatilities
  • Zugangsstatus: Freier Zugang