On bootstrapping tests of equal forecast accuracy for nested models

The asymptotic distributions of the recursive out‐of‐sample forecast accuracy test statistics depend on stochastic integrals of Brownian motion when the models under comparison are nested. This often complicates their implementation in practice because the computation of their asymptotic critical va...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Journal of forecasting 2023-11, Vol.42 (7), p.1844-1864
1. Verfasser: Doko Tchatoka, Firmin
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 1864
container_issue 7
container_start_page 1844
container_title Journal of forecasting
container_volume 42
creator Doko Tchatoka, Firmin
description The asymptotic distributions of the recursive out‐of‐sample forecast accuracy test statistics depend on stochastic integrals of Brownian motion when the models under comparison are nested. This often complicates their implementation in practice because the computation of their asymptotic critical values is burdensome. Hansen and Timmermann (2015, Econometrica) propose a Wald approximation of the commonly used recursive ‐statistic and provide a simple characterization of the exact density of its asymptotic distribution. However, this characterization holds only when the larger model has one extra predictor or the forecast errors are homoscedastic. No such closed‐form characterization is readily available when the nesting involves more than one predictor and heteroscedasticity or serial correlation is present. We first show through Monte Carlo experiments that both the recursive ‐test and its Wald approximation have poor finite‐sample properties, especially when the forecast horizon is greater than one and forecast errors exhibit serial correlation. We then propose a hybrid bootstrap method consisting of a moving block bootstrap and a residual‐based bootstrap for both statistics and establish its validity. Simulations show that the hybrid bootstrap has good finite‐sample performance, even in multi‐step ahead forecasts with more than one predictor, and with heteroscedastic or autocorrelated forecast errors. The bootstrap method is illustrated on forecasting core inflation and GDP growth.
doi_str_mv 10.1002/for.2987
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2870820305</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2870820305</sourcerecordid><originalsourceid>FETCH-LOGICAL-c340t-17dddad1c3e8d267639d43f65130fa680ff01ccb647d53608615c246c7245a3</originalsourceid><addsrcrecordid>eNpF0E1LAzEQBuAgCtYq-BMCXrxsnUl2k-xRil9Q6EEP3kKaD9nSbrbJ7qH_3pQKngaGh_cdhpB7hAUCsKcQ04K1Sl6QGULbVsjx-5LMgElZCdHya3KT8xYApEI2I8t1TzcxjnlMZhi6_oeOPo-ZxkD9YTI7WvK8NXmkxtopGXs8bWhfkHd0H53f5VtyFcwu-7u_OSefry9fy_dqtX77WD6vKstrGCuUzjnj0HKvHBNS8NbVPIgGOQQjFIQAaO1G1NI1XIAS2FhWCytZ3Rg-Jw_n1CHFw1T69TZOqS-FmikJigGHpqjHs7Ip5px80EPq9iYdNYI-PUiX8_XpQYXSM_U29l3-h0qiBCG45L_8OWJo</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2870820305</pqid></control><display><type>article</type><title>On bootstrapping tests of equal forecast accuracy for nested models</title><source>Wiley Online Library Journals Frontfile Complete</source><source>Business Source Complete</source><creator>Doko Tchatoka, Firmin</creator><creatorcontrib>Doko Tchatoka, Firmin</creatorcontrib><description>The asymptotic distributions of the recursive out‐of‐sample forecast accuracy test statistics depend on stochastic integrals of Brownian motion when the models under comparison are nested. This often complicates their implementation in practice because the computation of their asymptotic critical values is burdensome. Hansen and Timmermann (2015, Econometrica) propose a Wald approximation of the commonly used recursive ‐statistic and provide a simple characterization of the exact density of its asymptotic distribution. However, this characterization holds only when the larger model has one extra predictor or the forecast errors are homoscedastic. No such closed‐form characterization is readily available when the nesting involves more than one predictor and heteroscedasticity or serial correlation is present. We first show through Monte Carlo experiments that both the recursive ‐test and its Wald approximation have poor finite‐sample properties, especially when the forecast horizon is greater than one and forecast errors exhibit serial correlation. We then propose a hybrid bootstrap method consisting of a moving block bootstrap and a residual‐based bootstrap for both statistics and establish its validity. Simulations show that the hybrid bootstrap has good finite‐sample performance, even in multi‐step ahead forecasts with more than one predictor, and with heteroscedastic or autocorrelated forecast errors. The bootstrap method is illustrated on forecasting core inflation and GDP growth.</description><identifier>ISSN: 0277-6693</identifier><identifier>EISSN: 1099-131X</identifier><identifier>DOI: 10.1002/for.2987</identifier><language>eng</language><publisher>Chichester: Wiley Periodicals Inc</publisher><subject>Accuracy ; Approximation ; Bootstrap method ; Density ; Forecasting ; Inflation ; Tests</subject><ispartof>Journal of forecasting, 2023-11, Vol.42 (7), p.1844-1864</ispartof><rights>2023. This article is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c340t-17dddad1c3e8d267639d43f65130fa680ff01ccb647d53608615c246c7245a3</cites><orcidid>0000-0003-0694-4443 ; 0000-0003-1876-0633</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,776,780,27901,27902</link.rule.ids></links><search><creatorcontrib>Doko Tchatoka, Firmin</creatorcontrib><title>On bootstrapping tests of equal forecast accuracy for nested models</title><title>Journal of forecasting</title><description>The asymptotic distributions of the recursive out‐of‐sample forecast accuracy test statistics depend on stochastic integrals of Brownian motion when the models under comparison are nested. This often complicates their implementation in practice because the computation of their asymptotic critical values is burdensome. Hansen and Timmermann (2015, Econometrica) propose a Wald approximation of the commonly used recursive ‐statistic and provide a simple characterization of the exact density of its asymptotic distribution. However, this characterization holds only when the larger model has one extra predictor or the forecast errors are homoscedastic. No such closed‐form characterization is readily available when the nesting involves more than one predictor and heteroscedasticity or serial correlation is present. We first show through Monte Carlo experiments that both the recursive ‐test and its Wald approximation have poor finite‐sample properties, especially when the forecast horizon is greater than one and forecast errors exhibit serial correlation. We then propose a hybrid bootstrap method consisting of a moving block bootstrap and a residual‐based bootstrap for both statistics and establish its validity. Simulations show that the hybrid bootstrap has good finite‐sample performance, even in multi‐step ahead forecasts with more than one predictor, and with heteroscedastic or autocorrelated forecast errors. The bootstrap method is illustrated on forecasting core inflation and GDP growth.</description><subject>Accuracy</subject><subject>Approximation</subject><subject>Bootstrap method</subject><subject>Density</subject><subject>Forecasting</subject><subject>Inflation</subject><subject>Tests</subject><issn>0277-6693</issn><issn>1099-131X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><recordid>eNpF0E1LAzEQBuAgCtYq-BMCXrxsnUl2k-xRil9Q6EEP3kKaD9nSbrbJ7qH_3pQKngaGh_cdhpB7hAUCsKcQ04K1Sl6QGULbVsjx-5LMgElZCdHya3KT8xYApEI2I8t1TzcxjnlMZhi6_oeOPo-ZxkD9YTI7WvK8NXmkxtopGXs8bWhfkHd0H53f5VtyFcwu-7u_OSefry9fy_dqtX77WD6vKstrGCuUzjnj0HKvHBNS8NbVPIgGOQQjFIQAaO1G1NI1XIAS2FhWCytZ3Rg-Jw_n1CHFw1T69TZOqS-FmikJigGHpqjHs7Ip5px80EPq9iYdNYI-PUiX8_XpQYXSM_U29l3-h0qiBCG45L_8OWJo</recordid><startdate>20231101</startdate><enddate>20231101</enddate><creator>Doko Tchatoka, Firmin</creator><general>Wiley Periodicals Inc</general><scope>OQ6</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>8BJ</scope><scope>FQK</scope><scope>JBE</scope><orcidid>https://orcid.org/0000-0003-0694-4443</orcidid><orcidid>https://orcid.org/0000-0003-1876-0633</orcidid></search><sort><creationdate>20231101</creationdate><title>On bootstrapping tests of equal forecast accuracy for nested models</title><author>Doko Tchatoka, Firmin</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c340t-17dddad1c3e8d267639d43f65130fa680ff01ccb647d53608615c246c7245a3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Accuracy</topic><topic>Approximation</topic><topic>Bootstrap method</topic><topic>Density</topic><topic>Forecasting</topic><topic>Inflation</topic><topic>Tests</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Doko Tchatoka, Firmin</creatorcontrib><collection>ECONIS</collection><collection>CrossRef</collection><collection>International Bibliography of the Social Sciences (IBSS)</collection><collection>International Bibliography of the Social Sciences</collection><collection>International Bibliography of the Social Sciences</collection><jtitle>Journal of forecasting</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Doko Tchatoka, Firmin</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>On bootstrapping tests of equal forecast accuracy for nested models</atitle><jtitle>Journal of forecasting</jtitle><date>2023-11-01</date><risdate>2023</risdate><volume>42</volume><issue>7</issue><spage>1844</spage><epage>1864</epage><pages>1844-1864</pages><issn>0277-6693</issn><eissn>1099-131X</eissn><abstract>The asymptotic distributions of the recursive out‐of‐sample forecast accuracy test statistics depend on stochastic integrals of Brownian motion when the models under comparison are nested. This often complicates their implementation in practice because the computation of their asymptotic critical values is burdensome. Hansen and Timmermann (2015, Econometrica) propose a Wald approximation of the commonly used recursive ‐statistic and provide a simple characterization of the exact density of its asymptotic distribution. However, this characterization holds only when the larger model has one extra predictor or the forecast errors are homoscedastic. No such closed‐form characterization is readily available when the nesting involves more than one predictor and heteroscedasticity or serial correlation is present. We first show through Monte Carlo experiments that both the recursive ‐test and its Wald approximation have poor finite‐sample properties, especially when the forecast horizon is greater than one and forecast errors exhibit serial correlation. We then propose a hybrid bootstrap method consisting of a moving block bootstrap and a residual‐based bootstrap for both statistics and establish its validity. Simulations show that the hybrid bootstrap has good finite‐sample performance, even in multi‐step ahead forecasts with more than one predictor, and with heteroscedastic or autocorrelated forecast errors. The bootstrap method is illustrated on forecasting core inflation and GDP growth.</abstract><cop>Chichester</cop><pub>Wiley Periodicals Inc</pub><doi>10.1002/for.2987</doi><tpages>21</tpages><orcidid>https://orcid.org/0000-0003-0694-4443</orcidid><orcidid>https://orcid.org/0000-0003-1876-0633</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0277-6693
ispartof Journal of forecasting, 2023-11, Vol.42 (7), p.1844-1864
issn 0277-6693
1099-131X
language eng
recordid cdi_proquest_journals_2870820305
source Wiley Online Library Journals Frontfile Complete; Business Source Complete
subjects Accuracy
Approximation
Bootstrap method
Density
Forecasting
Inflation
Tests
title On bootstrapping tests of equal forecast accuracy for nested models
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-08T13%3A27%3A47IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=On%20bootstrapping%20tests%20of%20equal%20forecast%20accuracy%20for%20nested%20models&rft.jtitle=Journal%20of%20forecasting&rft.au=Doko%20Tchatoka,%20Firmin&rft.date=2023-11-01&rft.volume=42&rft.issue=7&rft.spage=1844&rft.epage=1864&rft.pages=1844-1864&rft.issn=0277-6693&rft.eissn=1099-131X&rft_id=info:doi/10.1002/for.2987&rft_dat=%3Cproquest_cross%3E2870820305%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2870820305&rft_id=info:pmid/&rfr_iscdi=true