Nothing Special   »   [go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/a/eee/finana/v18y2009i3p117-124.html
   My bibliography  Save this article

Are RiskMetrics forecasts good enough? Evidence from 31 stock markets

Author

Listed:
  • McMillan, David G.
  • Kambouroudis, Dimos
Abstract
Academic research has highlighted the inherent flaws within the RiskMetrics model and demonstrated the superiority of the GARCH approach in-sample. However, these results do not necessarily extend to forecasting performance. This paper seeks answer to the question of whether RiskMetrics volatility forecasts are adequate in comparison to those obtained from GARCH models. To answer the question stock index data is taken from 31 international markets and subjected to two exercises, a straightforward volatility forecasting exercise and a Value-at-Risk exceptions forecasting competition. Our results provide some simple answers to the above question. When forecasting volatility of the G7 stock markets the APARCH model, in particular, provides superior forecasts that are significantly different from the RiskMetrics models in over half the cases. This result also extends to the European markets with the APARCH model typically preferred. For the Asian markets the RiskMetrics model performs well, and is only significantly dominated by the GARCH models for one market, although there is evidence that the APARCH model provides a better forecast for the larger Asian markets. Regarding the Value-at-Risk exercise, when forecasting the 1% VaR the RiskMetrics model does a poor job and is typically the worst performing model, again the APARCH model does well. However, forecasting the 5% VaR then the RiskMetrics model does provide an adequate performance. In short, the RiskMetrics model only performs well in forecasting the volatility of small emerging markets and for broader VaR measures.

Suggested Citation

  • McMillan, David G. & Kambouroudis, Dimos, 2009. "Are RiskMetrics forecasts good enough? Evidence from 31 stock markets," International Review of Financial Analysis, Elsevier, vol. 18(3), pages 117-124, June.
    • Handle: RePEc:eee:finana:v:18:y:2009:i:3:p:117-124
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1057-5219(09)00009-X
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Schwert, G William, 1990. "Stock Volatility and the Crash of '87," The Review of Financial Studies, Society for Financial Studies, vol. 3(1), pages 77-102.
    2. David McMillan & Alan Speight & Owain Apgwilym, 2000. "Forecasting UK stock market volatility," Applied Financial Economics, Taylor & Francis Journals, vol. 10(4), pages 435-448.
    3. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    4. Asger Lunde & Peter R. Hansen, 2005. "A forecast comparison of volatility models: does anything beat a GARCH(1,1)?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(7), pages 873-889.
    5. So, Mike K.P. & Yu, Philip L.H., 2006. "Empirical analysis of GARCH models in value at risk estimation," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 16(2), pages 180-197, April.
    6. Nelson, Daniel B, 1991. "Conditional Heteroskedasticity in Asset Returns: A New Approach," Econometrica, Econometric Society, vol. 59(2), pages 347-370, March.
    7. Baillie, Richard T. & Bollerslev, Tim & Mikkelsen, Hans Ole, 1996. "Fractionally integrated generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 74(1), pages 3-30, September.
    8. Ding, Zhuanxin & Granger, Clive W. J. & Engle, Robert F., 1993. "A long memory property of stock market returns and a new model," Journal of Empirical Finance, Elsevier, vol. 1(1), pages 83-106, June.
    9. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
    10. Andersen, Torben G. & Bollerslev, Tim & Lange, Steve, 1999. "Forecasting financial market volatility: Sample frequency vis-a-vis forecast horizon," Journal of Empirical Finance, Elsevier, vol. 6(5), pages 457-477, December.
    11. Brailsford, Timothy J. & Faff, Robert W., 1996. "An evaluation of volatility forecasting techniques," Journal of Banking & Finance, Elsevier, vol. 20(3), pages 419-438, April.
    12. Pagan, Adrian R. & Schwert, G. William, 1990. "Alternative models for conditional stock volatility," Journal of Econometrics, Elsevier, vol. 45(1-2), pages 267-290.
    13. Yock Y. Chong & David F. Hendry, 1986. "Econometric Evaluation of Linear Macro-Economic Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 53(4), pages 671-690.
    14. Davidson, James, 2004. "Moment and Memory Properties of Linear Conditional Heteroscedasticity Models, and a New Model," Journal of Business & Economic Statistics, American Statistical Association, vol. 22(1), pages 16-29, January.
    15. Robert F. Engle & Simone Manganelli, 2004. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," Journal of Business & Economic Statistics, American Statistical Association, vol. 22, pages 367-381, October.
    16. Jorion, Philippe, 1995. "Predicting Volatility in the Foreign Exchange Market," Journal of Finance, American Finance Association, vol. 50(2), pages 507-528, June.
    17. Bera, Anil K & Higgins, Matthew L, 1993. "ARCH Models: Properties, Estimation and Testing," Journal of Economic Surveys, Wiley Blackwell, vol. 7(4), pages 305-366, December.
    18. Bollerslev, Tim & Chou, Ray Y. & Kroner, Kenneth F., 1992. "ARCH modeling in finance : A review of the theory and empirical evidence," Journal of Econometrics, Elsevier, vol. 52(1-2), pages 5-59.
    19. Akgiray, Vedat, 1989. "Conditional Heteroscedasticity in Time Series of Stock Returns: Evidence and Forecasts," The Journal of Business, University of Chicago Press, vol. 62(1), pages 55-80, January.
    20. Philippe Jorion, 1996. "Risk and Turnover in the Foreign Exchange Market," NBER Chapters, in: The Microstructure of Foreign Exchange Markets, pages 19-40, National Bureau of Economic Research, Inc.
    21. Andersen, Torben G & Bollerslev, Tim, 1998. "Answering the Skeptics: Yes, Standard Volatility Models Do Provide Accurate Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 885-905, November.
    22. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
    23. Alan E. H. Speight & David G. McMillan, 2004. "Daily volatility forecasts: reassessing the performance of GARCH models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 449-460.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Louzis, Dimitrios P. & Xanthopoulos-Sisinis, Spyros & Refenes, Apostolos P., 2011. "Are realized volatility models good candidates for alternative Value at Risk prediction strategies?," MPRA Paper 30364, University Library of Munich, Germany.
    2. Mohamed Chikhi & Anne Péguin-Feissolle & Michel Terraza, 2013. "SEMIFARMA-HYGARCH Modeling of Dow Jones Return Persistence," Computational Economics, Springer;Society for Computational Economics, vol. 41(2), pages 249-265, February.
    3. Stavros Degiannakis & Pamela Dent & Christos Floros, 2014. "A Monte Carlo Simulation Approach to Forecasting Multi-period Value-at-Risk and Expected Shortfall Using the FIGARCH-skT Specification," Manchester School, University of Manchester, vol. 82(1), pages 71-102, January.
    4. Manh Ha Nguyen & Olivier Darné, 2018. "Forecasting and risk management in the Vietnam Stock Exchange," Working Papers halshs-01679456, HAL.
    5. Laura Garcia‐Jorcano & Alfonso Novales, 2021. "Volatility specifications versus probability distributions in VaR forecasting," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(2), pages 189-212, March.
    6. Chrétien, Stéphane & Coggins, Frank, 2010. "Performance and conservatism of monthly FHS VaR: An international investigation," International Review of Financial Analysis, Elsevier, vol. 19(5), pages 323-333, December.
    7. Dimitrakopoulos, Dimitris N. & Kavussanos, Manolis G. & Spyrou, Spyros I., 2010. "Value at risk models for volatile emerging markets equity portfolios," The Quarterly Review of Economics and Finance, Elsevier, vol. 50(4), pages 515-526, November.
    8. Chebbi, Ali & Hedhli, Amel, 2022. "Revisiting the accuracy of standard VaR methods for risk assessment: Using the Copula–EVT multidimensional approach for stock markets in the MENA region," The Quarterly Review of Economics and Finance, Elsevier, vol. 84(C), pages 430-445.
    9. Louzis, Dimitrios P. & Xanthopoulos-Sisinis, Spyros & Refenes, Apostolos P., 2014. "Realized volatility models and alternative Value-at-Risk prediction strategies," Economic Modelling, Elsevier, vol. 40(C), pages 101-116.
    10. Stavroyiannis, S. & Makris, I. & Nikolaidis, V. & Zarangas, L., 2012. "Econometric modeling and value-at-risk using the Pearson type-IV distribution," International Review of Financial Analysis, Elsevier, vol. 22(C), pages 10-17.
    11. Chaker Aloui & Hela BEN HAMIDA, 2015. "Estimation and Performance Assessment of Value-at-Risk and Expected Shortfall Based on Long-Memory GARCH-Class Models," Czech Journal of Economics and Finance (Finance a uver), Charles University Prague, Faculty of Social Sciences, vol. 65(1), pages 30-54, January.
    12. Dimitrios P. Louzis & Angelos T. Vouldis, 2013. "A financial systemic stress index for Greece," Working Papers 155, Bank of Greece.
    13. Diamandis, Panayiotis F. & Drakos, Anastassios A. & Kouretas, Georgios P. & Zarangas, Leonidas, 2011. "Value-at-risk for long and short trading positions: Evidence from developed and emerging equity markets," International Review of Financial Analysis, Elsevier, vol. 20(3), pages 165-176, June.
    14. Degiannakis, Stavros & Potamia, Artemis, 2017. "Multiple-days-ahead value-at-risk and expected shortfall forecasting for stock indices, commodities and exchange rates: Inter-day versus intra-day data," International Review of Financial Analysis, Elsevier, vol. 49(C), pages 176-190.
    15. Maghyereh Aktham Issa & Awartani Basel, 2012. "Modeling and Forecasting Value-at-Risk in the UAE Stock Markets: The Role of Long Memory, Fat Tails and Asymmetries in Return Innovations," Review of Middle East Economics and Finance, De Gruyter, vol. 8(1), pages 1-22, August.
    16. González-Pla, Francisco & Lovreta, Lidija, 2022. "Modeling and forecasting firm-specific volatility: The role of asymmetry and long-memory," Finance Research Letters, Elsevier, vol. 48(C).
    17. Stavros Stavroyiannis & Leonidas Zarangas, 2013. "Out of Sample Value-at-Risk and Backtesting with the Standardized Pearson Type-IV Skewed Distribution," Panoeconomicus, Savez ekonomista Vojvodine, Novi Sad, Serbia, vol. 60(2), pages 231-247, April.
    18. Emrah ALTUN & Morad ALIZADEH & Gamze OZEL & Hüseyin TATLIDIL & Najmieh MAKSAYI, 2017. "Forecasting Value-At-Risk With Two-Step Method: Garch-Exponentiated Odd Log-Logistic Normal Model," Journal for Economic Forecasting, Institute for Economic Forecasting, vol. 0(4), pages 97-115, December.
    19. Paul Bui Quang & Tony Klein & Nam H. Nguyen & Thomas Walther, 2018. "Value-at-Risk for South-East Asian Stock Markets: Stochastic Volatility vs. GARCH," JRFM, MDPI, vol. 11(2), pages 1-20, April.
    20. Louzis, Dimitrios P. & Vouldis, Angelos T., 2012. "A methodology for constructing a financial systemic stress index: An application to Greece," Economic Modelling, Elsevier, vol. 29(4), pages 1228-1241.
    21. Degiannakis, Stavros & Floros, Christos & Dent, Pamela, 2013. "Forecasting value-at-risk and expected shortfall using fractionally integrated models of conditional volatility: International evidence," International Review of Financial Analysis, Elsevier, vol. 27(C), pages 21-33.
    22. Gabriela Anghelache & Dumitru-Cristian Oanea, 2014. "Main Romanian Commercial Banks’ Systemic Risk during Financial Crisis: a CoVar Approach," The Review of Finance and Banking, Academia de Studii Economice din Bucuresti, Romania / Facultatea de Finante, Asigurari, Banci si Burse de Valori / Catedra de Finante, vol. 6(2), pages 069-080, December.
    23. Liu, Wei & Semeyutin, Artur & Lau, Chi Keung Marco & Gozgor, Giray, 2020. "Forecasting Value-at-Risk of Cryptocurrencies with RiskMetrics type models," Research in International Business and Finance, Elsevier, vol. 54(C).
    24. Slim, Skander & Koubaa, Yosra & BenSaïda, Ahmed, 2017. "Value-at-Risk under Lévy GARCH models: Evidence from global stock markets," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 46(C), pages 30-53.
    25. Harris, Richard D.F. & Mazibas, Murat, 2010. "Dynamic hedge fund portfolio construction," International Review of Financial Analysis, Elsevier, vol. 19(5), pages 351-357, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Twm Evans & David McMillan, 2007. "Volatility forecasts: the role of asymmetric and long-memory dynamics and regional evidence," Applied Financial Economics, Taylor & Francis Journals, vol. 17(17), pages 1421-1430.
    2. David McMillan & Raquel Quiroga Garcia, 2009. "Intra-day volatility forecasts," Applied Financial Economics, Taylor & Francis Journals, vol. 19(8), pages 611-623.
    3. Kambouroudis, Dimos S. & McMillan, David G., 2015. "Is there an ideal in-sample length for forecasting volatility?," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 37(C), pages 114-137.
    4. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2006. "Volatility and Correlation Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 15, pages 777-878, Elsevier.
    5. Franses,Philip Hans & Dijk,Dick van, 2000. "Non-Linear Time Series Models in Empirical Finance," Cambridge Books, Cambridge University Press, number 9780521779654, September.
    6. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2005. "Volatility forecasting," CFS Working Paper Series 2005/08, Center for Financial Studies (CFS).
    7. Mehmet Sahiner, 2022. "Forecasting volatility in Asian financial markets: evidence from recursive and rolling window methods," SN Business & Economics, Springer, vol. 2(10), pages 1-74, October.
    8. Alan E. H. Speight & David G. McMillan, 2004. "Daily volatility forecasts: reassessing the performance of GARCH models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 449-460.
    9. Trino-Manuel Ñíguez, 2008. "Volatility and VaR forecasting in the Madrid Stock Exchange," Spanish Economic Review, Springer;Spanish Economic Association, vol. 10(3), pages 169-196, September.
    10. Degiannakis, Stavros & Xekalaki, Evdokia, 2004. "Autoregressive Conditional Heteroskedasticity (ARCH) Models: A Review," MPRA Paper 80487, University Library of Munich, Germany.
    11. N. Antonakakis & J. Darby, 2013. "Forecasting volatility in developing countries' nominal exchange returns," Applied Financial Economics, Taylor & Francis Journals, vol. 23(21), pages 1675-1691, November.
    12. Trino-Manuel Ñíguez, 2003. "Volatility And Var Forecasting For The Ibex-35 Stock-Return Index Using Figarch-Type Processes And Different Evaluation Criteria," Working Papers. Serie AD 2003-33, Instituto Valenciano de Investigaciones Económicas, S.A. (Ivie).
    13. Liu, Hung-Chun & Chiang, Shu-Mei & Cheng, Nick Ying-Pin, 2012. "Forecasting the volatility of S&P depositary receipts using GARCH-type models under intraday range-based and return-based proxy measures," International Review of Economics & Finance, Elsevier, vol. 22(1), pages 78-91.
    14. Eskandar A. Tooma, 2003. "Modeling and Forecasting Egyptian Stock Market Volatility Before and After Price Limits," Working Papers 0310, Economic Research Forum, revised Apr 2003.
    15. Tim Bollerslev, 2008. "Glossary to ARCH (GARCH)," CREATES Research Papers 2008-49, Department of Economics and Business Economics, Aarhus University.
    16. Bali, Turan G. & Weinbaum, David, 2007. "A conditional extreme value volatility estimator based on high-frequency returns," Journal of Economic Dynamics and Control, Elsevier, vol. 31(2), pages 361-397, February.
    17. Xekalaki, Evdokia & Degiannakis, Stavros, 2005. "Evaluating volatility forecasts in option pricing in the context of a simulated options market," Computational Statistics & Data Analysis, Elsevier, vol. 49(2), pages 611-629, April.
    18. repec:awi:wpaper:0472 is not listed on IDEAS
    19. LeBaron, Blake, 2003. "Non-Linear Time Series Models in Empirical Finance,: Philip Hans Franses and Dick van Dijk, Cambridge University Press, Cambridge, 2000, 296 pp., Paperback, ISBN 0-521-77965-0, $33, [UK pound]22.95, [," International Journal of Forecasting, Elsevier, vol. 19(4), pages 751-752.
    20. BAUWENS, Luc & HAFNER, Christian & LAURENT, Sébastien, 2011. "Volatility models," LIDAM Discussion Papers CORE 2011058, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
      • Bauwens, L. & Hafner, C. & Laurent, S., 2012. "Volatility Models," LIDAM Reprints ISBA 2012028, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
      • Bauwens, L. & Hafner C. & Laurent, S., 2011. "Volatility Models," LIDAM Discussion Papers ISBA 2011044, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    21. Hou, Aijun & Suardi, Sandy, 2012. "A nonparametric GARCH model of crude oil price return volatility," Energy Economics, Elsevier, vol. 34(2), pages 618-626.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:finana:v:18:y:2009:i:3:p:117-124. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/620166 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.