Building A hybrid Time Series Model Using ARDL With LSTM and GRU Models
DOI:
https://doi.org/10.33095/wh488343Abstract
Purpose: The aim of the research is to utilize a hybrid model that combines the linear model represented by Autoregressive Distributed Lag (ARDL) and the nonlinear model represented by deep learning models, such as Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU).
Theoretical Framework: The theoretical framework integrates the linear component represented by the Autoregressive Distributed Lag (ARDL) model and the nonlinear component represented by deep learning models, namely Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU) To create hybrid models.
Design/Methodology/Approach: The research methodology involves the use of EVIEWS 12 for analyzing standard data and integrating the ARDL model, as well as Python programming for building the proposed forecasting models. Weekly data from the Iraqi stock market, specifically from the banking and communications sectors spanning from 2017 to 2021, is utilized. The study compares the performance of the hybrid models ARDL_LSTM and ARDL_GRU with individual models using evaluation metrics such as root mean square error (RMSE) and mean absolute percentage error (MAPE).
Findings: The results indicate the superiority of the hybrid model ARDL_LSTM over other models due to its high accuracy and lower comparison measurement values.
Originality/Value: The originality of the research lies in its hybrid approach, combining ARDL with deep learning models like LSTM and GRU for time series forecasting. This approach adds value by addressing the limitations of individual models and improving forecasting accuracy in the context of the Iraqi stock market.
Downloads
References
Abdelkader, S., & Hamza, T. (2021). Comparison of ARDL And Artificial Neural Networks Models for Foreign Direct Investment Prediction in Algeria. Journal of Finance, Investment and Sustainable Development 6(2),388-400.
Ahmadzadeh, E., Kim, H., Jeong, O., Kim, N., & Moon, I. (2022). A deep bidirectional LSTM-GRU network model for automated ciphertext classification. IEEE Access,10,3228-3237 https://ieeexplore.ieee.org/abstract/document/9668927
Ali, N., S., M., & Mohammed, F., A. (2023). The use of ARIMA, LSTM and GRU models in time series hybridization with practical application. International Journal Of Nonlinear Analysis and Applications, 14(1), 2008–6822. https://doi.org/10.22075/ijnaa.2022.7110
Abdelkader, S., & Hamza, T. (2021). Comparison of ARDL And Artificial Neural Networks Models for Foreign Direct Investment Prediction in Algeria. Journal of Finance, Investment and Sustainable Development 6(2),388-400.
Ahmadzadeh, E., Kim, H., Jeong, O., Kim, N., & Moon, I. (2022). A deep bidirectional LSTM-GRU network model for automated ciphertext classification. IEEE Access,10,3228-3237 https://ieeexplore.ieee.org/abstract/document/9668927
Ali, N., S., M., & Mohammed, F., A. (2023). The use of ARIMA, LSTM and GRU models in time series hybridization with practical application. International Journal Of Nonlinear Analysis and Applications, 14(1), 2008–6822. https://doi.org/10.22075/ijnaa.2022.7110
Arunkumar, K. E., Kalaga, D. V, Mohan, C., Kumar, S., Kawaji, M., & Brenza, T. M. (2022). Comparative analysis of Gated Recurrent Units (GRU), long Short-Term memory (LSTM) cells, autoregressive Integrated moving average (ARIMA), seasonal autoregressive Integrated moving average (SARIMA) for forecasting COVID-19 trends. Alexandria Engineering Journal, 61, 7585–7603. https://doi.org/10.1016/j.aej.2022.01.011
Bakshi, S. S., Jaiswal, R. K., & Jaiswal, R. (2021). Efficiency Check Using Cointegration and Machine Learning Approach: Crude Oil Futures Markets. Procedia Computer Science, 191, 304–311. https://doi.org/10.1016/j.procs.2021.07.038
Box, G. E. P., Jenkins, G. M., Reinsel, G. C., & Ljung, G. M. (2015). Time series analysis: forecasting and control. John Wiley & Sons.
Chicco, D., Warrens, M. J., & Jurman, G. (2021). The coefficient of determination R-squared is more informative than SMAPE, MAE, MAPE, MSE and RMSE in regression analysis evaluation. PeerJ Computer Science, 7, 1–24. https://doi.org/10.7717/PEERJ-CS.623
Choi, C. (2018). Time Series forecasting with Recurrent Neural Network in presence of missing Data. Munin uit No https://munin.uit.no/handle/10037/14887
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014). Empirical evaluation of gated recurrent neural networks on sequence modeling. ArXiv Preprint ArXiv:1412.3555.
Elsworth, S., & Uttel, S. G. (2020). Time Series Forecasting Using LSTM Networks: A Symbolic Approach. https://github.com/nla-group/ABBA-LSTM.
Farhan, A. H. (2019). Using dickey _ fuller expanded test for testing variables of investment function in Iraq. Journal of Economics and Administrative Sciences, 25(114), 1–19.
Fu, R., Zhang, Z., & Li, L. (2016). Using LSTM and GRU neural network methods for traffic flow prediction. In 2016 31st Youth academic annual conference of Chinese association of automation (YAC) (pp. 324-328). IEEE.
Hamad,M.J , Mhmood, M.M. and Hassan ,F.F.(2021)" Measuring and analyzing the impact of external debt on the Gross Domestic product in Morocco for the period 1990-2017 using the ARDL model" Journal of Economics and Administrative sciences, 27(125) , pp.462-476, https://www.iasj.net/iasj/download/e7ac60c7d22e9607
Islam, M. S., & Hossain, E. (2021). Foreign exchange currency rate prediction using a GRU-LSTM hybrid network. Soft Computing Letters, 3, 100009. https://doi.org/10.1016/j.socl.2020.100009
Jalaee, S. A., Lashkary, M., & GhasemiNejad, A. (2019). The Phillips curve in Iran: econometric versus artificial neural networks. In Heliyon (Vol. 5, Issue 8). Elsevier Ltd. https://doi.org/10.1016/j.heliyon.2019.e02344
Javangwe, K. Z., & Takawira, O. (2022). Exchange rate movement and stock market performance: An application of the ARDL model. Cogent Economics and Finance, 10(1). https://doi.org/10.1080/23322039.2022.2075520
Majed,H.H.(2013)"Using time series methods to address seasonal variations in the consumer price" Journal of Economics and Administrative sciences Vol.19 , No.74,pp.360-380, https://www.jeasiq.uobaghdad.edu.iq/index.php/JEASIQ/article/view/1439
Mateus, B. C., Mendes, M., Farinha, J. T., Assis, R., & Cardoso, A. M. (2021). Comparing LSTM and GRU models to predict the condition of a pulp paper press. Energies, 14(21). https://doi.org/10.3390/en14216958
Mousa, M. A., & Mohammed, F. A. (2020). Applying some hybrid models for modeling bivariate time series assuming different distributions for random error with a practical application. Journal of Economics and Administrative Sciences, 26(117). https://www.iasj.net/iasj/article/177097
Nkoro, E., & Uko, A. K. (2016). Autoregressive Distributed Lag (ARDL) cointegration technique: application and interpretation. Journal of Statistical and Econometric Methods, 5(4), 63–91.
Nosier, S., El-Shobaky, S., & Salah, R. (2022). Comparing Econometrics Approach Vs. Deep Learning Approach in Forecasting Covid-19 Infections and Deaths Horizon in Egypt. Scientific journal of the Faculty of Economic Studies & Political Science, https://doi.org/10.21608/ESALEXU.2022.247220
Omran, N. F., Abd-El Ghany, S. F., Saleh, H., Ali, A. A., Gumaei, A., & Al-Rakhami, M. (2021). Applying Deep Learning Methods on Time-Series Data for Forecasting COVID-19 in Egypt, Kuwait, and Saudi Arabia. Complexity, 2021. https://doi.org/10.1155/2021/6686745
Pahlavani, M., Wilson, E., & Worthington, A. C. (2005). Trade-GDP Nexus in Iran: An Application of the Autoregression Distributed Lag (ARDL) Model. American journal of Applied Sciences 2(7), 1158–1165. https://ro.uow,edu.au/commpapers/144
Ramzi ,B.&Warda,A.(2023)"The Impact Of Money Supply on the general Stock Price Index on the Qatar Stock Exchange – on econometric study using the ARDL model for the period (2000-2020)".Journal of Finance , Investment and sustainable Development , 8(1),150-170 , https://www.asjp.cerist.dz/index.php/en/article/224252
Rehman, A., Saba, T., Mujahid, M., Alamri, F. S., & El Hakim, N. (2023). Parkinson’s Disease Detection Using Hybrid LSTM-GRU Deep Learning Model. Electronics (Switzerland), 12(13). https://doi.org/10.3390/electronics12132856
Salehinejad, H., Sankar, S., Barfett, J., Colak, E., & Valaee, S. (2017). Recent Advances in Recurrent Neural Networks. http://arxiv.org/abs/1801.01078
Selvin, S., Vinayakumar, R., Gopalakrishnan, E. A., Menon, V. K., & Soman, K. P. (2017). Stock price prediction using LSTM, RNN and CNN-sliding window model. 2017 International Conference on Advances in Computing, Communications and Informatics, ICACCI 2017, 2017-January, 1643–1647.
https://doi.org/10.1109/ICACCI.2017.8126078
Shewalkar, A., nyavanandi, D., & Ludwig, S. A. (2019). Performance Evaluation of Deep neural networks Applied to Speech Recognition: RNN, LSTM and GRU. Journal of Artificial Intelligence and Soft Computing Research, 9(4), 235–245.
https://doi.org/10.2478/jaiscr-2019-0006
Wang, Y., Xu, C., Ren, J., Li, Y., Wu, W., & Yao, S. (2021). Use of meteorological parameters for forecasting scarlet fever morbidity in Tianjin, Northern China. Environmental Science and Pollution Research, 28(6), 7281–7294.
https://doi.org/10.1007/s11356-020-11072-9
Zafar, N., Haq, I. U., Chughtai, J. U. R., & Shafiq, O. (2022). Applying Hybrid LSTM-GRU Model Based on Heterogeneous Data Sources for Traffic Speed Prediction in Urban Areas. Sensors, 22(9). https://doi.org/10.3390/s22093348
Published
Issue
Section
License
Copyright (c) 2024 Journal of Economics and Administrative Sciences
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Articles submitted to the journal should not have been published before in their current or substantially similar form or be under consideration for publication with another journal. Please see JEAS originality guidelines for details. Use this in conjunction with the points below about references, before submission i.e. always attribute clearly using either indented text or quote marks as well as making use of the preferred Harvard style of formatting. Authors submitting articles for publication warrant that the work is not an infringement of any existing copyright and will indemnify the publisher against any breach of such warranty. For ease of dissemination and to ensure proper policing of use, papers and contributions become the legal copyright of the publisher unless otherwise agreed.
The editor may make use of Turnitin software for checking the originality of submissions received.
How to Cite
