Grid Search Of Multilayer Perceptron Based On The Walk-Forward Validation Methodology

Ngoc Thanh Tran

Abstract


Multilayer Perceptron neural network is one of the widely used method for load forecasting. There are hyperparameters which can be used to determine the network structure and used to train the Multilayer Perceptron neural network model. This paper aims to propose a framework for Grid Search model based on the Walk-Forward Validation methodology. The training process will specify the optimal models which satisfy requirement for minimum of accuracy scores of Root Mean Square Error, Mean Absolute Percentage Error and Mean Absolute Error. The testing process will evaluate the optimal models along with the other ones. The results indicated that the optimal models have accuracy scores near the minimum values. The US airline passenger and Ho Chi Minh city load demand data were used to verify the accuracy and reliability of the grid search framework.

Keywords


Multilayer Perceptron; Walk-Forward Validation; Grid Search model; Accuracy scores

References


Li, W., Kong, D., & Wu, J., "A novel hybrid model based on extreme learning machine, k-nearest neighbor regression and wavelet denoising applied to short-term electric load forecasting," Energies, 10(5), 1–16, 2017

Kaysal, A., Koroglu, S., Oguz, Y., & Kaysal, K, "Artificial Neural Networks and Adaptive Neuro-Fuzzy Inference Systems Approaches to Forecast the Electricity Data for Load Demand, an Analysis of Dinar District Case," ISMSIT 2018 - 2nd International Symposium on Multidisciplinary Studies and Innovative Technologies, Proceedings. , 2018

Netsanet, S., Zhang, J., & Zheng, D., "Short term load forecasting using wavelet augmented non-linear autoregressive neural networks: A single customer level perspective," IEEE 3rd International Conference on Big Data Analysis, ICBDA 2018, 407–411, 2018.

J.W. Taylor, P.E. McSharry, "Short-term load forecasting methods: an evaluation based on European data," IEEE Trans. Power Syst., vol. 22, no. 4, pp. 2213-2219, 2007

P. E. McSharry, S. Bouwman, G. Bloemhof, "Probabilistic forecasts of the magnitude and timing of peak electricity demand," IEEE Trans. Power Syst., vol. 20, no. 2, pp. 1166-1172, 2005.

E. Gonzalez-Romera, M. A. Jaramillo-Moran, D. Carmona-Fernandez, "Monthly electric energy demand forecasting based on trend extraction," IEEE Trans. Power Syst., vol. 21, no. 4, pp. 1946-1953, Nov. 2006.

Hong, T., Wang, P., & Willis, H. L. , "A naïve multiple linear regression benchmark for short term load forecasting," IEEE Power and Energy Society General Meeting, (2), 1–6, 2011.

Hong, T., Gui, M., Baran, M. E., & Willis, H. L, "Modeling and forecasting hourly electric load by multiple linear regression with interactions," IEEE PES General Meeting, PES 2010, 1–8, 2010.

Abdul Karim, S. A., & Alwi, S. A. , "Electricity load forecasting in UTP using moving averages and exponential smoothing techniques," Applied Mathematical Sciences, 7(77–80), 4003–4014, 2013.

Göb, R., Lurz, K., & Pievatolo, A, "Electrical load forecasting by exponential smoothing with covariates," Applied Stochastic Models in Business and Industry, 29(6), 629–645, 2013.

Acquah, M. A., Han, S., Kim, H., Park, S., & Han, H, "Real-Time Peak Control algorithm using Stochastic Optimization," IEEE 7th Annual Computing and Communication Workshop and Conference, 2017.

Ahmadi, S., Bevrani, H., & Jannaty, H, "A fuzzy inference model for short-term load forecasting," 2nd Iranian Conference on Renewable Energy and Distributed Generation, ICREDG 2012, 37, 39–44, 2012.

Thiang, & Kurniawan, Y, "Electrical load time series data forecasting using Interval Type-2 Fuzzy Logic system. Proceedings," 3rd IEEE International Conference on Computer Science and Information Technology, ICCSIT 2010, 5, 527–531, 2010.

Kaysal, A., Koroglu, S., Oguz, Y., & Kaysal, K, "Artificial Neural Networks and Adaptive Neuro-Fuzzy Inference Systems Approaches to Forecast the Electricity Data for Load Demand, an Analysis of Dinar District Case," ISMSIT 2018 - 2nd International Symposium on Multidisciplinary Studies and Innovative Technologies, Proceedings, 2018.

Netsanet, S., Zhang, J., & Zheng, D, "Short term load forecasting using wavelet augmented non-linear autoregressive neural networks: A single customer level perspective," IEEE 3rd International Conference on Big Data Analysis, ICBDA 2018, 407–411, 2018.

Vos, M., Bender-Saebelkampf, C., & Albayrak, S, "Residential Short-Term Load Forecasting Using Convolutional Neural Networks," IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids, SmartGridComm 2018, 2018.

Rahman, S., & Hazim, O, "A Generalized Knowledge-Based Short-Term Load-Forecasting Technique," IEEE Transactions on Power Systems, 8(2), 508–514, 1993.

Hernández, L., Baladrón, C., Aguiar, J. M., Carro, B., Sánchez-Esguevillas, A., & Lloret, J, "Artificial neural networks for short-term load forecasting in microgrids environment," Energy, 75, 252–264, 2014.

Khotanzad, A., Afkhami-Rohani, R., Lu, T. L., Abaye, A., Davis, M., & Maratukulam, D. J, "ANNSTLF - A neural-network-based electric load forecasting system," IEEE Transactions on Neural Networks, 8(4), 835–846, 1997.

Baliyan, A., Gaurav, K., & Kumar Mishra, S, "A review of short term load forecasting using artificial neural network models,"`` Procedia Computer Science, 48(C), 121–125, 2015.

Zhang, T., Liu, D., & Yue, D, "Rough Neuron Based RBF Neural Networks for Short-Term Load Forecasting," Proceedings - 1st IEEE International Conference on Energy Internet, ICEI 2017, 291–295, 2017

Andriy Burkov. The Hundred-Page Machine Learning," Andriy Burkov, 2019

Zhang, W., Quan, H., & Srinivasan, D, "An Improved Quantile Regression Neural Network for Probabilistic Load Forecasting," IEEE Transactions on Smart Grid, 10(4), 4425–4434, 2019

Bianchi, F. M., Maiorino, E., Kampffmeyer, M. C., Rizzi, A., & Jenssen, R, "An overview and comparative analysis of Recurrent Neural Networks for Short Term Load Forecasting," Springer Briefs in Computer Science, 2015

Jason Brownlee, "Deep Learning for Time Series Forecasting," [Ebook], 2019

https://keras.io/optimizers/

Jason, B. , "Deep Learning With Python, [Ebook], 2019

Daumé, H., " A Course in Machine Learning," Todo, 2012

Moon, J., Kim, K. H., Kim, Y., & Hwang, E, "A Short-Term Electric Load Forecasting Scheme Using 2-Stage Predictive Analytics," Proceedings - IEEE International Conference on Big Data and Smart Computing, BigComp 2018, 219–226, 2018

Ngoc TT, Dai L Van, "Grid search of exponential smoothing method: A case study of Ho Chi Minh City load demand, " Indones J Electr Eng Comput Sci, 19(3):1121-1130, 2020

H. Kusdarwati and S. Handoyo, “System for prediction of non stationary time series based on the wavelet radial bases function neural network model,” Int. J. Electr. Comput. Eng., vol. 8, no. 4, pp. 2327–2337, 2018.

I. Mado, A. Soeprijanto, and S. Suhartono, “Applying of Double Seasonal ARIMA Model for Electrical Power Demand Forecasting at PT. PLN Gresik Indonesia,” Int. J. Electr. Comput. Eng., vol. 8, no. 6, p. 4892, 2018.

A. Özdemir, U. Yavuz, and F. A. Dael, “Performance evaluation of different classification techniques using different datasets,” Int. J. Electr. Comput. Eng., vol. 9, no. 5, pp. 3584–3590, 2019.

Hyndman, R. J. & Athanasopoulos, G, "Forecasting: principles and practice,"[Online]. Available: OTexts.org/fpp/, 2019




DOI: http://doi.org/10.11591/ijece.v11i2.pp%25p
Total views : 0 times


Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

ISSN 2088-8708, e-ISSN 2722-2578