Comparison between estimates of beta regression model using MSE
DOI:
https://doi.org/10.33095/p4nwgd31Keywords:
Beta Regression Model, Multicollinearity, Maximum Likelihood Estimation, Ridge Regression, Modified Liu, Ozkale and Kaciranlar Method, Simulation.Abstract
The multiple linear regression analysis shows the effects of explanatory variables on the dependent variable. Its function is to represent data to understand the shape and nature of the relationship between explanatory variables and the response variable. One of the main problems faced by linear regression is the nature of the data, as sometimes it does not follow a normal distribution. This has led to the emergence of different types of linear regression models such as the beta regression model, where the data of the dependent variable is less than one and confined within the period (0,1), and the data is relative and decimal. Non-traditional methods will be used to estimate beta regression parameters because some traditional methods do not provide suitable and accurate results when dealing with one of the main problems encountered in regression, which is multicollinearity. To address this issue, we used some methods include The Maximum Likelihood Estimation (MLE), ridge regression, modified Liu, and Ozkale and Kaciranlar method. Shrinking parameters are proposed for each method, and a comparison between the methods is conducted using the Mean Squared Error comparison criterion through a simulation experiment with two approaches, the simulation results showed that the ridge regression method is the best for the first and second methods of simulation.
Paper type Research Paper
Downloads
References
.Abdulah, E., Ahmed, A. and Aboulwahhab, B. (2019). “Comparison of Estimate Methods of Multiple Linear Regression Model Auto –correlated Error when the Error Distribution with General Logistic” Journal of Engineering and Applied Sciences, Vol.14, No.19, pp.7072-7076.
Abonazel, M.R., Algamal, Z., Awwad, F. and Taha, I.M. (2022). “A New Two-Parameter Estimator for Beta Regression Model: Method, Simulation, and Application” Frontiers in Applied Mathematics and Statistics, Vol.7, pp.780322.
Abonazel, M.R. and Taha, I.M. (2023) “Beta ridge regression estimators: simulation and application” Communications in Statistics-Simulation and Computation, Vol.52, No.9, pp.4280-4292.
Abonazel, M.R., Dawoud, I., Awwad, F.A. and Lukman, A.F. (2022). “Dawoud–Kibria estimator for beta regression model: simulation and application” Frontiers in Applied Mathematics and Statistics, Vol.8, p.775068.
Abonazel, M.R., Said, H.A., Tag-Eldin, E., Abdel-Rahman, S. and Khattab, I.G. (2023) “Using beta regression modeling in medical sciences: a comparative study” Commun. Math. Biol. Neurosci., pp.Article-ID.
Ahmed, A., Abdulah, E., Abdulwahhab, B. and Abed, N. (2020). “Solving Multicollinearity Problem of gross domestic product using ridge regression method” Periodicals of Engineering and Natural Sciences, Vol.8, No.2, pp.668-672.
Ahmed, A., Abdulah, E. and Abdulwahhab, B. (2020). “Estimating the Coefficient of Polynomial Regression Model when the Error Distributed Generalized Logistic with three Parameters” International Journal of Psychosocial Rehabilitation, Vol.24, No.8, pp.4487-4496.
Algamal, Z.Y. and Abonazel, M.R. (2021). “Developing a Liu-type estimator in beta regression model” Concurrency and Computation: Practice and Experience, Vol.34, No.5, pp.1-11.
Algamal, Z.Y., Abonazel, M.R. and Lukman, A.F. (2022) “Modified Jackknife Ridge Estimator for Beta Regression Model with Application to Chemical Data” International Journal of Mathematics, Statistics, and Computer Science, Vol.1, pp.15-24.
Arashi, M., Roozbeh, M., Hamzah, N.A. and Gasparini, M. (2021). “Ridge regression and its applications in genetic studies” Plos One, Vol.16, No.4, pp. e0245376.
Asar, Y. and Genc, A. (2016). “New shrinkage parameters for the Liu-type logistic estimators” Communications in Statistics - Simulation and Computation, Vol.45, No.3, pp.1094-1103.
Asar, Y. (2018). “Liu-type negative binomial regression: a comparison of recent estimators and applications” Trends and Perspectives in linear statistical inference, springer, pp.23-39, doi.org/10.1007/978-3-319-73241-1_2
Awwad, F.A., Dawoud, I. and Abonazel, M.R. (2022) “Development of robust Özkale–Kaçiranlar and Yang–Chang estimators for regression models in the presence of multicollinearity and outliers” Concurrency and Computation: Practice and Experience, Vol.34, No.6, p. e6779.
Cribari-Neto, F. and Vasconcellos, K.L.P. (2002). “Nearly unbiased maximum-likelihood estimation for the beta distribution” Journal of Statistical Computation and Simulation, Vol.72, No.2, pp.107-118.
Ferrari, S.L.P. and Cribari-Neto, F. (2004). “Beta Regression for Modelling Rates and Proportions” Journal of Applied statistics, Vol.31, No.7, pp.799-815.
Geissinger, E.A., Khoo, C., Richmond, I.C., Faulkner, S.J. and Schneider, D.C. (2022). “A casefor beta regression in the natural sciences” Ecosphere, Vol.13, No.2, pp. e3940
Hirmez, A.H. (1990). “Mathematical Statistics” University Press, Iraq.
Hoerl, A.E. and Kennard, R.W. (1970). “Ridge regression: biased estimation for non- orthogonal problems” Technometrics, Vol.42, No.1, pp.80-86.
Hussein, S.M. (2016) “compared the proposed method (AUGJRR) with biased methods to estimate the Generalized ridge regression of the existence of multicollinearity” Al-Rafidain University College for Sciences, No.37.
Hussein, S.M. (2019) “Comparison of Some Suggested Estimators Based on Differencing Technique in the Partial Linear Model Using Simulation” Baghdad Science Journal, Vol.16, No.4, pp.0918-0918.
Irshayyid, A. and Saleh, R. (2022). “Robust Estimates for One – parameter Exponential Regression Model” Journal of Economics and Administrative Sciences (JEAS), Vol.28, No.134, pp.147-159.
Kadhim, A.H. and Suslim, B.S. (2002). “The Advance Econometrics Theory and Application” University of Baghdad, Iraq.
Kareem, U. and Hashim, F. (2021). “Comparison of some methods for Estimating maxture of linear Regression models with Application” Journal of Economics and Administrative Sciences (JEAS), vol.27, No. 129, pp.171-184.
Khalaf G. and Shukur G. (2005). “Choosing ridge parameter for regression problems” Communications in Statistics - Theory and Methods, Vol.34, No.5, pp.1177-1182.
Kibria, B.M.G. and Banik, S. (2016). “Some ridge regression estimators and their performances” Journal of Modern Applied Statistical Methods, Vol.15, No.1, pp.206-238.
Kibria, B.M.G. (2003). “Performance of some new ridge regression estimators” Communications in Statistics - Simulation and Computation, Vol.32, No.2, pp.419-435.
Kurnaz. F.S. and Akay, K.U. (2015). “A new Liu-type estimator” Statistical Papers, Vol.56, No.2, pp.495-517.
Liu, k. (2004). “More on Liu-type estimator in linear regression” Communications in Statistics - Theory and Methods, Vol.33, No.11, pp.2723-2733.
Liu, K.A. (1993). “New class of biased estimate in linear regression” Communications in Statistics - Theory and Methods, Vol.22, No.2, pp.393-402.
Liu, K. (2003). “Using Liu-Type Estimator to Combat Collinearity” Communication in Statistics –Theory and Methods, Vol.32, No.5, pp.1009-1020.
Lukman, A.F., Ayinde, K., Binuomote, S. and Clement, O.A. (2019). “Modified ridge-type estimator to combat multicollinearity: application to chemical data” Journal of Chemometrics, Vol.33, No.5, pp. e3125.
Mohamed, M. and Ahmed, A. (2022). “Comparison of Some Methods for Estimating a Polynomial Regression Model using Simulation” Mathematical Statistician and Engineering Applications, Vol.71, No.4, pp.693-706.
Mohammad, M. and Ahmed, A. (2022). “Estimating parameters via L-Linear method for Second-order Regression of polynomial Model” Journal of Economics and Administrative Sciences (JEAS), Vol.28, No.134, pp.160-167.
Muniz, G. and Kibria, B.M.G. (2009). “On some ridge regression estimators: an empirical comparison” Communications in Statistics - Simulation and Computation, Vol.38, No.3, pp.621-630.
Omara, T. (2019). “Modifying Two-Parameter Ridge Liu Estimator Based on Ridge Estimation” Pakistan Journal of Statistics and Operation Research, Vol.15, No.4, pp.881-890.
Ospina, R., Cribari-Neto, F., Vasconcellons, K. (2006). “Improved point and interval estimator for a beta regression model” Computational Statistics and Data Analysis, Vol.51, No.2, pp.960-981.
Ozkale, M.R. and Kaciranlar, S. (2007). “The restricted and unrestricted Two – Parameter estimators” Commun Stat Method, Vol.36, No.15, pp.2707-2725.
Qasim, M., Mansson, k. and Kibria, B.M. (2021). “On Same Beta Regression estimators: method, simulation and application” Journal of Statistical Computation and simulation, Vol.91, No.9, pp.1699-1712.
Radam, S. and Hameed, L. (2023). “comparison of poisson Regression and Conway Maxwell poisson models using simulation” Journal of Economics and Administrative Sciences (JEAS), Vol.29, No.136, pp.81-89.
Rao, C., Toutenburg, H., Shalabh and Heumann C. (2008). “Linear models and generalizations” Springer, Berlin.
Sabri, H.M. (2013). “A comparison of parameters estimation methods for the poisson regression model under existing of multicollinearty problem with application” PhD thesis, College Administration and Economics at the University of Baghdad, Iraq.
Sadullah, S. and Selahattin, K. (2008). “A new biased estimator based on ridge estimation” Statistical papers, Vol.49, No.4, pp.669-689.
Simas, A.B., Barreto-Souza, W. and Rocha, A.V. (2010). “Improved estimators for general class of beta regression models” Computational Statistics and Data Analysis, Vol.54, No.2, pp.348-366.
Smithson, M. and Verkuilen, J. (2006). “A better lemon squeezer? Maximum-likelihood regression with beta-distributed dependent variables” Psychol Methods, Vol.11, No.1, pp.54-71.
James, W. and Stein, C. (1961). “Estimation with Quadratic Loss” Fourth Berkeley Symposium on Mathematical Statistics and Probability, Vol.4, No.1, pp.361-379.
Swindel, B. (1976). “Good ridge estimators based on prior information” Communications in Statistics-Theory and Methods, Vol.5, No.11, pp.1065-1075.
Thompson, J.R. (2003). “Simulation: A Modeler’s Approach” IIE Transactions, Vol.35, No.3, pp.325-328.
Yalian, L. and Yang, H. (2012). “Anew Liu- type estimator in linear regression model” Statistical Papers, Vol.51, No.2, pp.1-11.
Yasin, A.S.A.R. (2023) “Performance of A New Bias Corrected Estimator in Beta Regression Model: A Monte Carlo Study” Necmettin Erbakan Üniversitesi Fen ve Mühendislik Bilimleri Dergisi, Vol.5 No.2, pp.38-49.
Yang, H. and Chang, X. (2010). “A new two-parameter estimator in linear regression” Communications in Statistics-Theory and Methods, Vol.39, No.6, pp.923-934.
Yousif, H.M. and Hussein, S.M. (2015) “A comparison among some biased estimators in generalized linear regression model in present of multicollinearity” AL-Qadisiyah Journal for Administrative and Economic sciences, Vol.17, No.2.
Published
Issue
Section
License
Copyright (c) 2024 Journal of Economics and Administrative Sciences
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Articles submitted to the journal should not have been published before in their current or substantially similar form or be under consideration for publication with another journal. Please see JEAS originality guidelines for details. Use this in conjunction with the points below about references, before submission i.e. always attribute clearly using either indented text or quote marks as well as making use of the preferred Harvard style of formatting. Authors submitting articles for publication warrant that the work is not an infringement of any existing copyright and will indemnify the publisher against any breach of such warranty. For ease of dissemination and to ensure proper policing of use, papers and contributions become the legal copyright of the publisher unless otherwise agreed.
The editor may make use of Turnitin software for checking the originality of submissions received.
How to Cite
