Elastic Net Principal Component Regression With an Application
DOI:
https://doi.org/10.62951/ijsme.v1i3.25Keywords:
Regularization Method, Elastic Net Technique, Principal Component Regression, Simulation ScenarioAbstract
To overcome the difficulties of high-dimensional data, Elastic Net Principal Component Regression (ENPCR), a potent statistical technique, combines Elastic Net regularization with Principal Component regression (PCR). When dealing with Multicollinearity among predictors, this method is especially helpful because it enables efficient variable selection while preserving interpretability. PCA is initially used in ENPCR to reduce the dataset's dimensionality by converting correlated variables into a group of uncorrelated principal components. The Elastic Net regression model then uses these elements as inputs and penalizes the regression coefficients using both L1 and L2 penalties. By promoting sparsity, this dual regularization lessens overfitting and helps the model concentrate on its most important components. simulated studies and Real datasets are used to demonstrate the our proposed method .
References
AL-Sharoot, M. H., Kazem, W. A. A. H., & Al-Fatlawi, S. A. (2023). Bayesian lasso principal component regression with an application. Journal of Al-Qadisiyah for Computer Science and Mathematics, 15(4), 32-38.
Bühlmann, P., & van de Geer, S. (2011). Statistics for high-dimensional data: Methods, theory and applications. Springer.
Fan, J., & Lv, J. (2008). Sure independence screening for ultrahigh dimensional feature space. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 70(5), 849-911.
Gelman, A., & Hill, J. (2007). Data analysis using regression and multilevel/hierarchical models. Cambridge University Press.
Hair, J. F., Anderson, R. E., Tatham, R. L., & Black, W. C. (1998). Multivariate data analysis (5th ed.). Prentice Hall.
Hastie, T., Tibshirani, R., & Friedman, J. (2009). The elements of statistical learning: Data mining, inference, and prediction (2nd ed.). Springer.
Jolliffe, I. T. (2002). Principal component regression (2nd ed.). Springer.
Lee, H., Park, Y. M., & Lee, S. (2015). Principal component regression by principal component selection. Communications for Statistical Applications and Methods, 22(2), 173-180.
Massy, W. F. (1965). Principal components regression in exploratory statistical research. Journal of the American Statistical Association, 60(309), 234-256.
Montgomery, D. C., Peck, E. A., & Vining, G. G. (2012). Introduction to linear regression analysis (5th ed.). Wiley.
O'Brien, R. G. (2007). A caution regarding rules of thumb for variance inflation factors. Quality and Quantity, 41(5), 673-690.
Perez, L. V. (2017). Principal component analysis to address multicollinearity. Whitman College: Walla Walla, WA, USA, 99362.
Wehrens, R., & Mevik, B. H. (2007). The pls package: Principal component and partial least squares regression in R.
Zou, H., & Hastie, T. (2005). Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 67(2), 301-320.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 International Journal of Science and Mathematics Education

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.