Bayesian Elastic Net Regression

behzadiravani · April 16, 2024, 4:08pm

Dear Community,

I would like to use a Bayesian regression but something similar to the Elastic Net with l1 and l2 regularizations. Upon some research it seems changing prior to Gauss and Laplace distribution has similar effect to l1 and l2 regularization. I love to hear your thoughts on this matter.

Best
Behzad

jessegrabowski · April 16, 2024, 7:21pm

Your research is pretty much right, did you have a specific question about implementation? Basically the standard deviation on the prior is going to control the degree of regularization (like the alpha or C hyperparameter in penalized regressions)

Topic		Replies	Views
L1 and L2 pegularization for an Autoregressive model Questions	4	1014	January 1, 2020
(Inverse?) Linear Regression - predicting the indepednent variable via two applications of Bayes rule Questions	0	310	June 23, 2022
Setting up a multiple input multiple output regularized Bayesian regression Questions	5	558	February 17, 2022
TwoFer: Prior Predictive Checks - An Applied Question & a Conceptual Question	0	399	August 12, 2021
Regularization/Survival: should I? Questions	6	756	October 27, 2017

Bayesian Elastic Net Regression

Related Topics