difference partial dependence and feature weights

Question

Assume we train a linear model to predict a numeric outcome.
A feature's model weight would essentially quantify me how much the outcome variable increases for each increase in the predictor's value.
I very recently stumbled upon partial dependence. If I understand it correctly, the partial dependence of a variable quantifies the influence of this variable on the dependent variable with all other variable marginalized out, i.e. all other things constant.
Am I right in thinking that partial dependence of an independent variable measures something very similar to a feature weight?

Michael M · Answer

For the special case of an additive linear model this is true.
However, partial dependence profiles can also be used with more complex model structures such as boosted trees or linear models with complex interactions. Their usefulness is sometimes diminished by the ceteris paribus principle as you have pointed out correctly.

difference partial dependence and feature weights

One Answer

Add your own answers!

Ask a Question