TransWikia.com

Binomial logistic regression for multiclass problems

Cross Validated Asked by Mathews24 on January 27, 2021

Applying the independence of irrelevant alternatives (IIA) is an inherent assumption in multinomial logistic regression but not binomial. Is it therefore okay and possibly better to use $K$ binomial logistic regression models instead of multinomial logistic regression when handing a multiclass classification problem with $K$ classes? Is this approach typically employed or not for any reasons in any scenarios (e.g. predicting elections)?

The primary concern I can think of is interpretation of probabilities. The $K$ binomial logistic regression models would allow one to understand the relative probabilities of class $A$ versus not class $A$, but would not have easy comparison of the probability of class $A$ versus class $B$. To compare the probabilities, some kind of alternative method (e.g. apply softmax function) would have to be employed, but perhaps this is just as misguided as the IIA assumption.

One Answer

I'm not 100% sure of this but I think that would you suggest is correct, finding the probability between classes would be difficult. I don't understand the softmax function you suggested since logistic regression is binary. You're exaggerating binary outputs.

To my knowledge (which isn't much because multinomial logistic regression was never touched on in my studies), how Multinomial LR works is already how you are describing your multi class logistic regression works.

Answered by James S. on January 27, 2021

Add your own answers!

Ask a Question

Get help from others!

© 2024 TransWikia.com. All rights reserved. Sites we Love: PCI Database, UKBizDB, Menu Kuliner, Sharing RPP