TransWikia.com

Is it necessary to standardise the expected output

Artificial Intelligence Asked on December 7, 2021

Normalisation transform data into a range:
$$X_i = dfrac{X_i – Min}{Max-Min}$$

Practically, I found out that the model doesn’t generalise well when using normalisation of input data, instead of standardisation (another formula shown below).

Before training a neural net, data are usually standardised or normalised. Standardising seems good as it makes the model generalise better, while normalisation may make the model not working with values out of training data range.

So I’m using standardisation for input data (X), however, I’m confusing whether I should standardise the expected output values too?

For a column in input data:
$$X_i = dfrac{(X_i – Mean)}{Standard Deviation of the Column}$$

Should I apply this formula to the expected output values (labels) too?

One Answer

It depends, as mentioned in comments, on your model and labels. For example how would you use standardisation on multi classification problem?

Generally, standardisation is more flavourable for input data as its mean is around 0.

I assume you have a regression model and in that case using standardisation could be better than normalisation.

Answered by pedrum on December 7, 2021

Add your own answers!

Ask a Question

Get help from others!

© 2024 TransWikia.com. All rights reserved. Sites we Love: PCI Database, UKBizDB, Menu Kuliner, Sharing RPP