TransWikia.com

LSTM / GRU weights during test time

Data Science Asked by Yuval Asher on February 10, 2021

I am working on a historic time series dataset and using RNN, LSTM, GRU models, and I didn’t find an answer if in test time, the h (or h, c) weights should be zeors for each batch?

If the weights should be zero, what they should be? the last updated weights from the training?

Thanks

One Answer

The initial weights of h for GRU and h,c for LSTM are are often set to zeros, setting random weights is also an option. Also people have tried to learn the initial hidden states.

Since the hidden states are updated with every cell, if your sequences are long enough, it would not make a big difference how you initialize the hidden states.

Answered by Akavall on February 10, 2021

Add your own answers!

Ask a Question

Get help from others!

© 2024 TransWikia.com. All rights reserved. Sites we Love: PCI Database, UKBizDB, Menu Kuliner, Sharing RPP