TransWikia.com

Keras lstm equations, matrices and diagram

Data Science Asked by Caeta on January 4, 2021

I was reading this post, mainly the LSTM equation section for understand the structure diagram and relate it with the matrices and I can deducted this cell diagram:

enter image description here

I made this homemade diagram because in the Colah’s article it’s not the exactly same cell that in keras.

I need know if it ok, can someone confirm me that? This are the equations

enter image description here

W are weights matrices for input data and U are weights matrices for previous hidden state

b are biases

In the pink circles there are operations. The point it’s multiply element by element and X is matrix multiplication

Add your own answers!

Ask a Question

Get help from others!

© 2024 TransWikia.com. All rights reserved. Sites we Love: PCI Database, UKBizDB, Menu Kuliner, Sharing RPP