Recurrent Neural Networks: building GRU cells VS LSTM cells in Pytorch
What are the advantages of RNN’s over transformers? When to use GRU’s over LSTM? What are the equations of GRU really mean? How to build a GRU cell in Pytorch?
Are you interested to see how recurrent networks process sequences under the hood? That’s what this article is all about. We are going to inspect and build our own custom LSTM model. Moreover, we make some comparisons between recurrent and convolutional modules, to maximize our understanding.