11 min listen
[MINI] Long Short Term Memory
FromData Skeptic
ratings:
Length:
15 minutes
Released:
Sep 8, 2017
Format:
Podcast episode
Description
Thanks to our sponsor brilliant.org/dataskeptics A Long Short Term Memory (LSTM) is a neural unit, often used in Recurrent Neural Network (RNN) which attempts to provide the network the capacity to store information for longer periods of time. An LSTM unit remembers values for either long or short time periods. The key to this ability is that it uses no activation function within its recurrent components. Thus, the stored value is not iteratively modified and the gradient does not tend to vanish when trained with backpropagation through time.
Released:
Sep 8, 2017
Format:
Podcast episode
Titles in the series (100)
[MINI] Bayesian Updating: In this minisode, we discuss Bayesian Updating - the process by which one can calculate the most likely hypothesis might be true given one's older / prior belief and all new evidence. by Data Skeptic