Kizspy | Question: 22
(Choose 1 answer)
Here are the equations for the GRU and the LSTM:
GRU
LSTM
\tilde{c}^{<t>}=tanh(W_{c}[\Gamma_{r}*c^{<t-1>},x^{<t>}]+b_{c}) \Gamma_{u}=\sigma(W_{u}[c^{<t-1>},x^{<t>}]+b_{u}). \Gamma_{r}=\sigma(W_{r}[c^{<t-1>},x^{<t>}]+b_{r}) c^{<t>}=\Gamma_{u}*\tilde{c}^{<t>}+(1-\Gamma_{u})*c^{<t-1>} a^{<t>}=c^{<t>}
\tilde{c}^{<t>}=tanh(W_{c}[a^{<t-1>},x^{<t>}]+b_{c}) \Gamma_{u}=\sigma(W_{u}[a^{<t-1>},x^{<t>}]+b_{u}) \Gamma_{f}=\sigma(W_{f}[a^{<t-1>},x^{<t>}]+b_{f}) \Gamma_{o}=\sigma(W_{o}[a^{<t-1>},x^{<t>}]+b_{o}) c^{<t>}=\Gamma_{u}*\tilde{c}^{<t>}+\Gamma_{f}*c^{<t-1>} a^{<t>}=\Gamma_{o}*c^{<t>}
From these, we can see that the Update Gate and Forget Gate in the LSTM play a role similar to and in the GRU. What should go in the the blanks?
a.\Gamma_{u} and 1-\Gamma_{u}
b. \Gamma_{u} and \Gamma_{j}
c. -\Gamma_{u} and \Gamma_{u}
d. \Gamma_{y} and \Gamma_{u}
A. A
B. B
C. C
D. D
FUOVER
