Hiroki Naganuma

2017 Automne Q4

1.

Backpropを全部記述せよ

• Answer
• Memo
• 誤差逆伝播法復習
• DL本 RNN パートスライド
• tanhの積分

2.

Lossをl, f, g で書き換える

• Answer
• Memo2

3.

• Answer

線形で簡単に考える場合

ヤコビアンで考える

4.

Taking advantage of the above, rewrite the gradient in a form that highlights the exponentially decaying or exploding effects known as gradient vanishing and gradient explosion. What condition on the eigenvalues of per-time step Jacobians is guaranteed to give rise to gradient vanishing?

• Answer