Batch Normalization / L2 regularization

(Vincent Nguyen) #1

Hello team,

Just wondering if you ever tested these techniques as an alternative to dropout.


(Guillaume Klein) #2


There was a pull request implementing recurrent batch normalization normalization but it did not work at all.

Are you referring to a paper or another framework?

(Vincent Nguyen) #3

I see this:

so, nobody actually fixed it, right ?