Batch Normalization / L2 regularization


(Vincent Nguyen) #1

Hello team,

Just wondering if you ever tested these techniques as an alternative to dropout.

Thanks.


(Guillaume Klein) #2

Hi,

There was a pull request implementing recurrent batch normalization normalization but it did not work at all.

Are you referring to a paper or another framework?


(Vincent Nguyen) #3

I see this: https://github.com/OpenNMT/OpenNMT/pull/101

so, nobody actually fixed it, right ?