Dear fantastic support !
I would like to implement a scheduled dropout.
Ideally here is what I would like:
If we train during N epochs of n minibatch of sentences, which means N x n minibatches,
I would like to be able to start training with a dropout schedule as follow:
(examples but we may generalize with variable value for %)
between 0% and 25% of minibatches, dropout linearly change from a value a(0%) to a(25%)
between 25% and 50% of minibatches, dropout linearly change from a(25%) to a(50%)
again between 50 and 75, then 75% to 100%.
-dropout-schedule could kind of a string with such a schedule.
I hope this request is clear enough.