I’m trying to do a Sequence Classificator.
Different sentences will be classified to numbers 1 - 5
But using the same data, model, config, steps. When I try to do an eval I get different results.
something like 59%-74% accurancy difference
I tried to change the learning rate, adding exponential decay. regularization l1,l2 and increased the dropout on the encoder. nothing seems to make it work.
Anyone can have an idea why this so much difference if everything is the same always?