relyer
August 3, 2022, 8:12am
1
In previosly posts you suggess to watch this 2 links for alignment features supported by OpenNMThttps://opennmt.net/OpenNMT-tf/alignments.html?highlight=align#alignments-and-transformer-models https://opennmt.net/OpenNMT-py/FAQ.html#supervised-learning-on-a-specific-head
if i’m right the pytorch have more complicated options for alignment, like -lambda_align, -alignment_layer, -alignment_heads, -full_context_alignment. But for tf just setup additional dataset block & thats all.
Can i manage alignment training in tf like in pt?
thx.
The implementations are based on different papers so the options are also different.
OpenNMT-tf implements the original guided alignment paper:
while OpenNMT-py implements a more recent paper:
The state of the art in machine translation (MT) is governed by neural
approaches, which typically provide superior translation accuracy over
statistical approaches. However, on the closely related task of word alignment,
traditional statistical word...
relyer
August 5, 2022, 7:26am
3
Thx for papers.
Is someone retrain unaligned model on data with alignment for get it alingned? Does it make sense …
I personally don’t understand your question.
Best regards,
relyer
August 9, 2022, 7:28am
5
I have model trained without alignment data. Can I retrain model with alignment data?, without training model from the begining.
thx.
I think it should work but I haven’t tested this myself.