Hello, I am new with OpenNMT and would need some help here.
I want to build a sequence classification model. For that, I already have a pre-trained openNMT.py Bert model for sequence to sequence translation. What I would like to know is:
- How can I to remove its last layer and add a classification head
- Re-train the modified model with my data.
- How to get the output embeddings from a specific layer? This way I will be able to build the classification using another framework
Is it a task that can be done using OpenNMT? How can I do it?
In case it cannot be done, how can I convert the model to huggingface format?
Thanks in advance!