It is already supported in OpenNMT-py. (http://opennmt.net/OpenNMT-py/FAQ.html#how-do-i-use-the-transformer-model)
is there special reason for that couldn’t use in lua version?
It would be too much work and the Lua Torch framework is no longer supported.
You have to pick either pytorch or tensorflow.
1 Like