Skip to content

OpenNMT-tf 1.21.0
Compare
Choose a tag to compare
@guillaumekln guillaumekln released this 01 Mar 16:37
· 1016 commits to master since this release
v1.21.0
2fbbc9c

OpenNMT-tf 1.21.0

New features

  • New experimental model type LanguageModel to train generative language models (see the example GPT-2 configuration). The usage is the same as a sequence to sequence model except that "labels" data should not be set.
  • cosine_annealing learning rate decay
  • weight_decay parameter to apply decoupled weight decay regularization (as described in Loshchilov et al. 2017)
  • sampling_temperature parameter to control the randomness of the generation

Fixes and improvements

  • Improve correctness of MeanEncoder for variable lengths inputs (requires TensorFlow 1.13+)
  • Internal refactoring and changes to prepare for 2.0 transition
Assets 2
Loading