untrained model gives this results: 2019-08-06 11:43:03,161 - INFO - allennlp.commands.evaluate - Metrics: 2019-08-06 11:43:03,161 - INFO - allennlp.commands.evaluate - accuracy: 0.746 2019-08-06 11:43:03,161 - INFO - allennlp.commands.evaluate - accuracy3: 0.9442 2019-08-06 11:43:03,161 - INFO - allennlp.commands.evaluate - loss: 1.5099316606521607

Training process decrease results.