Subtraction, the - operator, with a bool tensor is not supported.

[daiwei12]

pytorch-pretrained-bert 0.6.2
pytorch-transformers 1.1.0
torch 1.2.0

Traceback (most recent call last):
  File "/home/david/workspace/BERTSum/src/train.py", line 71, in run
    train(args, device_id)
  File "/home/david/workspace/BERTSum/src/train.py", line 264, in train
    trainer.train(train_iter_fct, args.train_steps)
  File "/home/david/workspace/BERTSum/src/models/trainer.py", line 142, in train
    for i, batch in enumerate(train_iter):
  File "/home/david/workspace/BERTSum/src/models/data_loader.py", line 131, in __iter__
    for batch in self.cur_iter:
  File "/home/david/workspace/BERTSum/src/models/data_loader.py", line 235, in __iter__
    batch = Batch(minibatch, self.device, self.is_test)
  File "/home/david/workspace/BERTSum/src/models/data_loader.py", line 31, in __init__
    mask = 1 - (src == 0)
  File "/home/david/software/anaconda3/envs/bert_sum/lib/python3.6/site-packages/torch/tensor.py", line 325, in __rsub__
    return _C._VariableFunctions.rsub(self, other)
RuntimeError: Subtraction, the `-` operator, with a bool tensor is not supported. If you are trying to invert a mask, use the `~` or `bitwise_not()` operator instead.

[astariul]

It comes from your PyTorch version.

nlpyang/PreSumm#2

Downgrade to 1.1.0

[Santosh-Gupta]

If you would like to fork your own version, there's three lines where you have to change '1-' to '~'

I made these changes to my own fork

https://github.com/Santosh-Gupta/BertSum/blob/master/src/models/encoder.py

https://github.com/Santosh-Gupta/BertSum/blob/master/src/models/data_loader.py

More details here

https://github.com/pytorch/pytorch/releases