DiaParser destroys Icelandic tokenizer

[KoichiYasuoka]

I've tried to install DiaParser via pip install diaparser, and it destroyed Icelandic tokenizer. I'm vague why they conflicted in installing...

[attardi]

Sorry about that.
pip installs the diaparser dependencies, which are:

torch >= 1.6
transformers >= 2.10.0
stanza >= 1.1.1
pytest >= 5.4.1
nltk >= 3.5

During installation pip should have shown the packages that it needed to upgrade.
If you share that output, we can figure out the culprit.

[KoichiYasuoka]

OK, first we install Icelandic Tokenizer with the dependencies above:

$ pip3 install -U torch transformers stanza pytest nltk tokenizer

Then we can use tokenize as Icelandic Tokenizer:

$ echo "3.janúar sl. keypti   ég 64kWst rafbíl. Hann kostaði € 30.000." | tokenize
3. janúar sl. keypti ég 64kWst rafbíl .
Hann kostaði €30.000 . 

Second we install DiaParser additionally:

$ pip3 install -U diaparser

After that, Icelandic Tokenizer is destroyed:

$ echo "3.janúar sl. keypti   ég 64kWst rafbíl. Hann kostaði € 30.000." | tokenize
Traceback (most recent call last):
  File "/home/yasuoka/.local/bin/tokenize", line 5, in <module>
    from tokenizer.main import main
  File "/home/yasuoka/.local/lib/python3.7/site-packages/tokenizer/main.py", line 49, in <module>
    from .tokenizer import TOK, tokenize
ImportError: cannot import name 'TOK' from 'tokenizer.tokenizer' (/home/yasuoka/.local/lib/python3.7/site-packages/tokenizer/tokenizer.py) 

DiaParser seems to have destroyed ~/.local/lib/python3.7/site-packages/tokenizer but why?

[attardi]

If you reinstall tokenizer it works again.

> sudo -H pip install --force-reinstall tokenizer -U
Collecting tokenizer
  Using cached tokenizer-2.4.0-py2.py3-none-any.whl (105 kB)
Installing collected packages: tokenizer
  Attempting uninstall: tokenizer
    Found existing installation: tokenizer 2.4.0
    Uninstalling tokenizer-2.4.0:
      Successfully uninstalled tokenizer-2.4.0
Successfully installed tokenizer-2.4.0

> echo "3.janúar sl. keypti   ég 64kWst rafbíl. Hann kostaði € 30.000." | tokenize
3. janúar sl. keypti ég 64kWst rafbíl .
Hann kostaði €30.000 .

diaparser does not install itself the tokenizer package: it seems to be installed by transformers

Requirement already satisfied: tokenizers==0.9.4 in /usr/lib/python3.8/site-packages (from transformers->diaparser) (0.9.4)

which requires version 0.9.4 instead of the latest.
Version 0.9.4 seem to be flawed, synth it is missing the file tokenizer.py. from which it tries to import:

from .tokenizer import TOK, tokenize
ModuleNotFoundError: No module named 'tokenizer.tokenizer'

[KoichiYasuoka]

diaparser does not install itself the tokenizer package: it seems to be installed by transformers

Umm...

$ cat ~/.local/lib/python3.7/site-packages/transformers-3.4.0.dist-info/RECORD
../../../bin/transformers-cli,sha256=prHvo-MZ2MpvodwV_KKmBtI7NyypzcjYZXPQLiM6B24,237
transformers-3.4.0.dist-info/INSTALLER,sha256=zuuue4knoyJ-UwPPXg8fezS7VCrXJQrAP7zeNuwvFQg,4
transformers-3.4.0.dist-info/LICENSE,sha256=z8d0m5b2O9McPEK1xHG_dWgUBT6EfBDz6wA0F7xSPTA,11358
transformers-3.4.0.dist-info/METADATA,sha256=s3UcJeFPdVwVLmqxJsYPyYs1KDlufifJPjW4UJPkpLs,31596
transformers-3.4.0.dist-info/RECORD,,
transformers-3.4.0.dist-info/REQUESTED,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
transformers-3.4.0.dist-info/WHEEL,sha256=g4nMs7d-Xl9-xC9XovUrsDHGXt-FT0E17Yqo92DEfvY,92
transformers-3.4.0.dist-info/entry_points.txt,sha256=NC_VjQxHu59c5WStu_7imUSlBjuk86IvLxhEtlrO-2k,82
transformers-3.4.0.dist-info/top_level.txt,sha256=GLBaeTo_CSdhnHvbxQ0kzpEHdlLuA_33foIogaWxntI,13
transformers/__init__.py,sha256=zk-XZ5wfkSVyrph6iNE0Hms4Vt1Es--4JUC00adOGjM,30900
transformers/__pycache__/__init__.cpython-37.pyc,,
transformers/__pycache__/activations.cpython-37.pyc,,
transformers/__pycache__/activations_tf.cpython-37.pyc,,
transformers/__pycache__/configuration_albert.cpython-37.pyc,,
transformers/__pycache__/configuration_auto.cpython-37.pyc,,
transformers/__pycache__/configuration_bart.cpython-37.pyc,,
transformers/__pycache__/configuration_bert.cpython-37.pyc,,
transformers/__pycache__/configuration_bert_generation.cpython-37.pyc,,
transformers/__pycache__/configuration_blenderbot.cpython-37.pyc,,
transformers/__pycache__/configuration_camembert.cpython-37.pyc,,
transformers/__pycache__/configuration_ctrl.cpython-37.pyc,,
transformers/__pycache__/configuration_deberta.cpython-37.pyc,,
transformers/__pycache__/configuration_distilbert.cpython-37.pyc,,
transformers/__pycache__/configuration_dpr.cpython-37.pyc,,
transformers/__pycache__/configuration_electra.cpython-37.pyc,,
transformers/__pycache__/configuration_encoder_decoder.cpython-37.pyc,,
transformers/__pycache__/configuration_flaubert.cpython-37.pyc,,
transformers/__pycache__/configuration_fsmt.cpython-37.pyc,,
transformers/__pycache__/configuration_funnel.cpython-37.pyc,,
transformers/__pycache__/configuration_gpt2.cpython-37.pyc,,
transformers/__pycache__/configuration_layoutlm.cpython-37.pyc,,
transformers/__pycache__/configuration_longformer.cpython-37.pyc,,
transformers/__pycache__/configuration_lxmert.cpython-37.pyc,,
transformers/__pycache__/configuration_marian.cpython-37.pyc,,
transformers/__pycache__/configuration_mbart.cpython-37.pyc,,
transformers/__pycache__/configuration_mmbt.cpython-37.pyc,,
transformers/__pycache__/configuration_mobilebert.cpython-37.pyc,,
transformers/__pycache__/configuration_openai.cpython-37.pyc,,
transformers/__pycache__/configuration_pegasus.cpython-37.pyc,,
transformers/__pycache__/configuration_prophetnet.cpython-37.pyc,,
transformers/__pycache__/configuration_rag.cpython-37.pyc,,
transformers/__pycache__/configuration_reformer.cpython-37.pyc,,
transformers/__pycache__/configuration_retribert.cpython-37.pyc,,
transformers/__pycache__/configuration_roberta.cpython-37.pyc,,
transformers/__pycache__/configuration_squeezebert.cpython-37.pyc,,
transformers/__pycache__/configuration_t5.cpython-37.pyc,,
transformers/__pycache__/configuration_transfo_xl.cpython-37.pyc,,
transformers/__pycache__/configuration_utils.cpython-37.pyc,,
transformers/__pycache__/configuration_xlm.cpython-37.pyc,,
transformers/__pycache__/configuration_xlm_prophetnet.cpython-37.pyc,,
transformers/__pycache__/configuration_xlm_roberta.cpython-37.pyc,,
transformers/__pycache__/configuration_xlnet.cpython-37.pyc,,
transformers/__pycache__/convert_albert_original_tf_checkpoint_to_pytorch.cpython-37.pyc,,
transformers/__pycache__/convert_bart_original_pytorch_checkpoint_to_pytorch.cpython-37.pyc,,
transformers/__pycache__/convert_bert_original_tf2_checkpoint_to_pytorch.cpython-37.pyc,,
transformers/__pycache__/convert_bert_original_tf_checkpoint_to_pytorch.cpython-37.pyc,,
transformers/__pycache__/convert_bert_pytorch_checkpoint_to_original_tf.cpython-37.pyc,,
transformers/__pycache__/convert_blenderbot_original_pytorch_checkpoint_to_pytorch.cpython-37.pyc,,
transformers/__pycache__/convert_dialogpt_original_pytorch_checkpoint_to_pytorch.cpython-37.pyc,,
transformers/__pycache__/convert_dpr_original_checkpoint_to_pytorch.cpython-37.pyc,,
transformers/__pycache__/convert_electra_original_tf_checkpoint_to_pytorch.cpython-37.pyc,,
transformers/__pycache__/convert_fsmt_original_pytorch_checkpoint_to_pytorch.cpython-37.pyc,,
transformers/__pycache__/convert_funnel_original_tf_checkpoint_to_pytorch.cpython-37.pyc,,
transformers/__pycache__/convert_gpt2_original_tf_checkpoint_to_pytorch.cpython-37.pyc,,
transformers/__pycache__/convert_graph_to_onnx.cpython-37.pyc,,
transformers/__pycache__/convert_longformer_original_pytorch_lightning_to_pytorch.cpython-37.pyc,,
transformers/__pycache__/convert_lxmert_original_tf_checkpoint_to_pytorch.cpython-37.pyc,,
transformers/__pycache__/convert_marian_tatoeba_to_pytorch.cpython-37.pyc,,
transformers/__pycache__/convert_marian_to_pytorch.cpython-37.pyc,,
transformers/__pycache__/convert_mbart_original_checkpoint_to_pytorch.cpython-37.pyc,,
transformers/__pycache__/convert_mobilebert_original_tf_checkpoint_to_pytorch.cpython-37.pyc,,
transformers/__pycache__/convert_openai_original_tf_checkpoint_to_pytorch.cpython-37.pyc,,
transformers/__pycache__/convert_pegasus_tf_to_pytorch.cpython-37.pyc,,
transformers/__pycache__/convert_prophetnet_original_pytorch_checkpoint_to_pytorch.cpython-37.pyc,,
transformers/__pycache__/convert_pytorch_checkpoint_to_tf2.cpython-37.pyc,,
transformers/__pycache__/convert_reformer_trax_checkpoint_to_pytorch.cpython-37.pyc,,
transformers/__pycache__/convert_roberta_original_pytorch_checkpoint_to_pytorch.cpython-37.pyc,,
transformers/__pycache__/convert_slow_tokenizer.cpython-37.pyc,,
transformers/__pycache__/convert_slow_tokenizers_checkpoints_to_fast.cpython-37.pyc,,
transformers/__pycache__/convert_t5_original_tf_checkpoint_to_pytorch.cpython-37.pyc,,
transformers/__pycache__/convert_tf_hub_seq_to_seq_bert_to_pytorch.cpython-37.pyc,,
transformers/__pycache__/convert_transfo_xl_original_tf_checkpoint_to_pytorch.cpython-37.pyc,,
transformers/__pycache__/convert_xlm_original_pytorch_checkpoint_to_pytorch.cpython-37.pyc,,
transformers/__pycache__/convert_xlnet_original_tf_checkpoint_to_pytorch.cpython-37.pyc,,
transformers/__pycache__/file_utils.cpython-37.pyc,,
transformers/__pycache__/generation_tf_utils.cpython-37.pyc,,
transformers/__pycache__/generation_utils.cpython-37.pyc,,
transformers/__pycache__/hf_api.cpython-37.pyc,,
transformers/__pycache__/hf_argparser.cpython-37.pyc,,
transformers/__pycache__/integrations.cpython-37.pyc,,
transformers/__pycache__/modelcard.cpython-37.pyc,,
transformers/__pycache__/modeling_albert.cpython-37.pyc,,
transformers/__pycache__/modeling_auto.cpython-37.pyc,,
transformers/__pycache__/modeling_bart.cpython-37.pyc,,
transformers/__pycache__/modeling_bert.cpython-37.pyc,,
transformers/__pycache__/modeling_bert_generation.cpython-37.pyc,,
transformers/__pycache__/modeling_blenderbot.cpython-37.pyc,,
transformers/__pycache__/modeling_camembert.cpython-37.pyc,,
transformers/__pycache__/modeling_ctrl.cpython-37.pyc,,
transformers/__pycache__/modeling_deberta.cpython-37.pyc,,
transformers/__pycache__/modeling_distilbert.cpython-37.pyc,,
transformers/__pycache__/modeling_dpr.cpython-37.pyc,,
transformers/__pycache__/modeling_electra.cpython-37.pyc,,
transformers/__pycache__/modeling_encoder_decoder.cpython-37.pyc,,
transformers/__pycache__/modeling_flaubert.cpython-37.pyc,,
transformers/__pycache__/modeling_flax_auto.cpython-37.pyc,,
transformers/__pycache__/modeling_flax_bert.cpython-37.pyc,,
transformers/__pycache__/modeling_flax_roberta.cpython-37.pyc,,
transformers/__pycache__/modeling_flax_utils.cpython-37.pyc,,
transformers/__pycache__/modeling_fsmt.cpython-37.pyc,,
transformers/__pycache__/modeling_funnel.cpython-37.pyc,,
transformers/__pycache__/modeling_gpt2.cpython-37.pyc,,
transformers/__pycache__/modeling_layoutlm.cpython-37.pyc,,
transformers/__pycache__/modeling_longformer.cpython-37.pyc,,
transformers/__pycache__/modeling_lxmert.cpython-37.pyc,,
transformers/__pycache__/modeling_marian.cpython-37.pyc,,
transformers/__pycache__/modeling_mbart.cpython-37.pyc,,
transformers/__pycache__/modeling_mmbt.cpython-37.pyc,,
transformers/__pycache__/modeling_mobilebert.cpython-37.pyc,,
transformers/__pycache__/modeling_openai.cpython-37.pyc,,
transformers/__pycache__/modeling_outputs.cpython-37.pyc,,
transformers/__pycache__/modeling_pegasus.cpython-37.pyc,,
transformers/__pycache__/modeling_prophetnet.cpython-37.pyc,,
transformers/__pycache__/modeling_rag.cpython-37.pyc,,
transformers/__pycache__/modeling_reformer.cpython-37.pyc,,
transformers/__pycache__/modeling_retribert.cpython-37.pyc,,
transformers/__pycache__/modeling_roberta.cpython-37.pyc,,
transformers/__pycache__/modeling_squeezebert.cpython-37.pyc,,
transformers/__pycache__/modeling_t5.cpython-37.pyc,,
transformers/__pycache__/modeling_tf_albert.cpython-37.pyc,,
transformers/__pycache__/modeling_tf_auto.cpython-37.pyc,,
transformers/__pycache__/modeling_tf_bert.cpython-37.pyc,,
transformers/__pycache__/modeling_tf_camembert.cpython-37.pyc,,
transformers/__pycache__/modeling_tf_ctrl.cpython-37.pyc,,
transformers/__pycache__/modeling_tf_distilbert.cpython-37.pyc,,
transformers/__pycache__/modeling_tf_electra.cpython-37.pyc,,
transformers/__pycache__/modeling_tf_flaubert.cpython-37.pyc,,
transformers/__pycache__/modeling_tf_funnel.cpython-37.pyc,,
transformers/__pycache__/modeling_tf_gpt2.cpython-37.pyc,,
transformers/__pycache__/modeling_tf_longformer.cpython-37.pyc,,
transformers/__pycache__/modeling_tf_lxmert.cpython-37.pyc,,
transformers/__pycache__/modeling_tf_mobilebert.cpython-37.pyc,,
transformers/__pycache__/modeling_tf_openai.cpython-37.pyc,,
transformers/__pycache__/modeling_tf_outputs.cpython-37.pyc,,
transformers/__pycache__/modeling_tf_pytorch_utils.cpython-37.pyc,,
transformers/__pycache__/modeling_tf_roberta.cpython-37.pyc,,
transformers/__pycache__/modeling_tf_t5.cpython-37.pyc,,
transformers/__pycache__/modeling_tf_transfo_xl.cpython-37.pyc,,
transformers/__pycache__/modeling_tf_transfo_xl_utilities.cpython-37.pyc,,
transformers/__pycache__/modeling_tf_utils.cpython-37.pyc,,
transformers/__pycache__/modeling_tf_xlm.cpython-37.pyc,,
transformers/__pycache__/modeling_tf_xlm_roberta.cpython-37.pyc,,
transformers/__pycache__/modeling_tf_xlnet.cpython-37.pyc,,
transformers/__pycache__/modeling_transfo_xl.cpython-37.pyc,,
transformers/__pycache__/modeling_transfo_xl_utilities.cpython-37.pyc,,
transformers/__pycache__/modeling_utils.cpython-37.pyc,,
transformers/__pycache__/modeling_xlm.cpython-37.pyc,,
transformers/__pycache__/modeling_xlm_prophetnet.cpython-37.pyc,,
transformers/__pycache__/modeling_xlm_roberta.cpython-37.pyc,,
transformers/__pycache__/modeling_xlnet.cpython-37.pyc,,
transformers/__pycache__/optimization.cpython-37.pyc,,
transformers/__pycache__/optimization_tf.cpython-37.pyc,,
transformers/__pycache__/pipelines.cpython-37.pyc,,
transformers/__pycache__/retrieval_rag.cpython-37.pyc,,
transformers/__pycache__/testing_utils.cpython-37.pyc,,
transformers/__pycache__/tokenization_albert.cpython-37.pyc,,
transformers/__pycache__/tokenization_albert_fast.cpython-37.pyc,,
transformers/__pycache__/tokenization_auto.cpython-37.pyc,,
transformers/__pycache__/tokenization_bart.cpython-37.pyc,,
transformers/__pycache__/tokenization_bart_fast.cpython-37.pyc,,
transformers/__pycache__/tokenization_bert.cpython-37.pyc,,
transformers/__pycache__/tokenization_bert_fast.cpython-37.pyc,,
transformers/__pycache__/tokenization_bert_generation.cpython-37.pyc,,
transformers/__pycache__/tokenization_bert_japanese.cpython-37.pyc,,
transformers/__pycache__/tokenization_bertweet.cpython-37.pyc,,
transformers/__pycache__/tokenization_blenderbot.cpython-37.pyc,,
transformers/__pycache__/tokenization_camembert.cpython-37.pyc,,
transformers/__pycache__/tokenization_camembert_fast.cpython-37.pyc,,
transformers/__pycache__/tokenization_ctrl.cpython-37.pyc,,
transformers/__pycache__/tokenization_deberta.cpython-37.pyc,,
transformers/__pycache__/tokenization_distilbert.cpython-37.pyc,,
transformers/__pycache__/tokenization_distilbert_fast.cpython-37.pyc,,
transformers/__pycache__/tokenization_dpr.cpython-37.pyc,,
transformers/__pycache__/tokenization_dpr_fast.cpython-37.pyc,,
transformers/__pycache__/tokenization_electra.cpython-37.pyc,,
transformers/__pycache__/tokenization_electra_fast.cpython-37.pyc,,
transformers/__pycache__/tokenization_flaubert.cpython-37.pyc,,
transformers/__pycache__/tokenization_fsmt.cpython-37.pyc,,
transformers/__pycache__/tokenization_funnel.cpython-37.pyc,,
transformers/__pycache__/tokenization_funnel_fast.cpython-37.pyc,,
transformers/__pycache__/tokenization_gpt2.cpython-37.pyc,,
transformers/__pycache__/tokenization_gpt2_fast.cpython-37.pyc,,
transformers/__pycache__/tokenization_herbert.cpython-37.pyc,,
transformers/__pycache__/tokenization_herbert_fast.cpython-37.pyc,,
transformers/__pycache__/tokenization_layoutlm.cpython-37.pyc,,
transformers/__pycache__/tokenization_layoutlm_fast.cpython-37.pyc,,
transformers/__pycache__/tokenization_longformer.cpython-37.pyc,,
transformers/__pycache__/tokenization_longformer_fast.cpython-37.pyc,,
transformers/__pycache__/tokenization_lxmert.cpython-37.pyc,,
transformers/__pycache__/tokenization_lxmert_fast.cpython-37.pyc,,
transformers/__pycache__/tokenization_marian.cpython-37.pyc,,
transformers/__pycache__/tokenization_mbart.cpython-37.pyc,,
transformers/__pycache__/tokenization_mbart_fast.cpython-37.pyc,,
transformers/__pycache__/tokenization_mobilebert.cpython-37.pyc,,
transformers/__pycache__/tokenization_mobilebert_fast.cpython-37.pyc,,
transformers/__pycache__/tokenization_openai.cpython-37.pyc,,
transformers/__pycache__/tokenization_openai_fast.cpython-37.pyc,,
transformers/__pycache__/tokenization_pegasus.cpython-37.pyc,,
transformers/__pycache__/tokenization_pegasus_fast.cpython-37.pyc,,
transformers/__pycache__/tokenization_phobert.cpython-37.pyc,,
transformers/__pycache__/tokenization_prophetnet.cpython-37.pyc,,
transformers/__pycache__/tokenization_rag.cpython-37.pyc,,
transformers/__pycache__/tokenization_reformer.cpython-37.pyc,,
transformers/__pycache__/tokenization_reformer_fast.cpython-37.pyc,,
transformers/__pycache__/tokenization_retribert.cpython-37.pyc,,
transformers/__pycache__/tokenization_retribert_fast.cpython-37.pyc,,
transformers/__pycache__/tokenization_roberta.cpython-37.pyc,,
transformers/__pycache__/tokenization_roberta_fast.cpython-37.pyc,,
transformers/__pycache__/tokenization_squeezebert.cpython-37.pyc,,
transformers/__pycache__/tokenization_squeezebert_fast.cpython-37.pyc,,
transformers/__pycache__/tokenization_t5.cpython-37.pyc,,
transformers/__pycache__/tokenization_t5_fast.cpython-37.pyc,,
transformers/__pycache__/tokenization_transfo_xl.cpython-37.pyc,,
transformers/__pycache__/tokenization_utils.cpython-37.pyc,,
transformers/__pycache__/tokenization_utils_base.cpython-37.pyc,,
transformers/__pycache__/tokenization_utils_fast.cpython-37.pyc,,
transformers/__pycache__/tokenization_xlm.cpython-37.pyc,,
transformers/__pycache__/tokenization_xlm_prophetnet.cpython-37.pyc,,
transformers/__pycache__/tokenization_xlm_roberta.cpython-37.pyc,,
transformers/__pycache__/tokenization_xlm_roberta_fast.cpython-37.pyc,,
transformers/__pycache__/tokenization_xlnet.cpython-37.pyc,,
transformers/__pycache__/tokenization_xlnet_fast.cpython-37.pyc,,
transformers/__pycache__/trainer.cpython-37.pyc,,
transformers/__pycache__/trainer_callback.cpython-37.pyc,,
transformers/__pycache__/trainer_pt_utils.cpython-37.pyc,,
transformers/__pycache__/trainer_tf.cpython-37.pyc,,
transformers/__pycache__/trainer_utils.cpython-37.pyc,,
transformers/__pycache__/training_args.cpython-37.pyc,,
transformers/__pycache__/training_args_tf.cpython-37.pyc,,
transformers/activations.py,sha256=boDZAfFRsJuSLxJ1SKghFtXkj141Ovy5fu0XRWjKwDE,1711
transformers/activations_tf.py,sha256=2jYuoDvHp9HqMHy3dJtV46ANifcz0MPA3AwYPBNWeq8,1924
transformers/benchmark/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
transformers/benchmark/__pycache__/__init__.cpython-37.pyc,,
transformers/benchmark/__pycache__/benchmark.cpython-37.pyc,,
transformers/benchmark/__pycache__/benchmark_args.cpython-37.pyc,,
transformers/benchmark/__pycache__/benchmark_args_tf.cpython-37.pyc,,
transformers/benchmark/__pycache__/benchmark_args_utils.cpython-37.pyc,,
transformers/benchmark/__pycache__/benchmark_tf.cpython-37.pyc,,
transformers/benchmark/__pycache__/benchmark_utils.cpython-37.pyc,,
transformers/benchmark/benchmark.py,sha256=ke9ThuyhjZZ4RtFyfnqDO7euGBaSSgNTJi3C3uUBGJU,10617
transformers/benchmark/benchmark_args.py,sha256=veAsbPRuyPaXsvgp7EfFF32g05V420NA_diq5qRHJaw,3768
transformers/benchmark/benchmark_args_tf.py,sha256=6lYsMhIPAk8Wv2pTCJz8MwAf1-9O3W_MpiAI28o5qpo,4603
transformers/benchmark/benchmark_args_utils.py,sha256=ITNvpr30-ONpDdpwcHJGM6KkhMTQQe03zlgO4fT0XiU,6050
transformers/benchmark/benchmark_tf.py,sha256=PStXnb_c7c5GiIsXDh5Up3LxwV2DF5QIo7wDrxF-Zio,12928
transformers/benchmark/benchmark_utils.py,sha256=A51gu6luMSw0rjBs9NgCrdJUH0C8kWQX7J8Vf275We8,37582
transformers/commands/__init__.py,sha256=HUC8mCzpc2nlVUgYbIXbQ-axSJLzdGVvQYGxSiAegnM,316
transformers/commands/__pycache__/__init__.cpython-37.pyc,,
transformers/commands/__pycache__/convert.cpython-37.pyc,,
transformers/commands/__pycache__/download.cpython-37.pyc,,
transformers/commands/__pycache__/env.cpython-37.pyc,,
transformers/commands/__pycache__/run.cpython-37.pyc,,
transformers/commands/__pycache__/serving.cpython-37.pyc,,
transformers/commands/__pycache__/train.cpython-37.pyc,,
transformers/commands/__pycache__/transformers_cli.cpython-37.pyc,,
transformers/commands/__pycache__/user.cpython-37.pyc,,
transformers/commands/convert.py,sha256=hcNMsrpURYJMFuuPM7ifRWN0ZfDO0zg5Vulz2Lv08oU,6582
transformers/commands/download.py,sha256=Zv1RpWQx5kzs1jxKU_eQACpMqHU0uR_JH0Tz8TP4Lc8,1272
transformers/commands/env.py,sha256=45VcyjHDlJO_dDOwJjR0Wd6OoUh5LyvefAnkkz4XXrg,2027
transformers/commands/run.py,sha256=GpbFsr4t7aJ7I4yIrxhK_c6g0qtiujEC7X0DEfviJrw,3688
transformers/commands/serving.py,sha256=y5dox6YWVj6aKk59yYwepzw6h5biIaAsZgUvC-QPafk,7474
transformers/commands/train.py,sha256=YVXk8_LWPkVWv_4aWoti13lZukewSWHYh9LVrkA4eS0,5798
transformers/commands/transformers_cli.py,sha256=ZoWAGBh_VaGS4w-b8-DoN9fINbKNPOiUSNgDNp3-5cM,1168
transformers/commands/user.py,sha256=bk0WGz0-H7zlaWef2YAHiJO7eihAStrWPWyxI8s5UYY,9308
transformers/configuration_albert.py,sha256=q4Fvhu_BkWT74yl3Mmga2t6PSBz4mojdPHNMQBSAjcY,7570
transformers/configuration_auto.py,sha256=iMjTU-HyDgg4UMnHUndF9tGyayTX7n8kkmg55sIjND0,16527
transformers/configuration_bart.py,sha256=DrhvO2l6I3VKthDjZniUaOnScYQ9omfEXyiYEnXnqqQ,11397
transformers/configuration_bert.py,sha256=aD4dVqc9KL7CwWEyx-ILvhSk1kOL02Qga0N08_AHMi4,8933
transformers/configuration_bert_generation.py,sha256=x19H4zArcxY13B1pt--Nymwqn8ub0fOBfkp9wnorxcg,5228
transformers/configuration_blenderbot.py,sha256=erijIE51chFQrkd3n3PvJcguPJjoeNH9Ls76EL6nu-w,9322
transformers/configuration_camembert.py,sha256=20uh30AfIQ5pGlJKXO9CQi8lbn9imK91Y6dD_e0vlhQ,1536
transformers/configuration_ctrl.py,sha256=Hk8s7tfaAe4Xq1uTRePDXqpjRJ0pzo0QL8u2Bvnq4K4,5550
transformers/configuration_deberta.py,sha256=o3DicEtmactrWLM0OlFVH2UxX0-95Km60pcNdzQPDpE,6651
transformers/configuration_distilbert.py,sha256=M2I8DGIpTcDvJX2nhOikoz7HLbEGMrRsCZVAD8KNc3A,6840
transformers/configuration_dpr.py,sha256=Pq5dfF04_If03GetxhZelM8BhLFAU0VrpEkIHBQvtco,6206
transformers/configuration_electra.py,sha256=3KP7CwSFlDQI0J4EdLOkAt0r-fmFnIDdy2X0W46Verk,8495
transformers/configuration_encoder_decoder.py,sha256=c8EQDEGn7XPnIQZpOO0hhJp9FwJR71qE53qG4lzIHDM,5002
transformers/configuration_flaubert.py,sha256=z3pBxiq0lNSVsv2nKXCalGB2CARw0kGG4MCGiro7u7g,9054
transformers/configuration_fsmt.py,sha256=olXMTnGEaL2l6V7un2J2vJlfRj0iPhYEhxeLzysl28Y,9784
transformers/configuration_funnel.py,sha256=Nod59TqJLvTc5ut-JD_RKgrbJQxJWpWkSpaNoI7f4Y0,9680
transformers/configuration_gpt2.py,sha256=aDiAlr3ypzJJTxCtLEO9vCptNrsoAgVl-ywiJRVzmyQ,8865
transformers/configuration_layoutlm.py,sha256=bXwHMCMK5Sf6wd88QmMalxaNOzQdgXrdT-48Jx_MIVA,6190
transformers/configuration_longformer.py,sha256=ed0RKEKaG_wz8IXiRzDwHKOF5a_wTAD9WTTOw5Iv1PU,3626
transformers/configuration_lxmert.py,sha256=AqVOJYBJIRB9P0m816lyqLHkYKbyv5X0NxkVJkk2AD8,9873
transformers/configuration_marian.py,sha256=Pm9XCSB9TlEHhLpyekfXShKt5SDeZKwiRaMmiWCt2dA,5957
transformers/configuration_mbart.py,sha256=VBvnMPhfUfNjKoDnwzQtMW_3qk9Hc-JXEZCUCcJOU4s,6234
transformers/configuration_mmbt.py,sha256=ScmjchkPFj_OphJP2TjELh9OzGLpNb5Z_sAYOawI2es,1652
transformers/configuration_mobilebert.py,sha256=_6kxtRQ5fmWWy37HTdS1qfqMLg0ktH7W8bCFcL46jG8,7776
transformers/configuration_openai.py,sha256=yoKhcpKpTcYbjc8V1bjzHBsyY_v-UXO3XJ_KdvRdM0k,8241
transformers/configuration_pegasus.py,sha256=0ktwcnkfwcSaZX9lvty8jN8P1HstKFV26m8JIxi7N5M,8264
transformers/configuration_prophetnet.py,sha256=o6Iq00BRQiATJDz-X4byM7KZd-f0QqaIFWwLZP7wrqA,8066
transformers/configuration_rag.py,sha256=x9_AJI1ef_25qKrBLapPdjWtfLOnveEniV0TBh56tkg,8540
transformers/configuration_reformer.py,sha256=mGMXZJXMMtLslV-BFq6CzK0r2q3bsScRnUPDyn__ynE,13249
transformers/configuration_retribert.py,sha256=Yk8qKoWlTPqXoZ8weKj3GFDS_UQA3R_2NQIHDZUhxSc,5380
transformers/configuration_roberta.py,sha256=LLtX4BJkPs61xN5JndsRkt9ZhkRtImN2_tJi4l4-99M,2966
transformers/configuration_squeezebert.py,sha256=9fIN08ktFWeb6wLEWBA3BcneHuqfhckvCfcuDS5eKE8,7280
transformers/configuration_t5.py,sha256=ABiXIDX_hlyW7HHLEObATyQ0aCpdMJe2VAwi6VAIx6g,5617
transformers/configuration_transfo_xl.py,sha256=_79P0Qk4-TzhQonCVEfpChT6q-nVXWMMzOuNkgf7BAY,8405
transformers/configuration_utils.py,sha256=3eY4GFeaVk7OTbL1PzFprpfXbKpOsvsbufrHEFeHRbI,28627
transformers/configuration_xlm.py,sha256=n1T5Uk_ObDMvcjEpdRdyqOwMlLAazgSu1VHyuwnAyzc,12125
transformers/configuration_xlm_prophetnet.py,sha256=QZGhP19b_Xi9ee4DUplpG_pTpe06OUTwt7gRtVlFz4M,1264
transformers/configuration_xlm_roberta.py,sha256=tsktZL7A7QJk3q8i-YnbJKngklLJ-jTWudSdB7gMWIY,2013
transformers/configuration_xlnet.py,sha256=5k16nMWJy1aCsHz4Z-PCgkaZvMsE8o268HzP8zn21gY,10859
transformers/convert_albert_original_tf_checkpoint_to_pytorch.py,sha256=xh2oY3pSQHsXDXPL8xDu7SOM7SOxV24mXNXSMIJR1ag,2176
transformers/convert_bart_original_pytorch_checkpoint_to_pytorch.py,sha256=-I9kC4lXlcoZdzkP-eT7ajEm1lYuT2nN13Vhzh75lfQ,5486
transformers/convert_bert_original_tf2_checkpoint_to_pytorch.py,sha256=SeuU1F6FYjkNNnMFOmcZd_zBr6cRUsvHUTZRSgtqnjc,9664
transformers/convert_bert_original_tf_checkpoint_to_pytorch.py,sha256=2pKh1BsXA8rfYgEk910CT1gxzLN3cd2V6J9kAJDaas0,2152
transformers/convert_bert_pytorch_checkpoint_to_original_tf.py,sha256=-7NNtZCPIyzm89VWfzP4jguzRRMmuNlRlKcQl5gCYxw,4115
transformers/convert_blenderbot_original_pytorch_checkpoint_to_pytorch.py,sha256=bqHKTaU9P7BUedAtCHYeT_NaFxg4EpkEDgzNWX23Jcs,3678
transformers/convert_dialogpt_original_pytorch_checkpoint_to_pytorch.py,sha256=17hl_9wXT83FTi3N6CPI6Z6pPZcam-mOwREU_6o4gAQ,935
transformers/convert_dpr_original_checkpoint_to_pytorch.py,sha256=xyUIlN8aIn1FkeRAF6LYIFMVOYXxp3bR-jvItG7XQKw,5460
transformers/convert_electra_original_tf_checkpoint_to_pytorch.py,sha256=sPjSj6kIOnrNPFMPizpBalPjqmzAMffMHirWtXQG_Dk,2866
transformers/convert_fsmt_original_pytorch_checkpoint_to_pytorch.py,sha256=U9154FBOkLcFI-Yy9DB0ohJDHOfN6nJZ6iDSF_n2UUU,10885
transformers/convert_funnel_original_tf_checkpoint_to_pytorch.py,sha256=l7Gw3TDZULMcHs_sLaVHervfj7NJpfrsqdQDnsqtbnU,2128
transformers/convert_gpt2_original_tf_checkpoint_to_pytorch.py,sha256=GWnp05rdqIbWLPC0nR3myb9dfKbgZScMAO42pkPXXAc,2520
transformers/convert_graph_to_onnx.py,sha256=_lwWiR6mBNhUE8E3o43_58dPEAmnCMaCJxlheJ_lEfw,17899
transformers/convert_longformer_original_pytorch_lightning_to_pytorch.py,sha256=dCjMSrsSwELq_lrhW_EuVPjumqMd1mSrnxYoL4U4owE,3037
transformers/convert_lxmert_original_tf_checkpoint_to_pytorch.py,sha256=X1DHhht981Gnzinr-tUAkHEbhZllsVioT_C8gNNL-Ng,2128
transformers/convert_marian_tatoeba_to_pytorch.py,sha256=OPvllcdVHISclz-z07OOH07jx8eKa0qdQthjIfsgM40,33229
transformers/convert_marian_to_pytorch.py,sha256=GdpJLCUMDNQVcRFL3rPMd_m2Ndkt2uZzzgnvGBSIEns,22823
transformers/convert_mbart_original_checkpoint_to_pytorch.py,sha256=_5cT6YKulIW97adoJlc26wrrhdLU5YMvBEMeepUGuFg,1489
transformers/convert_mobilebert_original_tf_checkpoint_to_pytorch.py,sha256=2yWH-cVlriCrBUZVet0WbuCdSrPq97DkZse_DxSUuPw,1586
transformers/convert_openai_original_tf_checkpoint_to_pytorch.py,sha256=7e-um3S0Jv22ZXOUn9ULxd4UwrpGCvghobt15XZJ8jc,2654
transformers/convert_pegasus_tf_to_pytorch.py,sha256=kZiUmnz8z0El08TmMU5w6C5MRIi5STJ1iLA-janobcU,5347
transformers/convert_prophetnet_original_pytorch_checkpoint_to_pytorch.py,sha256=eLXBxE0sHYNZ2GfucWYEJuZGeqO5gfXOYml5YBo9PTk,7181
transformers/convert_pytorch_checkpoint_to_tf2.py,sha256=QJe9n-oWBN86AcfqBLiPBDOVzrHrEkkmlxd2gqh2ss4,15336
transformers/convert_reformer_trax_checkpoint_to_pytorch.py,sha256=9C1mWIyovCV9EYO0p_4O9lFMmih2semjrVnKJv2kCB0,7830
transformers/convert_roberta_original_pytorch_checkpoint_to_pytorch.py,sha256=MD0Aho4WJJUnLo8C7H8oFt7zrsCbKSxIhZVs2Ld5ocw,7982
transformers/convert_slow_tokenizer.py,sha256=5-qKaTJT-KU_OFhN0xZmi5X3-QEfYFTRjUR7NIqwZ0o,22947
transformers/convert_slow_tokenizers_checkpoints_to_fast.py,sha256=6LE8uvYT_206WKuGIOClUUAOTvwJTN7eeEoLKNaKrdg,5037
transformers/convert_t5_original_tf_checkpoint_to_pytorch.py,sha256=8yBrU_JBXa-yz-kSArJV-vvfLELO1fMVWEgQNCFnRC0,2113
transformers/convert_tf_hub_seq_to_seq_bert_to_pytorch.py,sha256=-r0zhJJclEEoc3dzEVgzUG_a-SJBGd-6RcyZet1jf_o,2931
transformers/convert_transfo_xl_original_tf_checkpoint_to_pytorch.py,sha256=dkolbUdI9gjp86-Pb4lBJMNbCzOHiuSskBVEEUyaO8g,4926
transformers/convert_xlm_original_pytorch_checkpoint_to_pytorch.py,sha256=4VAy8trzLD5vAQCQBXqo9tznkJmjScJu5JE6iKPwDik,2983
transformers/convert_xlnet_original_tf_checkpoint_to_pytorch.py,sha256=iq6uDSmmMA3XzKDP_re3S8ao0-gVr3np2fXWUpfbP6s,3698
transformers/data/__init__.py,sha256=mmtKNqYVbifKNuUfnPeyaQQfsBHndhZXop18uGR8W78,664
transformers/data/__pycache__/__init__.cpython-37.pyc,,
transformers/data/__pycache__/data_collator.cpython-37.pyc,,
transformers/data/__pycache__/test_generation_utils.cpython-37.pyc,,
transformers/data/data_collator.py,sha256=rcGfQQoCDtcc0E8P-5S4fGHF7jlIteX_gEfNmFN786I,27108
transformers/data/datasets/__init__.py,sha256=iO9zFr5MROu93f9yivXBQxQKA7GAUoI0pBlkWlmDXoE,443
transformers/data/datasets/__pycache__/__init__.cpython-37.pyc,,
transformers/data/datasets/__pycache__/glue.cpython-37.pyc,,
transformers/data/datasets/__pycache__/language_modeling.cpython-37.pyc,,
transformers/data/datasets/__pycache__/squad.cpython-37.pyc,,
transformers/data/datasets/glue.py,sha256=60tjRO6B67EYAQPrlNQGdcZxBV59-yQSzO4eanucg1w,5240
transformers/data/datasets/language_modeling.py,sha256=ut98cj-VYOGGh4htigFMvScsuvrTB36fTg0ZvZpGaN8,18485
transformers/data/datasets/squad.py,sha256=2mbDAIH9EaLUBn_OJMmhRkdfU-2QrpHwNbSkivmdFwk,8523
transformers/data/metrics/__init__.py,sha256=GQpe61-zhNvdyR_g9IbsUUVPDNjKpg62on8A0FGjuLg,3116
transformers/data/metrics/__pycache__/__init__.cpython-37.pyc,,
transformers/data/metrics/__pycache__/squad_metrics.cpython-37.pyc,,
transformers/data/metrics/squad_metrics.py,sha256=xLq_pNfceQ_FzULmOX4D5H5akVSi8oFMnD8QdD9ImYI,29105
transformers/data/processors/__init__.py,sha256=06UXi8_68t6kH7eXNMGODvQHAP0Q2vc2XLWWwI6jPQI,578
transformers/data/processors/__pycache__/__init__.cpython-37.pyc,,
transformers/data/processors/__pycache__/glue.cpython-37.pyc,,
transformers/data/processors/__pycache__/squad.cpython-37.pyc,,
transformers/data/processors/__pycache__/utils.cpython-37.pyc,,
transformers/data/processors/__pycache__/xnli.cpython-37.pyc,,
transformers/data/processors/glue.py,sha256=v519x8HkDW9-g0LphHqbIVFVhV_pEn-yXPtJtuMffEs,21346
transformers/data/processors/squad.py,sha256=_oeRMP-8qZ8PrrePzwIQhZXxDU_wLq3kvYdKVwSwydw,32391
transformers/data/processors/utils.py,sha256=5e4mHfvLMS6sQfUwkILOo5FkYQnUpeSERNnCB8Yz8us,14140
transformers/data/processors/xnli.py,sha256=nAwMopL5fgyj-sBkJF1TqyLiTvSGLyyWYsLxZLuYPXY,3308
transformers/data/test_generation_utils.py,sha256=Ud1CF9B_VFrxpBY_WOmkYciZfYcL4xSThbtKj_7SRIU,2874
transformers/file_utils.py,sha256=0dp5vDCdgDfda97hy30Xu4A9gGKW2lt4o7EA3j70da8,45188
transformers/generation_tf_utils.py,sha256=DopA57hnd77JCgPUi6Mqjv6DLjugInH2hgTsXiXat3s,54719
transformers/generation_utils.py,sha256=vh6IL8nW6ibYZ0wjNJ4KWBxrLtJXWWugOclCAf016t0,51388
transformers/hf_api.py,sha256=mch-SC0OcXpLocF3eWOgk6JI_qNDvSxk4C-mhGDuoV8,8178
transformers/hf_argparser.py,sha256=xm7m_dpX8WJJEUgcbascS8ahMWvYbun4JZhVXMRPbjk,8226
transformers/integrations.py,sha256=xIJEmBWoM63bTiVzvnUPfBFM7HizmOUWIalmVuU8OU0,14363
transformers/modelcard.py,sha256=8kO0boV_3EfMrYybuU3q0skKNtjY0GB35c0Eki_LPbM,10052
transformers/modeling_albert.py,sha256=p6Eh38bRwGzReiwS0vHniNdW9u51SvoFMp7JLb3AvhI,53414
transformers/modeling_auto.py,sha256=LTqvqNLkG2gvwLjYZyWV8LJvx-8JJX3flKJn5P6luw8,67297
transformers/modeling_bart.py,sha256=GOc3TdHrJ6Kd080bEr5bOO3_xRCrca6rANhi5kXmFH4,58368
transformers/modeling_bert.py,sha256=3RuUsL-Na2pjpXeJy__Hf_qJD96Bnqm9P4gSXj_Li1w,67579
transformers/modeling_bert_generation.py,sha256=u0MytsA_NhyHqkpgpCqgsoNecfw3YZVWXVQSM7CP_nI,23694
transformers/modeling_blenderbot.py,sha256=E7mDTAJN7S7LW7ddG8_4lBFfUokVDIMi7609IOFqYHE,2374
transformers/modeling_camembert.py,sha256=Yu45nyrWfiOOQpWI8rIT3dWYqZWZpAZDPDjuSwfPzPU,5685
transformers/modeling_ctrl.py,sha256=EcpeEMFgdGJtKuWGwfLDBE8PJ0eXT9Gt3z1An2wDv7w,24658
transformers/modeling_deberta.py,sha256=-iSGhaNBrFIIvMkIrlLvzdoLeiAzKH3giSDgAfzS_PM,41672
transformers/modeling_distilbert.py,sha256=EEuN-qvA9kWA4MorFrdHzwgnf9gddGNQ7HxN3uOEjEA,38980
transformers/modeling_dpr.py,sha256=CusZiCrQzJ3p4YR9E0mDNFB0mD-qsFV1dWG6YVu2HY0,28460
transformers/modeling_electra.py,sha256=jLZ3nHLZSzNe1ZaKczjpxn8jsNuCTD9s-2O79NDBg_E,53903
transformers/modeling_encoder_decoder.py,sha256=-sMtlqWbzJqFflBE6wkeK9oYasO-XJT73YM_UC2I_CQ,24460
transformers/modeling_flaubert.py,sha256=dYZiUkkXJAM4J0QwFmWO4R3PeX_Ix48gz3PpGLsp9Vo,17452
transformers/modeling_flax_auto.py,sha256=wy39brdU4UimwOmqE5bkNVr9kzCmzMJu_gJn_PpTovM,8917
transformers/modeling_flax_bert.py,sha256=GGxHansWoY10H7d2xMOdptWxEz2qeITPxoMeDcpiuL8,16952
transformers/modeling_flax_roberta.py,sha256=I_NSIp-MSOUKVWwDxQ5h3WzW-KMlDTuyQHxu4UtlPV0,17979
transformers/modeling_flax_utils.py,sha256=yLxHKieLzmcPYmZOxlHtocXX9b4UhX2jSOTo8GRmaLM,7330
transformers/modeling_fsmt.py,sha256=I5kwcIxvy_B-2-acMs0cn3iQnXqxftYxQgpstUaSJOw,49677
transformers/modeling_funnel.py,sha256=w0gfAg0g0_jtZkP05CynT2wpVsFhOZs6BThp2QGPdNI,65709
transformers/modeling_gpt2.py,sha256=19iNdOhzcmuGEqf_OvMN8M3KjzD2F7Kt0HG1s1l2Mw4,46472
transformers/modeling_layoutlm.py,sha256=HimJaAeAVbRY6d9XXMks3Td-5jAtdYd693EvPJE79Fc,37080
transformers/modeling_longformer.py,sha256=1eFAGyYRerAUlyf4m_iOu6yjjxNZUYh9ZMxkLnwA0Tc,80996
transformers/modeling_lxmert.py,sha256=RVjI1xm21mp8feNSWswfqvdNt-AmRpD8PqpwcVIHdzY,64088
transformers/modeling_marian.py,sha256=kzcoEXdMaW7o0lBUW7q7VIhMUNxnYNoedLnTcmhpoII,2434
transformers/modeling_mbart.py,sha256=oFIMAYZ6Ui91jzrHgbSjeaSFer3GtBfJlt5gnFusfUE,1365
transformers/modeling_mmbt.py,sha256=32We1xjsFjAmTAqwxDBQiQ2KhM2hAjgsalJbcp7rNj0,19377
transformers/modeling_mobilebert.py,sha256=Wef1lpeMbvcKlY3wtrq0SDiQRLIPfuqwWxZuWWu8ERI,68232
transformers/modeling_openai.py,sha256=XiO-t1RxS2jnEFVXoPoHt-lZoJDD7ghJunF7kSwDxCo,36008
transformers/modeling_outputs.py,sha256=kEWzcP8gtnzuSCa4tKvu0RHFI5zmFvwBHwxFpEiiYH8,37347
transformers/modeling_pegasus.py,sha256=HZtyHOYXhifol6Fsuy-k6vezl9o2Vtmv8KBptX80PMo,2696
transformers/modeling_prophetnet.py,sha256=r8aPJNYt8o_K2YYrQ_-rkQoJRi8ZglRv2BrHmZmkk8k,101399
transformers/modeling_rag.py,sha256=Qi5jq7IlH_ma8zpe8PJ0fC_j9AS3r-eDmJN4fM2W2a4,79283
transformers/modeling_reformer.py,sha256=yUwj54GOiW0ziq9ncd1IEgM-jabHtWVyM_dTETFnrBQ,109824
transformers/modeling_retribert.py,sha256=kqjzCSfDESnSFmjSI3V1KFelv3okeRb-TVRawkWADB8,9240
transformers/modeling_roberta.py,sha256=sPC_4K23BEmnjQRq32PZk_KUo6dlY9nbrJXWILhby74,54854
transformers/modeling_squeezebert.py,sha256=Wu3fyNJS5yYZyqZARFma1ai5h1wDhEz63AEysRf7qsc,41618
transformers/modeling_t5.py,sha256=wlVdaYI1kSs1cDgCNZXlKoRL5XyQVBZhfYXx2XQdU5s,56316
transformers/modeling_tf_albert.py,sha256=xoz7v4ZVVRb0LB4gL2EaY0KRmMO1TgVMBPJG2ZV4IuA,55170
transformers/modeling_tf_auto.py,sha256=rGLpmDHW4Y9yPUyJWLx1VaNT_CGec9R18u60-LH-C5Q,63058
transformers/modeling_tf_bert.py,sha256=1jP9X7ni72TGN6n8VJKhOgQ8xz4cAoILHGSvjNzpluA,60374
transformers/modeling_tf_camembert.py,sha256=_bVGG2mUtAItLKVP6NDpbQIuhtuLdzkRN0PlDH-vgeg,6262
transformers/modeling_tf_ctrl.py,sha256=FgQ2wvhy7LepfDqvEVLkbrzqOsRY_9MgJEoJA68v_TI,28263
transformers/modeling_tf_distilbert.py,sha256=fu-HJIs65WU3tQghxpWlftYBdevnFjZJ0b8MjnBO2as,46463
transformers/modeling_tf_electra.py,sha256=8wJiV3r9mmYS3LV8QdVIAoqdGbdxAyDiuyyOM1aUaJ4,56073
transformers/modeling_tf_flaubert.py,sha256=mi5cKW3NDd2rE_P9x_Ej0hxDB4ePKEe7JLWJiSNbylQ,35507
transformers/modeling_tf_funnel.py,sha256=USLAr4musfTOXNeH8KkByvNKLkD4J7BQi6HywPxGlCM,73584
transformers/modeling_tf_gpt2.py,sha256=U64JCo1liOT9qJ3bWMXPr8KEtExyGXprl70xYYcwfeI,35990
transformers/modeling_tf_longformer.py,sha256=bYnQqD3miKanP1d_akfzMHtv6anPCZFUo_jSLFfENQU,78170
transformers/modeling_tf_lxmert.py,sha256=Bbed9rN7ionMyQMKQVf3NCcobzf0drz-VZ0Ee9azI3Q,61944
transformers/modeling_tf_mobilebert.py,sha256=-wfkAbTLf82hqWy5uoI0NUO_4UabBHO9du5aIAsttdc,66041
transformers/modeling_tf_openai.py,sha256=qeU3Hr1-6wYCSQRufyBueIHdwsZS5mXauXyiPxOX2JM,32481
transformers/modeling_tf_outputs.py,sha256=MagL2Ze7tyqOlTR-AWry3-4rYW1rXq4lIg_tHsgMRHw,33585
transformers/modeling_tf_pytorch_utils.py,sha256=vyShVxvVTZ1wsaVsHUvz3XbtQ1xT4F7F-Y4XSb1feBI,16828
transformers/modeling_tf_roberta.py,sha256=77p4YWn0hCWrOrs57V0pEhQMjNhfOI1ui_0_aHy-Tf4,52114
transformers/modeling_tf_t5.py,sha256=RGdSOS711jMGAdMAvmk2-9KTkIf02k1jupvWJWdO9Bw,66954
transformers/modeling_tf_transfo_xl.py,sha256=8QofyhbrtCHT1HQXcBqnQ9F-wlpqooZJJdP7JvfeJ2E,39355
transformers/modeling_tf_transfo_xl_utilities.py,sha256=zl3qqGseISDfVyhiA6gwI69Hojc802iJiWbgg0jUrGI,7818
transformers/modeling_tf_utils.py,sha256=OOoRRKNndiGjb43YKGM4oWstUkoGajbyMerDikYvnHc,49337
transformers/modeling_tf_xlm.py,sha256=WC7LnIvlESJoD5YcPAX4pl1QHkQeWD5h9qrPQ7SD6fs,51920
transformers/modeling_tf_xlm_roberta.py,sha256=xBGYrV_lhGTizTG6KanTy35PmecrLxAcw7WzjhJ13bA,6300
transformers/modeling_tf_xlnet.py,sha256=m2MIMZp4wAxjMv-hjSRone8iPWHQGdFT6Jt_h5UYGy0,82670
transformers/modeling_transfo_xl.py,sha256=9o0L8jUs0jeWZBJYTYNg6KMMXvSTBsK-TTBQ3dF3TeA,46565
transformers/modeling_transfo_xl_utilities.py,sha256=DlGGEk8MAlbu6aO8V_h2L8fiXcs5w_Im5_wSzg0xIF4,10652
transformers/modeling_utils.py,sha256=aqL5e26-M5dbzNsA-CkK5mbj35U2K0cSXLPPuEU9ju8,82105
transformers/modeling_xlm.py,sha256=iGNQ79tBIJamOffRSFKqlkUAYj9vynGnU3e3L4OQXbk,52051
transformers/modeling_xlm_prophetnet.py,sha256=5g9wAn-jZhKHt8ZCt8wQne4PtdzL12s3bjxVdsdeC9E,6853
transformers/modeling_xlm_roberta.py,sha256=MV_6ya-SIPK2poAUXIkG7CRWPX8am4BptzPz2VHIbyw,5815
transformers/modeling_xlnet.py,sha256=pzRrhRrHbnYNvhRUdLyjqJsqMhufDsPUh1XCnyTIB0I,89614
transformers/optimization.py,sha256=vc6dI0P_sZvAI5Z3_wbOqkLtCx-glSITTt1LcBdtzU4,22600
transformers/optimization_tf.py,sha256=-RJINJ4rCQpM9Yqqf2ii4FFzL3bjXuN81rAINz21st0,15876
transformers/pipelines.py,sha256=WuTz4Mvbt7NRMimsg-j6nCUD3L4-j47ZfLzljaUvjhY,118659
transformers/retrieval_rag.py,sha256=6RXnWay1_j6IU-LF7UiQ3t77Dvq0g47D33oYFGQWyzY,27944
transformers/testing_utils.py,sha256=-DCFaNDATzJl7kMBp38imxAypDfDdzxXYvwYwvoKsMk,14955
transformers/tokenization_albert.py,sha256=0LwSdtX3qrNfSbrHhuE2D4Kc1V7KbVPHYgTQweZEYGc,13413
transformers/tokenization_albert_fast.py,sha256=pA_hGq0uR5WrD7J8LgBZZPn3fbwyCj40iG4NQm-AP6g,12323
transformers/tokenization_auto.py,sha256=KUbiwldpfKIf0BHpsLSREmTl8Lz7M1dJ1Ts1qjmrUpQ,15973
transformers/tokenization_bart.py,sha256=Ar4iz4dRH6c5rZeJIfCG-jVodDUTdDu--3Kl5DWaoRE,7982
transformers/tokenization_bart_fast.py,sha256=KsZ9G0HgpmsKPK_PqGkLdGUPQYkb-9hyDu4292d12X8,8017
transformers/tokenization_bert.py,sha256=hbdg4mdDaPUn8EgpdT8zplX6uswTf9AwOdZoz-io_f4,24880
transformers/tokenization_bert_fast.py,sha256=5Ykku8r1v6xXQz5U1FAPCXEwl_X3tDUKnGNoapSyFl0,14966
transformers/tokenization_bert_generation.py,sha256=m5USK-KuLvHIJx39ndKRusfRFm6AxOIz0TW4D0cSaIo,5191
transformers/tokenization_bert_japanese.py,sha256=HyRKYdRy9Zr8-UK6jxu3Pkx9x_fm_OXSart_n2MBCbk,13274
transformers/tokenization_bertweet.py,sha256=kJ9KU5W5t79i50hotjFjOXxlIbhi7aAy9wQrS1G7RGE,27550
transformers/tokenization_blenderbot.py,sha256=FKtshHooo1RnDwYz29W1yHrSL-SLtAKuOoLUBW-mHMg,10226
transformers/tokenization_camembert.py,sha256=0sy7hBgbiviIoeXgmBki7sl_7XIJk3uhMGvg1gHy6TU,11894
transformers/tokenization_camembert_fast.py,sha256=f4hjbG-QiQepZ45nRZa5489J6w_9v4-2uvCAPY1Bag4,10194
transformers/tokenization_ctrl.py,sha256=_N9AyjBrsKfV83vvINIvcUI-xXEWeUn00WkrHNUubcc,8515
transformers/tokenization_deberta.py,sha256=caG_Tl4OQPmGYhc_-0N84R_AtS3hbd97-nUNYZ3LI7M,24309
transformers/tokenization_distilbert.py,sha256=Ef-hB1SWbL7lA_awl8R6ZPa4AhE0kaN-6CRuqW6TNg0,3050
transformers/tokenization_distilbert_fast.py,sha256=df4Z2jET0JmOpLuwJQydc4aNz8Ym5HSuQHEhIVWLnmw,4107
transformers/tokenization_dpr.py,sha256=7FIfEt1AoSDh9wBOENE2mlXQ6-ouOqQ9T6qrpynW5tc,19909
transformers/tokenization_dpr_fast.py,sha256=vWfiTB283A-Roy550eavtKsw5xj1AVO4p3Imu6pP6pU,20403
transformers/tokenization_electra.py,sha256=RXKTZYPpRKLouwFNNpE_iBwm46uNiUIBllIJh_5MGZA,3022
transformers/tokenization_electra_fast.py,sha256=3gtAMteiqkVfmnBlWpV3Qd9qXDcSfZOldR5iXMv-eQ4,4144
transformers/tokenization_flaubert.py,sha256=sm4GediGJhD8pKCj387alSt1eMuhDSTik9n_GQnuK30,5738
transformers/tokenization_fsmt.py,sha256=WgHXrZ_kyhT4a8gTR_d5dZggURWdGW8VxhivlW2ZmUA,20725
transformers/tokenization_funnel.py,sha256=TC6nBpowZTqhD3KScYYl3yjAwPyMOD98mmKefczewKI,5526
transformers/tokenization_funnel_fast.py,sha256=o9BrWx_T_PDJW_6g81gQYIlmLE69sFnQu9q2pdq3wtE,7234
transformers/tokenization_gpt2.py,sha256=MMemX9mtSnBdsQWUByx39fbb9BENk8g1WDCWn1TyYLE,12201
transformers/tokenization_gpt2_fast.py,sha256=fJ-cujHUKXcTJ1LPoRyEQzpCJU5jvR-UdGjYrxRr5Eo,8411
transformers/tokenization_herbert.py,sha256=eWLa5UFHCTA8QimPgFBk5ShE857DNkDa09rsDEaFkUA,2898
transformers/tokenization_herbert_fast.py,sha256=k5cHmBg3iKjPy1FnEXbEgVy8LIpFb-vLlcTSCpTPPZM,6372
transformers/tokenization_layoutlm.py,sha256=SS6ZbK-ohXxrKuBxLFfMru5kwV482VegD0MM9-qFuyQ,2084
transformers/tokenization_layoutlm_fast.py,sha256=8gandDMy3uOHBU-XAuzhu-4Pq8UN7dQrhptx__ObukA,2551
transformers/tokenization_longformer.py,sha256=PYzuEwA0owt4lkm8JHE1kkVodE7pxHaan1oVkcXMQjs,2154
transformers/tokenization_longformer_fast.py,sha256=uWnsBlpIy-u5IyakymCt3V3lLhw4WjY73DBX2K5YG_s,2514
transformers/tokenization_lxmert.py,sha256=_bW5E7MlSbbRz25JetHqoXcTSxuoz-hXts7XheVh4V8,2635
transformers/tokenization_lxmert_fast.py,sha256=I8-2xQ_HyIk2wE54ywOrLftQ11l0gXE_tM3oS0gmy38,3003
transformers/tokenization_marian.py,sha256=k_jnGIaFOd9L5Z4Bu0roI1p5tc7HKnFIBNTFEcJuX6A,11311
transformers/tokenization_mbart.py,sha256=yRB73jrx9_rtUJ2qtZxqaqXaoFUZ0rdqZq155v7fgak,9395
transformers/tokenization_mbart_fast.py,sha256=j77Cd2IuLTOzxa3hUjgp58hG9NHilW-NwIJWuRTjcec,10119
transformers/tokenization_mobilebert.py,sha256=JHqcoZWUSs3_oiK3IrcV44xl2KjL5mheP8gyCKpIPoY,1689
transformers/tokenization_mobilebert_fast.py,sha256=DYki9PPsOLjPEdWkVGwB4YVgpAf_m_5mIvtTDbzS6lM,2070
transformers/tokenization_openai.py,sha256=G48gWibYAqVH9kT2WyyUiQmf1CxR5PI08Beba47WPTA,8542
transformers/tokenization_openai_fast.py,sha256=4mGFwEWw9EQzWTRJOLFj6AmBrR6XLSGKdu27IqCYZdQ,3106
transformers/tokenization_pegasus.py,sha256=M_FkJGnT16sVUD6cnWFu7hDFvbFfO1g5IWO9qzBBQJc,6716
transformers/tokenization_pegasus_fast.py,sha256=PIq65ZeA2DAPDndvBofhqv4cw8RITMFU39JUiLUmPts,4795
transformers/tokenization_phobert.py,sha256=CDCudfh8typutvSUicRupLpm9y5mQEuTb9QjamQV9g4,14033
transformers/tokenization_prophetnet.py,sha256=iLOzPiUfEcrIpF1ul7IdjvEzWiU5IHhew88dEgFl-_M,12531
transformers/tokenization_rag.py,sha256=xlBB-oZ3aUako8DHywDvxU8lbgTldbiwtG4Du-ykrqU,4007
transformers/tokenization_reformer.py,sha256=pcv_YNdIwhY8MgRg9Q9GYIdRlqTtL-KqU0Cw-DSm90A,6184
transformers/tokenization_reformer_fast.py,sha256=FB6GXNH90kWLza4ko05tznC3IGKZ80kkYrLIN6zCH2Q,5160
transformers/tokenization_retribert.py,sha256=A_bjFLK2re3x3ke4C-vc7TfbMRXyr-QlrcSO3Z_-V_o,1865
transformers/tokenization_retribert_fast.py,sha256=Lbmsh6bzQPiruQi68QKIRUod6eEVaB-il4SIQoL1Irk,2247
transformers/tokenization_roberta.py,sha256=fE8VeCrXw1lTxwgZGM0kIrTe3RYdnVPt372mDG0HowU,12658
transformers/tokenization_roberta_fast.py,sha256=6rq4tJJBcF6iz5RsI3bUFi9sCYDHzHYBwTkNQ60EsWQ,9932
transformers/tokenization_squeezebert.py,sha256=bAIyFvQ6JOTH-MsdgxWtN849ees5uoV6mzHtvOdZhQo,2378
transformers/tokenization_squeezebert_fast.py,sha256=aCGH9fUNKJckv-73HDCgxgT2S5PWqLwtP4iy9cS1FBI,3078
transformers/tokenization_t5.py,sha256=SA7wUET15EnNE-qX0Q1n1A8TFJho1dulabZKL_OLzsI,12287
transformers/tokenization_t5_fast.py,sha256=s5DBr5B9HM9_BGo3YouFJ1l0HHCVaEzAA8jYj8E6-D0,9617
transformers/tokenization_transfo_xl.py,sha256=5VLZpbd7rEGUiKVFEBVg0PaLQsa9NhqrZLkTyE20KTg,30586
transformers/tokenization_utils.py,sha256=bz6WA1F9ls1OeUOnpmJyuCpKyQ1L3HsJzcR4lVKfx1Q,39004
transformers/tokenization_utils_base.py,sha256=re9jAavWAeFnyfygGPPaMxQ2fPK8FfbzVnkRSqyP0xw,143797
transformers/tokenization_utils_fast.py,sha256=PG2wLhCewsv1mlsg0ri2Qx3PCEQ3sul1w7TbGeHu4b4,24319
transformers/tokenization_xlm.py,sha256=YMlN0LxU0AVp2LRfy2tLv1XC1HeAkoYUew-RZ36a90E,34875
transformers/tokenization_xlm_prophetnet.py,sha256=7hDaMvoHPcNuo6IA8DcjVlzMsoqYeVyOs1cTx7moYL0,12736
transformers/tokenization_xlm_roberta.py,sha256=EzsOZ-MfTutIIRf57Y0ajdTYa-79a9NgSIiBMbjlm8w,12834
transformers/tokenization_xlm_roberta_fast.py,sha256=qaef9ZJhZI0hL8MXhyTrE5UgZWSVoNNu3SjnSh6Lj2o,11555
transformers/tokenization_xlnet.py,sha256=CJeShRNOVSKV3QipnYBpal7Gt3hQ5sXG7OBEz0-d7sc,13149
transformers/tokenization_xlnet_fast.py,sha256=IPki-CftTAowe26a98VrJUi_zbbbUABRRSNmgjjhBnI,11241
transformers/trainer.py,sha256=VU_4UNUc4C318vf99_ChAhDTZsRpumYckuU4uwN1ef4,70507
transformers/trainer_callback.py,sha256=JXQdFYvfDVI6SfdEr7VWFDgk7pvsrVzDynxMWm3QIJY,19461
transformers/trainer_pt_utils.py,sha256=8FRxF9hmBm-lHinj-iZiBt7OpqOf-87l2v1BkYngExQ,12036
transformers/trainer_tf.py,sha256=sas17R7bxBc1mggjKJYfed1YjsOEE7knH5MixdJ5Kck,34717
transformers/trainer_utils.py,sha256=7Zg4Ji7d7Ys1Ptsnv_S0TxC45dY_X7HsHRxxgmNBn3I,4719
transformers/training_args.py,sha256=jbctjqxJGmf1DAFbwJn3V91wMdoYIwpmq5-Ju6RqB7Q,22648
transformers/training_args_tf.py,sha256=GEJS1hy7kO7-VoovnFm9MKRL7kV0wMpT_br0ikP25gE,10654
transformers/utils/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
transformers/utils/__pycache__/__init__.cpython-37.pyc,,
transformers/utils/__pycache__/dummy_flax_objects.cpython-37.pyc,,
transformers/utils/__pycache__/dummy_pt_objects.cpython-37.pyc,,
transformers/utils/__pycache__/dummy_sentencepiece_objects.cpython-37.pyc,,
transformers/utils/__pycache__/dummy_tf_objects.cpython-37.pyc,,
transformers/utils/__pycache__/dummy_tokenizers_objects.cpython-37.pyc,,
transformers/utils/__pycache__/logging.cpython-37.pyc,,
transformers/utils/__pycache__/notebook.cpython-37.pyc,,
transformers/utils/__pycache__/sentencepiece_model_pb2.cpython-37.pyc,,
transformers/utils/dummy_flax_objects.py,sha256=LcyKyS82hN-xfOware_eRpGFiSql4tY8eiqfcPUy5mA,490
transformers/utils/dummy_pt_objects.py,sha256=mzrGmkp310723iuoFrUpOH8QTHAvF8JMdJU-ZGNDEM8,43177
transformers/utils/dummy_sentencepiece_objects.py,sha256=-q7HJKIREEoM0_JcrF-yaeGCMWfBRTl71vcP33q6W34,2409
transformers/utils/dummy_tf_objects.py,sha256=V9AcfUPZHAEGeuAl8aqZvnBGfU1MJavhryTfcQkUeEI,26977
transformers/utils/dummy_tokenizers_objects.py,sha256=mdsnRIdnR3HEreviyOB7bpMop_lgob2lqq_9StrzVik,5813
transformers/utils/logging.py,sha256=8dzvo412oAcWCnBi5wUX8_P3yfzp4M8-BeQqlqTHSbo,7024
transformers/utils/notebook.py,sha256=ut7OZtO9HHJCYolj6eAIh642Q2BnZmlmar4EQQP-iS0,14370
transformers/utils/sentencepiece_model_pb2.py,sha256=WxwrJ0ToCgypsgQti6d5iW9ZNija_8M7vbSN2Q4pjg8,39000

transformers installs all packages under the directory transformers. On the other hand

$ cat ~/.local/lib/python3.7/site-packages/diaparser-1.0.2.dist-info/RECORD
../../../bin/diaparser,sha256=o2PYewSFbe_c-vrje0fQjNFwYsA9TjUWSKDuA3XPgN4,233
diaparser-1.0.2.dist-info/INSTALLER,sha256=zuuue4knoyJ-UwPPXg8fezS7VCrXJQrAP7zeNuwvFQg,4
diaparser-1.0.2.dist-info/LICENSE,sha256=xeI2EgJaGdxHP_8aseQp7ND6AzphyteAuZXiGA24jkA,1083
diaparser-1.0.2.dist-info/METADATA,sha256=hgC6w1c9DlBINGYpHkI2WdxhoiyCX_jrqnGiL6jI-uU,15553
diaparser-1.0.2.dist-info/RECORD,,
diaparser-1.0.2.dist-info/REQUESTED,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
diaparser-1.0.2.dist-info/WHEEL,sha256=EVRjI69F5qVjm_YgqcTXPnTAv3BfSUr0WVAHuSP3Xoo,92
diaparser-1.0.2.dist-info/entry_points.txt,sha256=E9vzi0dZMdkUAXjA64v2o9a9aN78MZNSYZ9ZAXgJjUk,71
diaparser-1.0.2.dist-info/top_level.txt,sha256=MT3qdEece4cdetbGYPMF2Ffr4BCbcMMJGkRGAezE_mM,26
diaparser/__init__.py,sha256=KyMh3o6KjeFdj3O4L_4lm49WsG8QggrxmV0seGQDKlU,72
diaparser/__pycache__/__init__.cpython-37.pyc,,
diaparser/catalog/__init__.py,sha256=yprOQfgRcljc1y11ZCuTjXho5EjK_9CmR1EFTO0huF8,50
diaparser/catalog/__pycache__/__init__.cpython-37.pyc,,
diaparser/catalog/__pycache__/catalog.cpython-37.pyc,,
diaparser/catalog/__pycache__/prepare.cpython-37.pyc,,
diaparser/catalog/catalog.py,sha256=mIhLSN6jANYvrzzhslkFojAKCIFigkWjbPmeMdSzHSs,4970
diaparser/catalog/prepare.py,sha256=tvl2Egu1Q8BH3JYUBtmrtrUPNPJKPUQ0XDbhdXyryzQ,4367
diaparser/cmds/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
diaparser/cmds/__pycache__/__init__.cpython-37.pyc,,
diaparser/cmds/__pycache__/biaffine_dependency.cpython-37.pyc,,
diaparser/cmds/__pycache__/cmd.cpython-37.pyc,,
diaparser/cmds/__pycache__/evaluate.cpython-37.pyc,,
diaparser/cmds/__pycache__/predict.cpython-37.pyc,,
diaparser/cmds/__pycache__/train.cpython-37.pyc,,
diaparser/cmds/biaffine_dependency.py,sha256=QKoe2b7r47kPDErWxlu5Z2ml2ehKox1zt4G-f3O3DvQ,3340
diaparser/cmds/cmd.py,sha256=s5Sw8Hv7a9RHxnMk_7wgVrmNn9Veqvh7nXRmwKJdaiE,1601
diaparser/cmds/evaluate.py,sha256=eInarDOjkjcnOGQUliPZyrXK3TBX4FNZ9dXZXkVtEuo,1635
diaparser/cmds/predict.py,sha256=te2jYsbWbVJEqZIC8BD6CWKN3MFNcTMJqPzSinW4HVQ,2867
diaparser/cmds/train.py,sha256=PElA8nkmsVgPkZCLVwDzwURCtDQ60gMbGfyMUCeed0g,7894
diaparser/models/__init__.py,sha256=A36_QT23A8nCh1SG7WbDY70Pu3jMntv3SoBu563xY5M,112
diaparser/models/__pycache__/__init__.cpython-37.pyc,,
diaparser/models/__pycache__/dependency.cpython-37.pyc,,
diaparser/models/dependency.py,sha256=mvRqi8tTd6e9AP0av65f5nhSIJmw5ZaMPGl0vN_-gIs,15907
diaparser/modules/__init__.py,sha256=7aTz_Q07kSwGlERijK-v2ceBnXCF5lBimuXadQ84Pww,473
diaparser/modules/__pycache__/__init__.cpython-37.pyc,,
diaparser/modules/__pycache__/bert.cpython-37.pyc,,
diaparser/modules/__pycache__/biaffine.cpython-37.pyc,,
diaparser/modules/__pycache__/bilstm.cpython-37.pyc,,
diaparser/modules/__pycache__/char_lstm.cpython-37.pyc,,
diaparser/modules/__pycache__/dropout.cpython-37.pyc,,
diaparser/modules/__pycache__/matrix_tree_theorem.cpython-37.pyc,,
diaparser/modules/__pycache__/mlp.cpython-37.pyc,,
diaparser/modules/__pycache__/scalar_mix.cpython-37.pyc,,
diaparser/modules/bert.py,sha256=UM_e2THGD5_vHBaF9cCO3sIkYKtEog60UA91JmTgBHc,8510
diaparser/modules/biaffine.py,sha256=yofK-rusLHp3kBvLxgUPOnkb72J9XGT4NZaOKn5E7NU,1220
diaparser/modules/bilstm.py,sha256=eAy0CC5ReGhJuAlX1e5Jrzq8ntRmQzb_PXTRoIsqrKw,4706
diaparser/modules/char_lstm.py,sha256=woB99KyDBo8rRrnuEweUP5ImI0hMm2__L-6iqPJx8ys,1620
diaparser/modules/dropout.py,sha256=YAraoJHxriPyONdqfd4_DvVqQGoqNf3A9RVX-r9VDYg,1914
diaparser/modules/matrix_tree_theorem.py,sha256=xa7R4G6vNl1hV_S1Z7OSMItg3HzcPpNABaNX8LVPyIU,1329
diaparser/modules/mlp.py,sha256=04_XqgscQqqTmceBFhau6jwLPaIFIWgpcITA9Z1qzA4,925
diaparser/modules/scalar_mix.py,sha256=CmGRsgYaS14imTMTsIdK1b-KDDfZmtEGAaY-HigSg38,1212
diaparser/parsers/__init__.py,sha256=iQirc_3rsiWyZ6dOOvlmfh4B148i7rTwTSvN8SAyXv4,171
diaparser/parsers/__pycache__/__init__.cpython-37.pyc,,
diaparser/parsers/__pycache__/biaffine_dependency.cpython-37.pyc,,
diaparser/parsers/__pycache__/parser.cpython-37.pyc,,
diaparser/parsers/biaffine_dependency.py,sha256=YpvrZH1j1kys233Ho3zBjZFhIErPzIY1zl0Bx7bPsQU,11359
diaparser/parsers/parser.py,sha256=grRGk-kaN0IpEJeBk47E1GKtGsVKZmmUKAeCKGqnlmY,9783
diaparser/resources/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
diaparser/resources/__pycache__/__init__.cpython-37.pyc,,
diaparser/resources/__pycache__/prepare.cpython-37.pyc,,
diaparser/resources/common.py,sha256=BxUlS_pe2pIabWjxUu1uS2BPieGS8m7id3SeKAomTpQ,13363
diaparser/resources/prepare.py,sha256=HSopfLhOs98grxznVVTB8jDv-6x0WZtQOnO6VAODwsw,4380
diaparser/resources/release.py,sha256=Hbe2HcC532hJL6LMnUmTSGzFfaRA_iWd6jNhm-W7A64,230
diaparser/utils/__init__.py,sha256=3_s_AtltzA_Go-aEmDB8dmzrsBtP2-ApqrXEkXqqBps,679
diaparser/utils/__pycache__/__init__.cpython-37.pyc,,
diaparser/utils/__pycache__/alg.cpython-37.pyc,,
diaparser/utils/__pycache__/common.cpython-37.pyc,,
diaparser/utils/__pycache__/config.cpython-37.pyc,,
diaparser/utils/__pycache__/corpus.cpython-37.pyc,,
diaparser/utils/__pycache__/data.cpython-37.pyc,,
diaparser/utils/__pycache__/embedding.cpython-37.pyc,,
diaparser/utils/__pycache__/field.cpython-37.pyc,,
diaparser/utils/__pycache__/fn.cpython-37.pyc,,
diaparser/utils/__pycache__/logging.cpython-37.pyc,,
diaparser/utils/__pycache__/metric.cpython-37.pyc,,
diaparser/utils/__pycache__/parallel.cpython-37.pyc,,
diaparser/utils/__pycache__/transform.cpython-37.pyc,,
diaparser/utils/__pycache__/vocab.cpython-37.pyc,,
diaparser/utils/alg.py,sha256=B9P65xHySzJcx6qb4mau6DdurKJihJLhLHOKBQ5PBOU,24571
diaparser/utils/common.py,sha256=8qM3F0cRxZ9UBPwlfIL9e9FAOfU0yU37tLDsdvhdS0g,81
diaparser/utils/config.py,sha256=h380sSC1BaWUvn9hyilCYAuivYlY2yfJ4wjk_16VDhQ,1386
diaparser/utils/corpus.py,sha256=ch0sbjK1mKEJUKjoPGSKxzYNwQXUQSCBs7JqoALsTF0,5444
diaparser/utils/data.py,sha256=v1niIP6EJQ7XaAaKjl91hU8rk7jpA3mMtADlY0ZYzd4,7007
diaparser/utils/embedding.py,sha256=ZFMwWOkAiUdbKU2x6Qyx54i4yM1Dc0aeRxo-2O7meKw,982
diaparser/utils/field.py,sha256=wKM7ouC8qp1Dbvbol5Ij21L3_tj3hItpar3AmF8GUqs,15414
diaparser/utils/fn.py,sha256=f2szKVvfyK_8e-ZQ29S6z9cHaHkXP4iPifsdR47dwVU,3138
diaparser/utils/logging.py,sha256=FKDEx1Qs1iQShuSSljJd-CCm6seEEogLjvxpBSIIUJc,1415
diaparser/utils/metric.py,sha256=iOxVcBJmb5Db_qVu2EtoXr77m1NVjXLDmICSZiRpwhI,1816
diaparser/utils/parallel.py,sha256=dNkD4cjPHXOAAnWatcAw5r0lnUgXGnkRJ039EMEQXWk,1044
diaparser/utils/transform.py,sha256=ecNNUZBXfArsNRrK1oUKGKbdUEnaKR3OaUo7BGhGuVU,24755
diaparser/utils/vocab.py,sha256=4k7BNALdoqaqOx2GRhdBL8ZY8NrcFkM5w47oGn05MR4,2669
tests/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
tests/__pycache__/__init__.cpython-37.pyc,,
tests/__pycache__/test_alg.cpython-37.pyc,,
tests/__pycache__/test_parse.cpython-37.pyc,,
tests/__pycache__/test_tokenizer.cpython-37.pyc,,
tests/__pycache__/test_transform.cpython-37.pyc,,
tests/test_alg.py,sha256=ZQXCk0vC1cCCUu7VmG-0RcznSfzmi4G43nFAJI_NVLM,540
tests/test_parse.py,sha256=1URiugLypq9H3_Lw4v7cLop9NgIEp2quMy0ueieezcA,248
tests/test_tokenizer.py,sha256=6DZTAHXK79FC_zyqlNIF4NZgwZMybHMbEumNU1VYtew,1417
tests/test_transform.py,sha256=A-6UOJSktFwE5Dmn5jdi-SM7VI70zYfNatUs1AP0Tm8,2585
tokenizer/__init__.py,sha256=8mjbDv2GDnc7OxO-ZwN9NJtynyxOshvuWczXyMOi-io,83
tokenizer/__pycache__/__init__.cpython-37.pyc,,
tokenizer/__pycache__/tokenizer.cpython-37.pyc,,
tokenizer/tokenizer.py,sha256=drqeo21O-JcmOsE6lAsMD5Rtqzwp3wNL5laDMKcsrjo,2370

diaparser installs some files under the directories diaparser tests and tokenizer. How do we think about this?