Review patent process

[kermitt2]

This is an update and review of the task of patent and non-patent reference extraction from patent documents.

• Support of Deep Learning models with adapted segmentation of input sequences for training and prediction.
• Batch processing for prediction.
• Include a BidLSTM_CRF_FEATURES model, which improves significantly the extraction accuracy for NPL references as compared to CRF (+10 points F1-score), relatively similar for patent citations (+1 point F1-score). Note that the training also supports all BERT flavor, in particular Google BERT for Patents
• Update of the mapping of US application prefix numbers to years (for patent publication number normalization according to epodoc), up to 2021/2022.
• Review XML serialization to only include in the result XML paragraphs with references. References are given for each paragraphs (rather all at the end), with position offsets referencing the paragraph (and not all the document as before). This improve readability without changing the XML parser normally for getting the references.

With GPU and DL model, 8 threads, the processing 500 EP B publications took 775 seconds.

Related: grobid_client_python has been extended to process directories of patent files (ST36 or PDF), for example

grobid_client --input /media/lopez/data/document-quality-data/citation_recognition/patent/ground_truth/  --output resources/test_out/ --n 8 processCitationPatentST36

TODO: proper 10-fold cross evaluation of models, benchmark and optionnally automatic download of fine-tuned BERT large model for patents

[coveralls]

coverage: 39.783% (-0.1%) from 39.893%
when pulling 1ebc6c8 on review-patent
into 4816a7a on master.