investigate clearmash delete pipeline failure

[OriHoch]

last clearmash delete pipeline failed, might be related to other changes that were deployed

might be solved by itself once the other pipelines ran successfully

..datapackage_pipelines_mojp.common.processors.delete: /usr/local/lib/python3.6/site-packages/dotenv/main.py:24: UserWarning: Not loading  - it doesn't exist.
..datapackage_pipelines_mojp.common.processors.delete:   warnings.warn("Not loading %s - it doesn't exist." % dotenv_path)
..datapackage_pipelines_mojp.common.processors.load_elasticsearch_dbs_docs: /usr/local/lib/python3.6/site-packages/dotenv/main.py:24: UserWarning: Not loading  - it doesn't exist.
..datapackage_pipelines_mojp.common.processors.load_elasticsearch_dbs_docs:   warnings.warn("Not loading %s - it doesn't exist." % dotenv_path)
..datapackage_pipelines_mojp.clearmash.processors.filter_elastsicsearch_docs_to_delete: /usr/local/lib/python3.6/site-packages/dotenv/main.py:24: UserWarning: Not loading  - it doesn't exist.
..datapackage_pipelines_mojp.clearmash.processors.filter_elastsicsearch_docs_to_delete:   warnings.warn("Not loading %s - it doesn't exist." % dotenv_path)
..datapackage_pipelines_mojp.common.processors.load_elasticsearch_dbs_docs: INFO:base:HEAD http://10.240.0.7:9200/next-mojp-dev [status:200 request:0.008s]
..datapackage_pipelines_mojp.clearmash.processors.filter_elastsicsearch_docs_to_delete: /usr/local/lib/python3.6/site-packages/jsontableschema/model.py:48: UserWarning: Class models.SchemaModel is deprecated [v0.7-v1)
..datapackage_pipelines_mojp.clearmash.processors.filter_elastsicsearch_docs_to_delete:   warnings.warn(message, UserWarning)
..datapackage_pipelines_mojp.common.processors.delete: /usr/local/lib/python3.6/site-packages/jsontableschema/model.py:48: UserWarning: Class models.SchemaModel is deprecated [v0.7-v1)
..datapackage_pipelines_mojp.common.processors.delete:   warnings.warn(message, UserWarning)
..datapackage_pipelines_mojp.common.processors.load_elasticsearch_dbs_docs: INFO:base:GET http://10.240.0.7:9200/next-mojp-dev/common/_search?scroll=3h&size=1000 [status:200 request:0.238s]
(sink): /usr/local/lib/python3.6/site-packages/jsontableschema/model.py:48: UserWarning: Class models.SchemaModel is deprecated [v0.7-v1)
(sink):   warnings.warn(message, UserWarning)
..datapackage_pipelines_mojp.common.processors.load_elasticsearch_dbs_docs: Traceback (most recent call last):
..datapackage_pipelines_mojp.common.processors.load_elasticsearch_dbs_docs:   File "/mojp/clearmash/../datapackage_pipelines_mojp/common/processors/load_elasticsearch_dbs_docs.py", line 30, in 
..datapackage_pipelines_mojp.common.processors.load_elasticsearch_dbs_docs:     Processor.main()
..datapackage_pipelines_mojp.common.processors.load_elasticsearch_dbs_docs:   File "/usr/local/lib/python3.6/site-packages/datapackage_pipelines_mojp/common/processors/base_processors.py", line 54, in main
..datapackage_pipelines_mojp.common.processors.load_elasticsearch_dbs_docs:     spew(*cls(*ingest()).spew())
..datapackage_pipelines_mojp.common.processors.load_elasticsearch_dbs_docs:   File "/usr/local/lib/python3.6/site-packages/datapackage_pipelines/wrapper/wrapper.py", line 60, in spew
..datapackage_pipelines_mojp.common.processors.load_elasticsearch_dbs_docs:     for rec in res:
..datapackage_pipelines_mojp.common.processors.load_elasticsearch_dbs_docs:   File "/usr/local/lib/python3.6/site-packages/datapackage_pipelines_mojp/common/processors/base_processors.py", line 123, in _filter_resource
..datapackage_pipelines_mojp.common.processors.load_elasticsearch_dbs_docs:     row = self._filter_row(row)
..datapackage_pipelines_mojp.common.processors.load_elasticsearch_dbs_docs:   File "/mojp/clearmash/../datapackage_pipelines_mojp/common/processors/load_elasticsearch_dbs_docs.py", line 24, in _filter_row
..datapackage_pipelines_mojp.common.processors.load_elasticsearch_dbs_docs:     doc = dbs_doc["_source"]
..datapackage_pipelines_mojp.common.processors.load_elasticsearch_dbs_docs: KeyError: '_source'
..datapackage_pipelines_mojp.common.processors.load_elasticsearch_dbs_docs: INFO:base:DELETE http://10.240.0.7:9200/_search/scroll [status:200 request:0.001s]