You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In addition to a standard download, this importer supports streaming data directly from a ZIP archive over HTTP.
When we originally wrote it, we thought the idea of every part of Pelias supporting a "streaming" mode would lead to great functionality. In practice, it just made things brittle, and we generally prefer a discrete download step followed by an import process that does not use the network (except possibly to contact Elasticsearch).
Removing this importer's streaming mode would simplify the code and remove lots of issues we've had with streaming ZIP files, which are inherently hard to stream.
The text was updated successfully, but these errors were encountered:
In addition to a standard download, this importer supports streaming data directly from a ZIP archive over HTTP.
When we originally wrote it, we thought the idea of every part of Pelias supporting a "streaming" mode would lead to great functionality. In practice, it just made things brittle, and we generally prefer a discrete download step followed by an import process that does not use the network (except possibly to contact Elasticsearch).
Removing this importer's streaming mode would simplify the code and remove lots of issues we've had with streaming ZIP files, which are inherently hard to stream.
The text was updated successfully, but these errors were encountered: