Use file path instead of inode as identifier in the registry

[pvledoux]

Referencing the following issue:
https://discuss.elastic.co/t/some-lines-sent-to-logstash-are-truncated/79900/12

It will be great if we could use the file path instead of the inode in the registry for files that are not updated or renamed.
This could be configured per prospector like so:

filebeat:
  prospectors:

      - paths:
          - /var/data/logs/*.log
        document_type: log
        registry_identifier: path

It would be particularly useful when you import lot of old logs and delete the files immediately when filebeat as finished.

[ruflin]

Thanks for filing this issue. Currently some filebeat refactoring is ongoing: #4277 Part of this is also making the state handling more generic which is need for this feature.

[guanghaofan]

Referencing the following issue:
https://discuss.elastic.co/t/some-lines-sent-to-logstash-are-truncated/79900/12

It will be great if we could use the file path instead of the inode in the registry for files that are not updated or renamed.
This could be configured per prospector like so:

filebeat:
  prospectors:

      - paths:
          - /var/data/logs/*.log
        document_type: log
        registry_identifier: path

It would be particularly useful when you import lot of old logs and delete the files immediately when filebeat as finished.

this is real a good idea for some special case, and I think this just is a common feature.

[botelastic]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[botelastic]

This issue doesn't have a Team:<team> label.