Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

auto-update "Updated" dates from in-list values #439

Closed
DandelionSprout opened this issue Sep 5, 2018 · 3 comments
Closed

auto-update "Updated" dates from in-list values #439

DandelionSprout opened this issue Sep 5, 2018 · 3 comments
Labels
directory-data changes to basic FilterLists data duplicate issue already exists

Comments

@DandelionSprout
Copy link
Contributor

DandelionSprout commented Sep 5, 2018

Many filterlists have info tags inside them á la ! Last updated:, ! Last modified:, ! Updated:, # Updated, # Generated on, # TimeUpdated:, ! TimeUpdated:, and so on. And those dates are almost always pretty accurate indicators for when a list was last updated. Therefore I propose that the Updated values on FilterLists.com could be auto-updated with such values whenever they are available.

There are admittedly a lot of date formats that'd need to be accounted for, e.g. 05 Sep 2018 (…), 05September2018(…), September 5, 2018, 2018-09-05 (…), and probably some other ones as well.

Edit: I also propose that lists whose such values are more than 730 days (2 non-leap years) ago could've had those dates auto-added to the "Discontinued" values as well, but that'd be merely a secondary bonus.

@collinbarrett collinbarrett added duplicate issue already exists enhancement directory-data changes to basic FilterLists data labels Sep 5, 2018
@collinbarrett
Copy link
Owner

closing as duplicate of #202

Capturing these dates is certainly on the roadmap. I am unsure whether we will use them as the primary source of the last updated date, however. I have found that some lists auto-update their date on a schedule even if the list hasn't actually changed at all.

However, in the latest changes to SnapshotService, I am determining if a list has been updated by its md5 hash, which will be different even if only the date metadata has changed. So, I guess that isn't as relevant anymore.

@collinbarrett
Copy link
Owner

opened #440 to capture your edit

@collinbarrett
Copy link
Owner

Fyi, on your last "Edit:", see: #440 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
directory-data changes to basic FilterLists data duplicate issue already exists
Projects
None yet
Development

No branches or pull requests

2 participants