Skip to content

Automatically extracts and normalizes an online article or blog post publication date

License

Notifications You must be signed in to change notification settings

nitinjavakid/article-date-extractor

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

33 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

version

License Downloads Gitter

About

articleDateExtractor (Article Date Extractor) is a simple open source Python module, built and maintained by Webhose.io, that automatically detects, extracts and normalizes the publication date of an online article or blog post.

Feature

  1. Extracting the publication date information when it is specified in a web page, with over 90% success rate.

A Quick Example

    import articleDateExtractor

    d = articleDateExtractor.extractArticlePublishedDate("http://edition.cnn.com/2015/11/28/opinions/sutter-cop21-paris-preview-two-degrees/index.html")

    print d

    d = articleDateExtractor.extractArticlePublishedDate("http://techcrunch.com/2015/11/29/tyro-payments/")

    print d

Installing

Available through pip:

    $ pip install articleDateExtractor

Alternatively, you can install from source:

    $ git clone https://github.com/Webhose/article-date-extractor
    $ cd article-date-extractor
    $ python setup.py install

Dependencies

About Webhose.io

At Webhose.io we crawl, structure, unify and aggregate data from millions of online sources (news sites, blogs, discussion forums, comments etc..), so the need for a scalable solution that will automatically extract and structure the unstructured web is critical. We use multiple signals and algorithms to automatically detect where the post text is, the author name, the comments, and of course the date. With articleDateExtractor (Article Date Extractor) we rely on the many "different types of standards" out there to automatically detect the date (with a success rate of over 90%).

About

Automatically extracts and normalizes an online article or blog post publication date

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%