Skip to content

Simple KSL Classifieds web scraper, because they don't have an API :(

Notifications You must be signed in to change notification settings

divsmith/kslwatchr

Repository files navigation

KSL Watchr

Installing and Running:

  • Clone repo or download zip

Frontend React/Backend GraphQL

  • Install Docker
  • In Terminal/PowerShell, CD to repo directory
  • run docker-compose up to create the new image based on node and our app
  • May need to install images
    • docker pull node:8.12.0
    • docker pull postgres:10
  • Browse to: localhost:3000
  • You can use ctrl + c to interrupt and stop the server then use docker-compose down to unbuild it cleanly

Backend Python Web Scraper

  • Install pipenv
  • In Terminal/PowerShell, CD to ./ksl-scraper
  • Install the dependencies pipenv install
  • If not installed, download and install Chrome or Chromium
  • Run by pipenv run python scraper.py

About

Simple KSL Classifieds web scraper, because they don't have an API :(

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published