Skip to content
This repository has been archived by the owner on Aug 31, 2020. It is now read-only.

armbreaker/armbreaker-scraper

Repository files navigation

Armbreaker

Armbreaker is a tool to scrape and visualize like information from XenForo forums such as Spacebattles.com. This repository contains the backend scraping code used to extract data from the site.

Requirements

  • PHP 7.3
  • Composer
  • A SQL database that doctrine/dbal can use (tested with mysql8)

Installation

Manual/Unmanaged installation

  1. composer install
  2. Fill your database with armbreaker.sql (note: file outdated rn)
  3. set config.php with the database credentials and a unique ID (0..255)
  4. fire up one (1) instance of runFaerieQueen.php per cluster and however many runShard.php you want. Recommended to limit yourself to one Shard per IP addr / network interface.

Automatic installation

(this will automatically spin up additional Shards based on demand. WIP.)

Vagrant

(old info)

  1. Install Vagrant
  2. Install Virtualbox
  3. vagrant up in the armbreaker directory
  4. visit localhost:8080
  5. optimal: vagrant ssh in the armbreaker directory to get access to the virtual server
  6. for phpmyadmin: http://localhost:8080/phpmyadmin

Vagrant Box Specs

Vagrant creates a private network with you, so only your computer can reach it.
Database passsword for root is: armbreaker