Armbreaker is a tool to scrape and visualize like information from XenForo forums such as Spacebattles.com. This repository contains the backend scraping code used to extract data from the site.
- PHP 7.3
- Composer
- A SQL database that doctrine/dbal can use (tested with mysql8)
composer install
- Fill your database with
armbreaker.sql
(note: file outdated rn) - set
config.php
with the database credentials and a unique ID (0..255) - fire up one (1) instance of
runFaerieQueen.php
per cluster and however manyrunShard.php
you want. Recommended to limit yourself to one Shard per IP addr / network interface.
(this will automatically spin up additional Shards based on demand. WIP.)
(old info)
- Install Vagrant
- Install Virtualbox
vagrant up
in the armbreaker directory- visit localhost:8080
- optimal:
vagrant ssh
in the armbreaker directory to get access to the virtual server - for phpmyadmin: http://localhost:8080/phpmyadmin
- Ubuntu 16.04.3
- git
- apache2 from ondrej/apache2
- php7.1 from ondrej/php
- php-xdebug ondrej/php
it is setup so you can debug you just need to set your host Xdebug follow this guide - php7.1-zip ondrej/php
- php7.1-xml ondrej/php
- php7.1-mbstring ondrej/php
- php7.1-mysql ondrej/php
- mysql-server-5.7
- phpmyadmin
- nodejs with latest 8.x installer
- build-essential
Vagrant creates a private network with you, so only your computer can reach it.
Database passsword for root is: armbreaker