Skip to content

redokun/centipede-crawler

 
 

Repository files navigation

Centipede Crawler Build Status

Crawls all unique links.

Usage

$urls = (new Centipede\Crawler('http://dev.umpirsky.com'))->crawl();

Asynchronous

(new Centipede\Crawler('http://dev.umpirsky.com'))->crawl(function ($url, GuzzleHttp\Message\FutureResponse $response) {
    printf('(%d) %s', $response->getStatusCode(), $url);
});

Packages

No packages published

Languages

  • PHP 100.0%