Distributed crawler powered by Headless Chrome

a reliable high-level web crawling & scraping framework for Node.js.

Collection of patches for puppeteer and playwright to avoid automation detection and leaks. Helps to avoid Cloudflare and DataDome CAPTCHA pages. Easy to patch/unpatch, can be enabled/disabled on demand.

Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head

Sasori is a dynamic web crawler powered by Puppeteer, designed for lightning-fast endpoint discovery.

Web crawling and document processing through a usable interface.

⛏ A versatile Web scraper for Node.js

Tutorial for web scraping / crawling with Node.js.

A crawler based on Phantom. Allows discovery of dynamic content and supports custom scrapers.

A web crawler that uses Firefox and js injection to interact with webpages and crawl their content, written in nodejs.

ProxyCrawl Node library for scraping and crawling

Crawling Udemy course info and save into JSON format.

Search for Slack Webhooks token publicly exposed on Github

A web page content extractor

b̶̡̪̬͒l̸̰̗̝̀ỏ̷̡̩g̴͇̑g̶̲̱̽͐i̵̹͗n̶̤̥͂̅̆g̴̮̾̅͜ ̷̧͎͆i̷̛͒͜͠n̸̥̺͒ ̶͚͚͊̿͜t̸̺͙̭̆̊̈́ḧ̶̟́̐e̸̱͔̟̓̓͝ ̶̨͔̾͛̑d̵̥̣̏ȧ̷̼̊r̷̰̝̥̅̌͝k̵̟̥̞̉̍͛

A Node.js XML DOM, Parser & Stringifier.

re-employment-kraken scrapes (job) sites, remembers what it saw and notifies downstream systems of any new sightings.

An interactive Command-Line Interface Build in NodeJS for downloading a single or multiple images to disk from URL

🕷️ Easily scrap the web for torrent and media files.