ScrapeMaster

It is robust web scraping tool that focuses specifically on extracting data from the renowned e-commerce giant, Amazon. By leveraging Puppeteer's capabilities, I was able to navigate through Amazon's web pages, interact with elements, and effortlessly retrieve valuable product information.

How To Use

Create a post request to http://15.207.100.214:8000/ with body that contains search query in json format.
eg:

{
    "search":"smartphones"
}

Setup

Here are the steps to run ScrapeMaster in your system.

Step 1

Clone and cd to the repo

$ git clone https://github.com/harshit/ScarpeMaster
$ cd ScrapeMaster

Step 2

Download node modules

$ npm i

step 3

To run the Amazon scrapper run:

$ npm run amazon

step 4

To practice Puppeteer run:

$ npm run practice

Features

ScrapeMaster can retreive data from amazon product page and store it int json format

Contributing

Feel free to contribute by opening an issue.

License

This project is licensed under the MIT License.