Job Listings Scraper is a Python-based web scraping tool that extracts job listings from Indeed based on user-provided skills and location. The script collects data such as job title, company, location, posting date, and the application link, and saves it into a CSV file for easy analysis and reference.
- Scrapes job listings from Indeed based on specified skills and location.
- Extracts relevant details about each job.
- Saves the data into a CSV file for easy reference.
-
Clone the repository:
git clone https://github.com/your-username/job-listings-scraper.git cd job-listings-scraper
-
Create a virtual environment and activate it:
python -m venv venv source venv/bin/activate # On Windows use `venv\Scripts\activate`
-
Install the required packages:
pip install -r requirements.txt
-
Run the script:
python scraper.py
- When prompted, enter the skill you're looking for.
- Enter the location for the job search.
- Enter the number of pages you want to scrape.
- The script will fetch the job listings, extract the required details, and save them into a CSV file named
{Skill}_{Location}_Jobs.csv
.
The script performs the following steps:
- Fetch the webpage: The script sends a request to Indeed with the specified skill and location and fetches the HTML content.
- Parse HTML: It uses BeautifulSoup to parse the HTML content.
- Extract Data: The script finds all job listings and extracts details such as job title, company, location, posting date, and application link.
- Save Data: The extracted data is saved into a CSV file using the
csv
module.
requests
beautifulsoup4
You can install the required packages using:
pip install requests beautifulsoup4