Python Developer (Web Scraping)

India Filings Pvt Ltd; Chennai District; On-site; INR 600,000 - 800,000; Full time

Job summary

India Filings Pvt Ltd is looking for a Python Developer (2-5 years) with hands-on experience in Web Scraping, Data Extraction, and Automation. You will build scalable scraping solutions using Python, Scrapy, BeautifulSoup, Selenium, Playwright, and Requests.

You will extract data from static and dynamic websites, handle JS rendering, authentication, cookies and pagination, and integrate scraped data into databases and APIs. Strong debugging and problem-solving skills are required.

Qualifications

• 2-5 years of Python development experience.
• Hands-on web scraping and data extraction skills.
• Experience with Scrapy, BeautifulSoup, Selenium, Playwright, Requests.
• Good knowledge of HTML, CSS, XPath, JSON, XML, and REST APIs.
• Experience with SQL/NoSQL databases.

Responsibilities

• Develop and maintain web scraping applications using Python.
• Extract data from static and dynamic websites.
• Build scraping solutions using Scrapy, BeautifulSoup, Selenium, Playwright, and Requests.
• Handle JavaScript-rendered websites, authentication, cookies, sessions, and pagination.
• Integrate scraped data into databases and APIs.
• Optimize scraping performance and ensure data quality.
• Troubleshoot scraping issues caused by website structure changes.
• Write clean, scalable, and maintainable Python code.

Skills

Python Development

Web Scraping

Automation

Tools

Scrapy

BeautifulSoup

Selenium

Playwright

Requests

Pandas

Job description

Python Developer Web Scraping

Experience: 2-5 Years
Location: Chennai
Employment Type: Full-time

Job Summary

We are looking for a Python Developer (2-5 years) with hands-on experience in Web Scraping, Data Extraction, and Automation. The ideal candidate should have strong Python programming skills and experience in building scalable web scraping solutions for collecting and processing data from various websites.

Key Responsibilities

• Develop and maintain web scraping applications using Python.
• Extract data from static and dynamic websites.
• Build scraping solutions using Scrapy, BeautifulSoup, Selenium, Playwright, and Requests.
• Handle JavaScript-rendered websites, authentication, cookies, sessions, and pagination.
• Integrate scraped data into databases and APIs.
• Optimize scraping performance and ensure data quality.
• Troubleshoot scraping issues caused by website structure changes.
• Write clean, scalable, and maintainable Python code.

Required Skills

• 2-5 years of experience in Python Development.
• Strong experience in Python, Web Scraping, and Automation.
• Hands-on experience with:
  • Scrapy
  • BeautifulSoup
  • Selenium
  • Playwright
  • Requests
  • Pandas
• Good knowledge of HTML, CSS, XPath, JSON, XML, and REST APIs.
• Experience with MySQL/PostgreSQL/MongoDB.
• Familiarity with Git and Linux environment.
• Strong debugging and problem-solving skills.

Good to Have

• Experience with FastAPI, Flask, or Django.
• Knowledge of Docker and AWS.
• Experience with Celery, Airflow, or scheduling tools.
• Knowledge of asynchronous programming (AsyncIO/Aiohttp).

Preferred Candidate

• Strong analytical and logical thinking.
• Excellent problem-solving skills.
• Good communication and teamwork.
• Ability to work independently and deliver high-quality solutions.

Location: Chennai
Experience: 2-5 Years