Python Web Developer – Web Scraping / Data Extraction

Arting Digital Private Limited; United States; Remote; USD 70,000 - 120,000; Full time

Job summary

Arting Digital Private Limited is seeking a Python-focused data extraction specialist to join our full-time team. You will build web crawlers and Scrapy-based pipelines to extract structured data from client websites that do not support bulk downloads.

You'll analyze website structures, validate scraped data, and collaborate with the team to meet project deadlines, delivering accurate data of high quality for diverse client projects.

Qualifications

• Proven experience in Python programming.
• Experience in web scraping and data extraction.
• Understanding of web crawlers and automated data collection.
• Experience extracting structured data from customer websites.

Responsibilities

• Develop and implement web crawlers and scraping scripts using Python.
• Extract structured data from customer websites lacking bulk downloads.
• Analyze website structures, HTML pages, and web elements to locate data.
• Use Python libraries and frameworks for automated data extraction.
• Clean, validate, and organize scraped data for accuracy.
• Troubleshoot scraping issues and adapt to changed site structures.
• Work with client platforms to build and run data extraction workflows.
• Collaborate with the team to meet project timelines and data delivery needs.

Skills

Python

Web scraping

Data extraction

Web crawlers

Tools

BeautifulSoup

Scrapy

Selenium

Playwright

XPath

CSS selectors

SQL

Job description

Arting Digital Private Limited | Full time

Employment Type: Full-Time

Location:

Shift Timings: 2:00 PM to 11:00 PM IST

Experience: 4–9 Years

Key Technical Skills:

• Strong experience in Python programming.
• Experience in web scraping and data extraction.
• Understanding of web crawlers and automated data collection.
• Experience working with customer websites and extracting structured data.

Nice-to-Have Skills:

• BeautifulSoup, Scrapy, Selenium, Playwright.
• XPath and CSS Selectors.
• SQL and Database knowledge.

Key Responsibilities:

• Develop and implement web crawlers and scraping scripts using Python.
• Extract structured data from customer websites that do not support bulk data downloads.
• Analyze website structures, HTML pages, and web elements to identify relevant data.
• Utilize Python libraries and frameworks for automated data extraction.
• Clean, validate, and organize scraped data to ensure accuracy and consistency.
• Troubleshoot scraping issues and handle changes in website structures.
• Work with the client-provided platform to build and execute data extraction workflows.
• Collaborate with the team to meet project timelines and data delivery requirements.