Web Scraping Developer

Intrics Solutions; Ghaziabad District; On-site; INR 350,000 - 550,000; Full time

Job summary

Intrics Solutions is seeking a motivated Web Scraping Developer with about 1 year of Python experience to build and maintain scraping scripts for reliable data collection. You will work on extracting data from websites, handling pagination and basic APIs, and validating data quality.

You'll use BeautifulSoup, Requests, Selenium or Scrapy, and collaborate with QA to meet delivery timelines. A Computer Science/IT background is preferred.

Qualifications

• 1 year of hands-on web scraping or Python development
• Familiarity with HTML/CSS structures and web page selectors
• Experience with BeautifulSoup, Requests, Selenium or Scrapy
• Understanding of JSON, APIs, HTTP requests and response codes

Responsibilities

• Develop and maintain web scraping scripts using Python
• Extract data from websites per business requirements
• Identify data elements via HTML/CSS selectors and XPath
• Handle pagination, cookies, sessions, headers, and basic API calls
• Troubleshoot scraping issues and ensure data quality
• Document scripts and updates

Skills

Python programming

HTML/CSS structures

XPath

JSON/APIs

Data extraction

Problem solving

Team collaboration

Education

Bachelor's degree in Computer Science / IT

Tools

BeautifulSoup

Requests

Selenium

Scrapy

Git

SQL basics

Job description

Job Description: Web Scraping Developer

Experience: 1 Year
Department: Data Solutions
Employment Type: Full-Time

Job Summary

We are looking for a motivated Web Scraping Developer with around 1 year of experience in Python programming and web data extraction. The candidate will be responsible for developing, maintaining, and troubleshooting web scraping scripts to collect accurate and reliable data from websites while meeting project requirements and delivery timelines.

Key Responsibilities

• Develop and maintain web scraping scripts using Python.
• Extract relevant data from websites based on business and project requirements.
• Work with libraries such as BeautifulSoup, Requests, Selenium, and Scrapy.
• Analyze website structures, HTML, CSS selectors, and XPath to identify relevant data elements.
• Handle pagination, cookies, sessions, headers, and basic API requests.
• Identify and resolve scraping errors, data inconsistencies, and website changes.
• Perform data validation and quality checks to ensure accuracy and completeness.
• Maintain existing scripts and troubleshoot issues in scheduled scraping jobs.
• Coordinate with team leads and QA teams to meet project requirements and delivery deadlines.
• Document scripts, issues, and process updates.

Required Skills

• Basic to intermediate knowledge of Python programming.
• Understanding of HTML, CSS, XPath, and web page structures.
• Hands-on experience with BeautifulSoup and Requests.
• Basic knowledge of Selenium or Scrapy.
• Understanding of JSON, APIs, HTTP requests, and response codes.
• Familiarity with SQL and databases is an advantage.
• Basic knowledge of Git or version control is preferred.
• Good analytical, debugging, and problem-solving skills.
• Willingness to learn new tools, technologies, and website-specific scraping techniques.

Educational Qualification

• Bachelors degree in Computer Science, IT, or a related field is preferred.
• Relevant practical projects or internship experience may also be considered.

Experience

• Approximately 1 year of hands-on experience in web scraping, data extraction, or Python development.
• Candidates with strong practical knowledge and relevant projects may also be considered.

Preferred Attributes

• Attention to detail and commitment to data quality.
• Ability to work collaboratively in a team.
• Good communication and time-management skills.
• Proactive approach to learning and resolving technical challenges.

Key Performance Expectations

• Timely completion of assigned scraping tasks.
• Accuracy and completeness of extracted data.
• Effective troubleshooting and resolution of scraping issues.
• Adherence to coding standards and documentation practices.
• Continuous improvement in script reliability and execution efficiency.