Associate Software Developer

Intrics Solutions; Hyderabad; On-site; INR 600,000 - 1,200,000; Full time

Job summary

Intrics Solutions in Hyderabad, India, is seeking a web scraping developer to build and maintain Python-based scraping scripts. You will extract data from websites, handle pagination, and work with libraries such as BeautifulSoup, Requests, Selenium, and Scrapy.

The role requires understanding of HTML, CSS selectors, and XPath, plus basic knowledge of APIs, JSON, and HTTP status codes. SQL knowledge is a plus, and you should be prepared to troubleshoot data quality and website changes.

Qualifications

• Basic to intermediate knowledge of Python programming.
• Understanding of HTML, CSS, XPath, and web page structures.
• Hands-on experience with BeautifulSoup and Requests.
• Basic knowledge of Selenium or Scrapy.
• Understanding of JSON, APIs, HTTP requests, and response codes.
• Familiarity with SQL and databases is an advantage.
• Basic knowledge of Git or version control is preferred.
• Good analytical, debugging, and problem-solving skills.

Responsibilities

• Develop and maintain web scraping scripts using Python.
• Extract relevant data from websites based on business and project requirements.
• Work with libraries such as BeautifulSoup, Requests, Selenium, and Scrapy.
• Analyze website structures, HTML, CSS selectors, and XPath to identify relevant data elements.
• Handle pagination, cookies, sessions, headers, and basic API requests.
• Identify and resolve scraping errors, data inconsistencies, and website changes.
• Perform data validation and quality checks to ensure accuracy and completeness.
• Maintain existing scripts and troubleshoot issues in scheduled scraping jobs.
• Coordinate with team leads and QA teams to meet project requirements and delivery deadlines.
• Document scripts, issues, and process updates.

Skills

Python programming

HTML understanding

CSS selectors

XPath

Problem-solving

Tools

BeautifulSoup

Requests

Selenium

Scrapy

Job description

Role & responsibilities

• Develop and maintain web scraping scripts using Python.
• Extract relevant data from websites based on business and project requirements.
• Work with libraries such as BeautifulSoup, Requests, Selenium, and Scrapy.
• Analyze website structures, HTML, CSS selectors, and XPath to identify relevant data elements.
• Handle pagination, cookies, sessions, headers, and basic API requests.
• Identify and resolve scraping errors, data inconsistencies, and website changes.
• Perform data validation and quality checks to ensure accuracy and completeness.
• Maintain existing scripts and troubleshoot issues in scheduled scraping jobs.
• Coordinate with team leads and QA teams to meet project requirements and delivery deadlines.
• Document scripts, issues, and process updates.

Preferred candidate profile

• Basic to intermediate knowledge of Python programming.
• Understanding of HTML, CSS, XPath, and web page structures.
• Hands-on experience with BeautifulSoup and Requests.
• Basic knowledge of Selenium or Scrapy.
• Understanding of JSON, APIs, HTTP requests, and response codes.
• Familiarity with SQL and databases is an advantage.
• Basic knowledge of Git or version control is preferred.
• Good analytical, debugging, and problem-solving skills.
• Willingness to learn new tools, technologies, and website-specific scraping techniques.