Sr. Developer

Cognizant Technology Solutions Corporation; India; Remote; INR 700,000 - 1,100,000; Full time

Job summary

Cognizant in PAN India is seeking an experienced Python Developer to lead web data scraping and automation using Selenium, Beautiful Soup, and Python. You will build robust scraping solutions for dynamic sites and complex HTML structures.

The role involves analyzing DOM elements, handling pagination, iframes, and cookies, and delivering clean, structured data for downstream consumption while collaborating with technical and business teams.

Qualifications

• Experience with Python for web scraping and data extraction.
• Hands-on experience with Selenium for web automation.
• Experience parsing HTML with Beautiful Soup and similar libraries.

Responsibilities

• Develop and maintain web scraping and data extraction solutions using Python and Selenium.
• Use Beautiful Soup (bs4) and other Python libraries for HTML parsing and data extraction.
• Analyze website structures, DOM elements, HTML, and network behavior to identify and extract required data.
• Handle dynamic content, pagination, iframes, pop-ups, cookies, sessions, and other website-specific challenges.
• Develop reusable and scalable scraping frameworks and utilities.
• Implement appropriate error handling, logging, retry mechanisms, and exception handling for scraping processes.
• Clean, validate, transform, and structure scraped data for downstream consumption.
• Troubleshoot and optimize existing scraping scripts for performance, reliability, and accuracy.
• Work with REST APIs and JSON data where required for data extraction.
• Collaborate with technical and business teams to understand data requirements and deliver reliable scraping solutions.

Skills

Python

Selenium

Beautiful Soup

Tools

REST APIs

BeautifulSoup

Job description

Job Description Python + Selenium Developer

Location- PAN India

Role Overview - We are looking for experienced Python Developers with strong hands-on experience in web data scraping, web automation, and data extraction. The ideal candidate should have expertise in building robust web scraping solutions using Selenium, Beautiful Soup, and Python and be comfortable working with dynamic and complex websites.

Key Responsibilities

• Develop and maintain web scraping and data extraction solutions using Python and Selenium.


• Use Beautiful Soup (bs4) and other Python libraries for HTML parsing and data extraction.


• Analyze website structures, DOM elements, HTML, and network behavior to identify and extract required data.


• Handle dynamic content, pagination, iframes, pop-ups, cookies, sessions, and other website-specific challenges.


• Develop reusable and scalable scraping frameworks and utilities.


• Implement appropriate error handling, logging, retry mechanisms, and exception handling for scraping processes.


• Clean, validate, transform, and structure scraped data for downstream consumption.


• Troubleshoot and optimize existing scraping scripts for performance, reliability, and accuracy.


• Work with REST APIs and JSON data where required for data extraction.


• Collaborate with technical and business teams to understand data requirements and deliver reliable scraping solutions.