Python Developer

Resources Valley; Jaipur; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Resources Valley is seeking an experienced Python Developer to design robust scraping solutions and automate complex portal interactions. You will use Playwright for browser automation, manage MFA flows, and deploy scalable tasks on AWS Lambda and related services.

The role focuses on building secure, scalable scraping pipelines across multiple portals and APIs, with emphasis on serverless architectures and CI/CD readiness.

Qualifications

• 5+ years of experience in Python development with a focus on automation and data extraction.
• Proven expertise in web scraping using Playwright, Selenium, Scrapy, BeautifulSoup, and requests.
• Experience handling multi-step authentication flows, including MFA, CAPTCHA solving, and session/cookie management.
• Proficient in deploying and managing scraping workloads in AWS, particularly Lambda, S3, IAM, CloudWatch, and Secrets Manager.
• Experience with asynchronous programming, headless browsers, and JavaScript-rendered content.
• Solid understanding of web protocols (HTTP/HTTPS, cookies, headers).

Responsibilities

• Assist with design and implementation of advanced scraping solutions using Python, Playwright, and AWS services.
• Automate interactions with JavaScript-heavy and authentication-secured websites, including MFA, CAPTCHA, and session flows.
• Architect scraping pipelines using serverless AWS components such as Lambda, Step Functions, S3, CloudWatch, and Secrets Manager.
• Build systems that scale to support high data volumes with fault tolerance, retries, and logging.
• Integrate and manage complex workflows across portals, APIs, and data sources.
• Contribute to architectural decisions, tooling, and best practices.

Skills

Python development

Automation

Data extraction

Web scraping

Asynchronous programming

Tools

Playwright

Selenium

Scrapy

BeautifulSoup

Requests

AWS Lambda

AWS S3

IAM

CloudWatch

Secrets Manager

Job description

We are looking for an experienced Python Developer with expertise in web scraping, automated portal interactions, and cloud-native deployment using AWS. The ideal candidate will have hands‑on experience working with Playwright for browser automation, managing multi-factor authentication (MFA) flows, and deploying scalable scraping tasks via AWS Lambda and related services.

You will assist in architecting and building robust, secure, and scalable scraping solutions that interact with complex web applications and secured portals.Role & responsibilities

Responsibilities:

• Assist with the design and implementation of advanced scraping solutions using Python, Playwright, and AWS services.


• Automate interactions with JavaScript-heavy and authentication-secured websites, including handling MFA, CAPTCHAs, and session/token-based login flows.


• Architect scraping pipelines using serverless AWS components such as Lambda, Step Functions, S3, CloudWatch, and Secrets Manager.


• Build systems that scale to support high volumes of data extraction with fault tolerance, retries, and intelligent logging.


• Integrate and manage complex workflows across multiple portals, APIs, and data sources.


• Contribute to architectural decisions, tooling, and best practices.

Qualifications:

• 5+ years of experience in Python development, with a strong focus on automation and data extraction.


• Proven expertise in web scraping using tools like Playwright, Selenium, Scrapy, BeautifulSoup, and requests.


• In-depth experience handling multi-step authentication flows, including multi-factor authentication (MFA), CAPTCHA solving, and session/cookie management.


• Proficient in deploying and managing scraping workloads in AWS, particularly Lambda, S3, IAM, CloudWatch, and Secrets Manager.


• Experience with asynchronous programming, headless browsers, and JavaScript-rendered content.


• Solid understanding of web protocols (HTTP, HTTPS, cookies, headers), and ability to reverse-engineer network calls and authentication mechanisms.


• Comfortable working with APIs, JSON/XML, and data transformation.