Python Developer IN - Jaipur

iCapital Network, Inc.; Jaipur; On-site; INR 1,200,000 - 1,800,000; Full time

Benefits offered by this job

Equity for all full-time employees

Healthcare with 100% employer-paid健康和牙

Job summary

iCapital Network, Inc. is seeking an experienced engineer to design and implement robust scraping solutions using Python, Playwright, and AWS. You will architect serverless pipelines with Lambda, Step Functions, and S3, ensuring scalable, reliable data extraction across portals and APIs.

Ideal candidates have 5+ years in Python, strong web scraping skills, and familiarity with CI/CD, Docker, and IaC. The role emphasizes secure data handling and collaboration on architectural decisions while

Qualifications

• 5+ years of experience in Python development, with a strong focus on automation and data extraction.
• Proven expertise in web scraping using Playwright, Selenium, Scrapy, BeautifulSoup, and requests.
• Proficient in deploying and managing scraping workloads in AWS, particularly Lambda, S3, IAM, CloudWatch, and Secrets Manager.
• Comfortable working with APIs, JSON/XML, and data transformation.
• Experience with CI/CD pipelines, Docker, and infrastructure as code (e.g., CloudFormation, Terraform).
• Familiarity with data pipeline orchestration tools such as Apache Airflow or AWS Step Functions.
• Prior experience scraping from secure or enterprise-level portals (e.g., financial, healthcare, legal).
• Background in data engineering or ETL workflows is a plus.
• Exposure to Python testing frameworks and writing unit/integration tests.

Responsibilities

• Assist with the design and implementation of advanced scraping solutions using Python, Playwright, and AWS services.
• Architect scraping pipelines using serverless AWS components such as Lambda, Step Functions, S3, CloudWatch, and Secrets Manager.
• Build systems that scale to support high volumes of data extraction with fault tolerance, retries, and intelligent logging.
• Integrate and manage complex workflows across multiple portals, APIs, and data sources.
• Contribute to architectural decisions, tooling, and best practices.

Skills

Python development

Automation

Data extraction

Web scraping

AWS deployments

APIs/JSON/XML

CI/CD

Docker

Airflow / Step Functions

Testing frameworks

Education

Bachelor’s or Master’s in CS/SE

Tools

Playwright

Selenium

Scrapy

BeautifulSoup

requests

Lambda

S3

IAM

CloudWatch

Secrets Manager

CloudFormation

Terraform

Docker

Apache Airflow

AWS Step Functions

Job description

You will assist in architecting and building robust, secure, and scalable scraping solutions that interact with complex web applications and secured portals.

Responsibilities:

• Assist with the design and implementation of advanced scraping solutions using Python, Playwright, and AWS services.
• Architect scraping pipelines using serverless AWS components such as Lambda, Step Functions, S3, CloudWatch, and Secrets Manager.
• Build systems that scale to support high volumes of data extraction with fault tolerance, retries, and intelligent logging.
• Integrate and manage complex workflows across multiple portals, APIs, and data sources.
• Contribute to architectural decisions, tooling, and best practices.

Qualifications:

• 5+ years of experience in Python development, with a strong focus on automation and data extraction.
• Proven expertise in web scraping using tools like Playwright, Selenium, Scrapy, BeautifulSoup, and requests.
• Proficient in deploying and managing scraping workloads in AWS, particularly Lambda, S3, IAM, CloudWatch, and Secrets Manager.
• Comfortable working with APIs, JSON/XML, and data transformation.

Preferred Qualifications:

• Experience with CI/CD pipelines, Docker, and infrastructure as code (e.g., CloudFormation, Terraform).
• Familiarity with data pipeline orchestration tools such as Apache Airflow or AWS Step Functions.
• Prior experience scraping from secure or enterprise-level portals (e.g., financial, healthcare, legal).
• Background in data engineering or ETL workflows is a plus.
• Exposure to Python testing frameworks and writing unit/integration tests.

Education:

• Bachelor’s or Master’s degree in Computer Science, Software Engineering, or related field, or equivalent professional experience.

We believe the best ideas and innovation happen when we are together. Employees in this role will work in the office four days, with the flexibility to work remotely one day (Friday).

iCapital offers a comprehensive benefits package that includes a total compensation program consisting of competitive salary, annual performance bonus, and equity for all full-time employees; healthcare with 100% employer-paid health and dental insurance; and generous paid time off (PTO).