VS01696 - Python AWS Developer

E4 Software Services Pvt Ltd.; India; On-site; INR 2,400,000 - 3,600,000; Full time

Job summary

E4 Software Services Pvt Ltd. is seeking a senior data engineer with deep hands-on experience in PySpark and Python to design, build and optimize scalable data pipelines.

The ideal candidate will leverage AWS Databricks and Spark clusters to process structured and unstructured data, apply best practices for version control, CI/CD, and performance tuning, and collaborate with cross-functional teams managing large cloud-based data platforms.

Qualifications

• 6+ years of relevant software industry experience.
• Strong hands-on PySpark for distributed data processing.
• Proven Python programming with production-grade code.
• Practical knowledge of AWS Databricks for large-scale pipelines.
• Experience with Spark clusters and cloud data platforms.
• Data engineering best practices: version control, CI/CD, performance tuning.

Skills

PySpark

Python

AWS Databricks

Spark clusters

Data pipelines

Version control

CI/CD

Performance tuning

Tools

AWS Databricks

AWS S3

EC2

CI/CD pipelines

Job description

• 6+ years of professional and relevant experience in software industry.
• Strong hands-on expertise in PySpark for distributed data processing and transformation.
• Proven experience with Python programming, including implementing reusable, production-grade code.
• Practical knowledge of AWS Databricks for building and orchestrating large-scale data pipelines.
• Demonstrated experience in processing structured and unstructured data using Spark clusters and cloud data platforms.
• Ability to apply data engineering best practices including version control, CI/CD for data pipelines, and performance tuning.

Preferred Skills:

• Working knowledge of SQL for data querying, analysis, and troubleshooting.
• Experience using AWS S3 for object storage and EC2 for compute orchestration in cloud environments.
• Understanding of cloud-native data architectures and principles of data security and governance.
• Exposure to BFSI domain use cases and familiarity with handling sensitive financial data.
• Familiarity with CI/CD tools and cloud-native deployment practices.
• Familiarity with ETL scripting and data pipeline automation.
• Knowledge of big data ecosystems and distributed computing.