AWS & Pyspark- Data Engineer-Immediate joiners only

EY; Pune District, Bengaluru, Delhi; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

EY is seeking a Data Engineer with strong expertise in AWS, PySpark, and Databricks to design, build, and optimize scalable data pipelines for large-scale distributed data processing.

The ideal candidate will collaborate with data analysts, scientists and stakeholders to deliver reliable data solutions, ensure data quality and governance, and continuously improve data workflows across cloud services.

Qualifications

• Strong experience in PySpark.
• Hands-on expertise with Databricks.
• In-depth knowledge of AWS services (S3, EMR, Glue, Lambda, etc.).
• Solid experience in Data Engineering concepts and ETL pipelines.
• Good understanding of distributed data processing.
• Strong SQL skills.

Responsibilities

• Design and develop scalable data pipelines using PySpark.
• Build and maintain data solutions on the Databricks platform.
• Work with AWS services for data storage, processing, and orchestration.
• Optimize data workflows for performance, scalability, and reliability.
• Handle large datasets and ensure efficient data processing and transformation.
• Collaborate with cross-functional teams (data analysts, scientists, stakeholders).
• Ensure data quality, integrity, and governance standards.
• Troubleshoot and improve existing data systems.

Skills

PySpark

Databricks

AWS (S3/EMR/Glue/Lambda)

Data Engineering & ETL pipelines

Distributed data processing

SQL

Education

Bachelors/Master’s in CS/Engineering or related field

Job description

Location: Pune / Chennai / Bangalore/Delhi NCR
Experience: 3.5+ years

Job Summary

We are looking for a Data Engineer with strong expertise in AWS, PySpark, and Databricks. The ideal candidate will design, build, and optimize scalable data pipelines and work on large-scale distributed data processing systems.

Key Responsibilities

• Design and develop scalable data pipelines using PySpark
• Build and maintain data solutions on Databricks platform
• Work with AWS services for data storage, processing, and orchestration
• Optimize data workflows for performance, scalability, and reliability
• Handle large datasets and ensure efficient data processing and transformation
• Collaborate with cross-functional teams (data analysts, scientists, stakeholders)
• Ensure data quality, integrity, and governance standards
• Troubleshoot and improve existing data systems

Mandatory Skills

• Strong experience in PySpark
• Hands-on expertise with Databricks
• In-depth knowledge of AWS (S3, EMR, Glue, Lambda, etc.)
• Solid experience in Data Engineering concepts and ETL pipelines
• Good understanding of distributed data processing
• Strong SQL skills

Qualifications

• Bachelors/Master’s degree in Computer Science, Engineering, or related field
• 3.5+ years of experience in Data Engineering

Soft Skills

• Strong problem-solving and analytical ability
• Effective communication and teamwork
• Ability to work in a fast-paced environment