EPAM Chennai - Hiring Data Engineers

Epam Systems; Chennai; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Epam Systems in Chennai & Pune seeks a Data Engineer with 6+ years of experience to design and implement scalable data pipelines using Spark and Python. You will build cloud-based data solutions on AWS or GCP, optimize ETL processes, and collaborate with cross-functional teams to deliver reliable data-driven insights.

The role requires hands-on experience with Databricks, Delta Lake, and cloud services, ensuring data quality and performance across platforms.

Qualifications

• 6+ years of experience in data engineering.
• Strong Python, PySpark and SQL skills.

Responsibilities

• Develop scalable data pipelines using Spark and Python.
• Design and implement cloud-based data solutions on AWS or GCP.
• Build, optimize, and maintain ETL processes.
• Collaborate with cross-functional teams to deliver data-driven solutions.
• Ensure data quality, performance, and reliability across platforms.

Skills

Python

PySpark

SQL

Databricks

Spark tuning

AWS

GCP

Delta Lake

ETL pipelines

Data warehousing

Databricks Workflows

Job description

Data Engineer (Spark, Python, AWS/GCP, Databricks)

Experience: 6+ YearsLocation: Chennai & Pune Location

Required Skills

• Strong experience in Python, PySpark, SQL
• Hands‑on experience with AWS + Databricks OR GCP + Databricks
• Experience in building and maintaining ETL/ELT pipelines
• Good understanding of Data Warehousing and Big Data concepts
• Experience with Spark performance tuning and optimization
• Hands‑on experience with Delta Lake, Databricks Workflows, Notebooks, Jobs, and Unity Catalog
• Experience with cloud services such as:
• AWS: S3, EMR, Glue, Athena
• GCP: GCS, Dataproc, BigQuery, Dataflow
• Experience working with relational and NoSQL databases

Responsibilities

• Develop scalable data pipelines using Spark and Python.
• Design and implement cloud-based data solutions on AWS or GCP.
• Build, optimize, and maintain ETL processes.
• Collaborate with cross-functional teams to deliver data-driven solutions.
• Ensure data quality, performance, and reliability across platforms.

Keywords: Spark, PySpark, "", SQL, Databricks, AWS, GCP, Delta Lake, ETL, Data Engineering.