Walk-in | AWS / Azure Data Engineer

EPAM Systems Inc

Coimbatore

Hybrid

INR 1,200,000 - 2,400,000

Full time

7 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

EPAM Systems Inc is seeking a data engineer to design and develop scalable data pipelines using Python, PySpark, and Spark. The role involves building ETL/ELT workflows, writing complex SQL queries, and optimizing data processing.

You will work with Databricks to maintain data workflows and collaborate with global teams to deliver robust data solutions in cloud environments (AWS or Azure). The ideal candidate will handle large datasets, optimize Spark jobs, and contribute to performance

Responsibilities

  • Design and develop scalable data pipelines using Python, PySpark, and Spark.
  • Develop complex SQL queries and perform query optimization.
  • Build and maintain data processing workflows using Databricks.
  • Work with large datasets and develop ETL/ELT pipelines.
  • Optimize Spark jobs and improve data processing performance.
  • Implement cloud-based data solutions using AWS or Azure.
  • Collaborate with global teams to deliver data engineering solutions.

Tools

Python
PySpark
Spark
SQL
Databricks

Job description

  • Design and develop scalable data pipelines using Python, PySpark, and Spark.
  • Develop complex SQL queries and perform query optimization.
  • Build and maintain data processing workflows using Databricks.
  • Work with large datasets and develop ETL/ELT pipelines.
  • Optimize Spark jobs and improve data processing performance.
  • Implement cloud-based data solutions using AWS or Azure.
  • Collaborate with global teams to deliver data engineering solutions.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

Mags Consulting • Chennai

On-site
INR 1,200,000 - 2,200,000
Data Engineer_105823
Data Engineer_105823

MyCareernet • Kochi

On-site
INR 900,000 - 1,500,000
PySpark Data Engineer (AWS | Databricks | ETL)
PySpark Data Engineer (AWS | Databricks | ETL)

Infosys • Hyderabad

On-site
INR 1,200,000 - 1,800,000
Data Engineer
Data Engineer

Datamatics • Bengaluru, Mumbai

Hybrid
INR 900,000 - 1,400,000
Senior Data Engineer
Senior Data Engineer

CloudBoson • Dadri

On-site
INR 1,800,000 - 3,000,000
Data Engineer - PySpark | Spark | SQL
Data Engineer - PySpark | Spark | SQL

Infosys • Bengaluru

On-site
INR 1,200,000 - 2,500,000
Data Engineer_Spark/Scala
Data Engineer_Spark/Scala

Zorba AI • Mumbai

On-site
INR 1,000,000 - 1,500,000
Data Engineer | PySpark | Databricks | Azure Data Factory
Data Engineer | PySpark | Databricks | Azure Data Factory

Infosys • Hyderabad, Pune District, Bengaluru

Hybrid
INR 1,200,000 - 2,400,000
Data Engineer_Spark/Scala
Data Engineer_Spark/Scala

Zorba AI • Maharashtra

On-site
INR 800,000 - 1,200,000
Data Engineer_Spark/Scala
Data Engineer_Spark/Scala

Zorba AI • Kolkata District

On-site
INR 1,000,000 - 1,500,000