AWS Data Engineer

Zorba AI; Bengaluru; On-site; INR 1,500,000 - 2,600,000; Full time

Job summary

Zorba AI is seeking a Data Engineer to design and optimize scalable data pipelines using PySpark, Databricks, Python, SQL, and AWS. You will implement CI/CD for data workflows and contribute to cloud-native data architectures.

The role emphasizes building robust ETL processes, performance tuning, and data modeling in a collaborative, fast-paced environment with exposure to Delta Lake and workflow orchestration.

Qualifications

• Experience building ETL pipelines and data processing workloads.
• Cloud-based data engineering with AWS (S3, Glue, EMR/Lambda) and Delta Lake knowledge.
• Strong problem-solving and collaboration in fast-paced environments.

Responsibilities

• Develop data pipelines using PySpark and Databricks.
• Write efficient SQL queries for data extraction and transformation.
• Build reusable data transformation frameworks in Python and optimize workflows.
• Collaborate with teams to ensure data quality and scalable architectures.

Skills

PySpark

Databricks

Python

SQL

AWS

Job description

Job Title: Data Engineer – PySpark, Databricks, AWS

We are looking for a skilled Data Engineer with hands-on experience in PySpark, Databricks, Python, SQL, and AWS to build and optimize scalable data solutions. The ideal candidate should have experience designing and developing ETL pipelines, processing large datasets, and implementing data engineering best practices in a cloud environment.

Key responsibilities include developing data pipelines using PySpark and Databricks, writing efficient SQL queries, building reusable data transformation frameworks using Python, and leveraging AWS services such as S3, Glue, EMR, or Lambda for data processing. The candidate should be familiar with Delta Lake, performance optimization, data quality, and workflow orchestration. Experience with CI/CD, Git, Agile methodologies, and data warehouse concepts is preferred.

The ideal candidate should possess strong analytical and problem-solving skills, excellent communication abilities, and the capability to work in a collaborative, fast-paced environment. Knowledge of Spark optimization, data modeling, and cloud-native data architectures will be an added advantage.

Required Skills: PySpark, Databricks, Python, SQL, AWS

Experience: 3–8 years (or as per requirement)

Location: Open

Notice Period: Immediate to 30 days preferred

Skills: python,pyspark,sql,data,aws