Associate - Data Engineer-Data Engineering-Big Data Engineering

EXL; Maharashtra; On-site; INR 1,400,000 - 2,000,000; Full time

Job summary

EXL is seeking a data engineer with 5-7 years of experience to design and implement end-to-end data pipelines in a cloud-native Lakehouse environment. Strong hands-on with Databricks, Spark, Delta Lake, and SQL is required.

You will work across data modeling, ETL, and governance, leveraging Airflow or similar workflow tools, and exploring MLflow for MLOps; exposure to multiple cloud platforms is a plus. Maharashtra-based role with on-site collaboration.

Qualifications

• 5-7 years of data engineering experience with 2-3 years on Databricks.
• Strong expertise in Apache Spark and distributed data processing.
• Solid Delta Lake, Lakehouse architecture, and data modeling knowledge.
• Hands-on cloud experience: Azure, AWS, or GCP.
• Strong SQL for data manipulation and performance tuning.
• Experience with ETL frameworks and workflow orchestration.
• Familiarity with CI/CD, Git workflows, and DevOps.
• Exposure to MLOps and MLflow is a strong plus.
• Knowledge of data governance and security frameworks.

Skills

Databricks

Spark

PySpark

SQL

Data modeling

CI/CD

Tools

Azure Data Lake

AWS S3

GCP BigQuery/Storage

Delta Lake

Airflow

ADF

DBX Workflows

MLflow

Git

Job description

• 5-7 years of experience in data engineering, with at least 2-3 years of Databricks hands-on experience.
• Strong expertise in Apache Spark (PySpark/Scala/SQL) and distributed data processing.
• Solid experience with Delta Lake, Lakehouse architecture, and data modeling.
• Hands-on experience with at least one cloud platform: Azure Data Lake, AWS S3, or GCP BigQuery/Storage.
• Strong proficiency in SQL for data manipulation and performance tuning.
• Experience with ETL frameworks, workflow orchestration tools (Airflow, ADF, DBX Workflows).
• Good understanding of CI/CD, Git-based workflows, and DevOps practices.
• Exposure to MLOps and MLflow is a strong plus.
• Knowledge of data governance, cataloging, and security frameworks.