Databrick Data Engineer

BDO India; Mumbai; On-site; INR 2,500,000 - 4,500,000; Full time

Job summary

BDO India in Mumbai is seeking an experienced Data Engineer to design, build and maintain scalable ETL/ELT pipelines using Databricks, PySpark, Spark SQL and Delta Lake. You will implement Lakehouse architectures and collaborate with analytics teams to deliver robust data models.

The role requires 5–8 years of experience with Databricks, strong SQL, and proficiency in Airflow, Git, and CI/CD. You will optimize performance, govern data with Unity Catalog and support ML pipelines.

Qualifications

• 5–8 years of data engineering experience.
• ,
• ],
• job_responsibilities_descriptionade=

Responsibilities

• Design, build and maintain ETL/ELT pipelines using Databricks and PySpark.

Skills

PySpark

Spark SQL

Python

SQL

Data modelling

Git

CI/CD

Delta Lake

Lakehouse Architecture

Tools

Databricks

Airflow

ADF

dbt

Unity Catalog

Databricks Workflows/Jobs

Job description

Role & responsibilities

• Design, build and maintain scalable ETL/ELT pipelines using Databricks, PySpark, Spark SQL and Delta Lake.
• Implement Lakehouse solutions using Bronze/Silver/Gold architecture.
• Optimise Spark jobs, clusters and workloads for performance and cost.
• Build Databricks Workflows/Jobs and integrate with Airflow, ADF or equivalent orchestration tools.
• Implement data-quality checks, monitoring and observability.
• Support ML feature pipelines and MLflow-based workflows.
• Work with Unity Catalog for governance, access control and lineage.
• Develop robust data models with business and analytics teams.
• Support Git-based CI/CD and Databricks Repos.
• Troubleshoot production data-pipeline issues and perform root-cause analysis.

Preferred candidate profile

• 5 to 8 years of Data Engineering experience
• Minimum 2 to 3 years of hands-on Databricks experience
• PySpark
• Spark SQL
• Python
• Delta Lake
• Lakehouse / Medallion Architecture
• Azure Databricks / AWS / GCP
• Unity Catalog
• Databricks Workflows / Jobs
• Spark performance and cluster optimisation
• Strong SQL and data modelling
• Airflow / ADF / dbt
• Git and CI/CD
• Data governance, security and lineage