Databricks Engineering Manager

Unison Group

Bengaluru

On-site

INR 4,000,000 - 6,000,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Unison Group in Bengaluru, India seeks an experienced Data Engineering Manager to lead a team delivering scalable data solutions on Databricks and Lakehouse architectures.

You will shape engineering standards, drive data governance, and collaborate across business, analytics and security to deliver reliable, cost-efficient data platforms. You will mentor engineers, manage delivery, and champion modern data practices in a fast-growing environment.

Qualifications

  • Bachelors or Masters in CS/Engineering/Data Science or related field.
  • Experience leading data engineering teams and projects.
  • Hands-on Databricks and Lakehouse architectures.
  • Proficient in Spark/PySpark, SQL and Python.
  • Experience with CI/CD, automated testing and monitoring.
  • Knowledge of data governance, security and privacy.

Responsibilities

  • Lead and mentor a data engineering team, setting technical direction.
  • Design, build and operate scalable data pipelines and Lakehouse solutions.
  • Define standards for ingestion, transformation, orchestration, testing and deployment.
  • Collaborate with business, analytics, data science, architecture, security and platform teams.
  • Champion reusable frameworks and Medallion Architecture patterns.
  • Embed data quality, governance, security and privacy controls.
  • Review designs, code and deployment approaches for reliability and maintainability.
  • Optimize Databricks workloads for performance, scalability, and cost.
  • Support Agile delivery, backlog refinement and roadmap development.

Skills

Databricks
Apache Spark
PySpark
SQL
Python
Data pipelines
CI/CD
Automation
Observability
Stakeholder management

Education

Bachelor's degree
Master's degree

Tools

Azure Databricks
Unity Catalog
Azure DevOps
Git
Infrastructure as Code

Job description

Role Summary

We are seeking an experienced Data Engineering Manager with strong Databricks and modern cloud data engineering expertise to lead the design, development and operation of scalable enterprise data solutions. The role combines technical leadership, people management, architecture oversight and delivery accountability. The successful candidate will establish engineering standards, reusable frameworks and robust practices for secure, governed, reliable and cost-efficient Lakehouse solutions.

Key Responsibilities
  • Lead, mentor and support a team of data engineers, setting technical direction and encouraging engineering best practices.
  • Design, build and operate scalable data pipelines and Lakehouse solutions using Databricks, Apache Spark, Delta Lake, SQL, Python and cloud-native services.
  • Define standards for ingestion, transformation, orchestration, automated testing, deployment, observability, monitoring and production support.
  • Collaborate with business, analytics, data science, architecture, security and platform teams to translate requirements into high-quality data solutions.
  • Champion reusable and metadata-driven frameworks, automation, Medallion Architecture patterns and modern data engineering practices.
  • Embed data quality, security, governance, privacy and compliance controls across pipelines and data products.
  • Review solution designs, code and deployment approaches to maintain consistency, resilience, maintainability and operational reliability.
  • Optimize Databricks workloads for performance, scalability, reliability and cost efficiency.
  • Support Agile delivery, including backlog refinement, sprint planning, estimation, risk management, continuous improvement and technical roadmap development.
Required Qualifications & Experience
  • Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, Data Science or a related discipline.
  • Significant professional experience in data engineering, including experience leading or managing data engineering teams.
  • Strong hands-on experience with Databricks and Lakehouse-based architectures.
  • Advanced proficiency in Apache Spark / PySpark, SQL, Python, Delta Lake, ETL/ELT, data pipeline development and orchestration.
  • Strong understanding of Medallion Architecture, distributed processing and modern cloud data-platform patterns.
  • Experience implementing CI/CD, automated testing, logging, monitoring, alerting and controlled deployment practices.
  • Working knowledge of data governance, lineage, data quality, security, privacy and role-based access control.
  • Proven experience optimizing large-scale workloads for performance, reliability and cost.
  • Experience conducting design and code reviews and establishing engineering standards.
  • Strong stakeholder management, problem-solving and written and verbal communication skills.
  • Preferred Qualifications
  • Experience with Azure Databricks, Unity Catalog and the broader Azure data ecosystem.
  • Experience building reusable, configuration-driven or metadata-driven ingestion and transformation frameworks.
  • Exposure to Azure DevOps, Git-based CI/CD, infrastructure as code and automated release controls.
  • Experience supporting production-grade data platforms and operational support models.
  • Understanding of dimensional modelling, enterprise data modelling and semantic or data-serving layers.
  • Databricks or relevant cloud certification.
  • Experience delivering governed data products for Power BI, analytics, AI/ML or advanced analytics.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Manager - Databricks
Data Manager - Databricks

Unison Group • Bengaluru

On-site
INR 3,500,000 - 6,000,000
Data Engineering Manager - Databricks & Lakehouse
Data Engineering Manager - Databricks & Lakehouse

Unison Group • Bengaluru

Hybrid
INR 2,500,000 - 4,200,000
Databricks Architect
Databricks Architect

Experion Technologies • Ernakulam

On-site
INR 4,000,000 - 7,000,000
Sr. Databricks Engineer
Sr. Databricks Engineer

ExlService Holdings, Inc. • Pune District

Hybrid
INR 3,500,000 - 6,500,000
Senior Databricks Engineer
Senior Databricks Engineer

DATABEAT • Hyderabad

On-site
INR 1,500,000 - 2,500,000
Databricks Developer / Data Architect
Databricks Developer / Data Architect

ExlService Holdings, Inc. • India

Hybrid
INR 1,500,000 - 2,100,000
Senior Databricks Engineer
Senior Databricks Engineer

Value Vision • Bengaluru

On-site
INR 4,200,000 - 6,600,000
Databricks Senior Architect
Databricks Senior Architect

Vrinda Global • Bengaluru

On-site
INR 3,000,000 - 6,000,000
Databricks Developer / Data Architect
Databricks Developer / Data Architect

Mployee.me • Pune District

Hybrid
INR 2,500,000 - 4,500,000
Senior Architect_Databricks
Senior Architect_Databricks

Tredence • Kolkata District, Pune District, Chennai

Hybrid
INR 3,500,000 - 7,500,000