Manager | Databricks + Pyspark | Mumbai | Engineering | Data Modernization & Migration

Deloitte & Touche GmbH Wirtschaftsprüfungsgesellschaft; Mumbai; On-site; INR 3,500,000 - 5,500,000; Full time

Job summary

Deloitte & Touche GmbH Wirtschaftsprüfungsgesellschaft in Mumbai seeks a Manager to lead Databricks-centric data platforms, bridging business needs with technical design. You will define standards, optimize Spark pipelines, and drive cost-efficient FinOps across Azure data services.

You will guide teams through end-to-end lifecycle management, ensuring scalable, secure, and compliant data solutions that align with strategic business goals.

Qualifications

• 7–10 years in data engineering with Azure Databricks experience.
• Expertise in end-to-end Data Lakehouse architectures.
• Proven Databricks FinOps experience (DBU consumption, cluster policies).
• Strong leadership in managing technical teams and project lifecycles.

Responsibilities

• Architect large-scale, enterprise data platforms on Databricks.
• Define and enforce standards for data modeling, Spark optimization, coding patterns.
• Drive FinOps by designing efficient cluster policies and resource optimization.
• Lead integration of Databricks with Azure Synapse, Power BI, and ML workflows.
• Oversee enterprise-wide data governance and security frameworks.
• Manage delivery of technical projects ensuring timelines and quality.

Skills

Databricks

Azure

FinOps

Leadership

Data Engineering

Education

Bachelor's/Master’s in CS

Job description

Select how often (in days) to receive an alert:

Job Title: Manager | Databricks + Pyspark | Mumbai | Engineering | Data Modernization & Migration

Role Overview: As a Manager, you will lead the technical strategy and delivery of Databricks-centric data platforms. You will bridge the gap between business requirements and technical architecture, ensuring that the Databricks ecosystem is scalable, cost-effective (FinOps), and perfectly integrated into the broader Azure data landscape.

Experience:

• 7–10 years of experience in data engineering, with significant experience architecting solutions on Azure Databricks.
• Expertise in designing end-to-end Data Lakehouse architectures.
• Proven experience in Databricks FinOps (managing DBU consumption and cluster policies).
• Strong leadership experience in managing technical teams and project lifecycles.

Key Responsibilities: Technical Skills:

• Architect large-scale, enterprise-grade data platforms using the DatabricksDataIntelligencePlatform.
• Define and enforce technical standards for data modeling, Spark optimization, and coding patterns.
• Drive Databricks FinOps initiatives by designing efficient cluster policies and optimizing resource utilization.
• Lead the integration of Databricks with Azure Synapse, Power BI, and advanced Machine Learning workflows.
• Oversee the implementation of enterprise-wide data governance and security frameworks.
• Manage technical project delivery, ensuring alignment with business timelines and quality standards.

Soft Skills:

• Strong leadership, mentorship, and people management abilities.
• Strategic thinking and ability to translate business needs into technical roadmaps.
• Excellent stakeholder management and communication skills.

Preferred Qualifications:

• Bachelor’s or Master’s degree in Computer Science or related field.
• Databricks Solutions Architect or Azure Solutions Architect certifications.