Director / Associate DIrector - Cloud Engineering (Azure)

VidPro Consultancy Services; Bengaluru; On-site; INR 4,000,000 - 7,000,000; Full time

Benefits offered by this job

Hybrid work model

Exposure to cloud-scale data platforms

Job summary

A technology consultancy is seeking a Director/Associate Director – Cloud Engineering specializing in Databricks. This leadership position requires extensive experience in data engineering, project management, and technical expertise in building cloud-native data solutions using Azure. Ideal candidates should have a strong track record of delivering large-scale projects and managing teams effectively. This role offers a hybrid work environment across locations in Hyderabad, Pune, and Bangalore.

Qualifications

• 14+ years in data engineering, including 3+ years in leadership/director-level roles.
• Proven experience with Databricks, Delta Lake, and cloud data architecture.
• Strong background in building scalable ETL/ELT pipelines.
• Governance with Unity Catalog: metadata, access control, data lineage.
• Power BI dashboards and visualizations.

Responsibilities

• Lead multiple Databricks‑based data engineering projects.
• Manage project budgets, costing, staffing, and client expectations.
• Collaborate with clients on architecture, strategy, governance, and reporting.
• Mentor engineering teams across engagements and timelines.
• Collaborate with clients on architecture, strategy, governance, and reporting.
• Ensure high‑quality delivery aligned with best practices and business value.
• Drive end‑to‑end project delivery and client success.
• Communicate effectively in fast‑paced environments.
• Deliver scalable data solutions in cloud‑native environments.

Skills

Databricks

Azure data services

ETL/ELT pipelines

Data warehousing or lakehouses

Unity Catalog

Power BI or equivalent

Job description

Pay & Compensation

This range is provided by VidPro Consultancy Services. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Role Overview

We are seeking a Director/Associate Director – Cloud Engineering (Azure Stack) with a strong specialization in Databricks to lead multiple client engagements, drive end-to-end project delivery, and manage high-performing engineering teams. This strategic leadership role requires hands‑on technical expertise, excellent project and people management skills, and a track record of delivering large‑scale data engineering solutions in cloud‑native environments.

Responsibilities

• 14+ years in data engineering, including 3+ years in leadership/director-level roles
• Proven experience with Databricks, Delta Lake, and cloud data architecture
• Strong track record of project delivery, team management, and client success
• Excellent communication and leadership skills in fast‑paced environments
• Oversee and deliver multiple Databricks‑based data engineering projects
• Manage project budgets, costing, staffing, and client expectations
• Lead and mentor engineering teams across engagements
• Collaborate with clients on architecture, strategy, governance, and reporting
• Ensure high‑quality delivery aligned with best practices and business value

Required Skills

• Strong hands‑on experience with Databricks
• Deep hands‑on experience with Azure data services
• Strong background in building scalable ETL/ELT pipelines
• Proven experience in designing data warehouses or lakehouses
• Hands‑on experience implementing Unity Catalog
• Ability to work with business teams to build dashboards

Qualifications

• Databricks – Full‑platform expertise for scalable data solutions: Building and managing ETL pipelines, Delta Lake, notebooks, and job orchestration. Skilled in cluster optimization, workspace management, and integrating Databricks with Azure services.
• Cloud – Azure (preferred) or similar cloud environments: Design and deploy cloud‑native data architectures using Azure Data Lake, Azure Synapse, Azure Data Factory, and integration with Databricks.
• Data Engineering – Spark, PySpark, and Python: Build scalable, high‑performance ETL/ELT pipelines, write optimized production‑grade Python code for data transformation and orchestration.
• Data Warehousing & SQL: Dimensional modeling and complex SQL queries for analytics and reporting.
• Governance – Unity Catalog: Implement and manage metadata, access control, and data lineage.
• Reporting Tools – Power BI or equivalent: Build insightful dashboards and visualizations.

Required Experience

10–15 years in the field, with significant leadership experience.

Locations

• Hyderabad
• Pune
• Bangalore

Work Mode

Hybrid

Employment Type

Full‑time

Seniority Level

Director