Databricks Platform Engineer

Navlakha Management Services; Pune District, Thiruvananthapuram; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

Navlakha Management Services seeks a Databricks Platform Engineer to design, deploy, and operate a secure, scalable Databricks platform across Azure and AWS in a regulated, multicloud environment. You will enable data engineers and AI teams by building automated, well-governed data foundations and reusable platform components.

You will collaborate with data scientists, cloud, and security teams to optimize performance, implement governance, and support AI/ML workloads at scale.

Qualifications

• Hands-on Databricks engineering in enterprise environments.
• Experience with multi-cloud deployments (Azure AWS).
• IaC tooling and CI/CD platforms to automate platform lifecycle.
• Strong focus on security, governance, and data privacy.

Responsibilities

• Engineer, deploy, and operate Databricks workspaces, clusters, jobs, and ML runtimes across Azure, AWS, and multi-cloud architectures.
• Build and manage automated CI/CD pipelines, infrastructure-as-code, and platform lifecycle processes.
• Ensure platform reliability, observability, and cost efficiency through monitoring and optimization.
• Enable scalable data ingestion, transformation, and processing pipelines using Delta Lake and Unity Catalog.
• Collaborate with AI/ML teams, data engineers, cloud and security teams to integrate Databricks with enterprise ecosystems.

Skills

Databricks platform

Multi-cloud

IaC (Terraform, Pulumi, ARM/Bicep)

CI/CD pipelines

Security & governance

Delta Lake & Unity Catalog

Collaboration across teams

Tools

Terraform

Pulumi

ARM/Bicep

GitHub Actions

Azure DevOps

GitLab

Databricks

Delta Lake

Unity Catalog

Job description

We are hiring a Databricks Platform Engineer

Description

Are you passionate about building enterprisegrade data platforms that power both advanced analytics

and nextgeneration Agentic AI solutions?

Join us as a Databricks Platform Engineer, where you will play a key role in engineering, scaling, and

operating our enterprise Databricks platform across a highly regulated, multicloud environment. You will

enable data engineers, AI/ML teams, and downstream platform consumers by building a secure,

automated, and wellgoverned data foundation.

In this role, you will work at the intersection of data engineering, platform engineering, and AI

enablement.

You will design and automate cloud-native platform components, implement governance frameworks,

optimize performance, and ensure compliance with strict security and dataprivacy requirements.

What you do

Platform Engineering & Operations

• Engineer, deploy, and operate Databricks workspaces, clusters, jobs, and ML runtimes across Azure, AWS, and multi-cloud architectures.
• Build and manage automated CI/CD pipelines, infrastructure-as-code (IaC), and platform lifecycle processes (provisioning, scaling, upgrades).
• Ensure platform reliability, observability, and cost efficiency through proactive monitoring, tuning, and optimization.

Data Platform & AI Enablement

• Enable scalable data ingestion, transformation, and processing pipelines using Delta Lake, Unity Catalog, and Databricks Jobs/Workflows.
• Collaborate with AI/ML teams to support feature stores, model training pipelines, and data services powering Agentic AI use cases.
• Implement and maintain enterprise-wide metadata, lineage, and data quality controls.

Governance, Security & Compliance

• Ensure strong security baselines, including Identity & Access Management (IAM), network isolation, data encryption, secret management, and secure cluster configurations.
• Implement governance guardrails aligned with regulatory, compliance, and risk frameworks (e.g., GDPR, financial regulations).
• Enforce platform standards, policies, cluster controls, and workspace configurations across Operating Entities.

Automation & Tooling

• Build reusable automation components, templates, and frameworks for platform onboarding and daytoday operations.
• Support the development of monitoring dashboards, alerting systems, and platform health indicators.

Collaboration & Support

• Work with data engineers, data scientists, AI architects, cloud teams, and security teams to ensure seamless integration of Databricks with enterprise data and AI ecosystems.
• Troubleshoot platform issues and support stakeholders in building robust, scalable workloads.
• Contribute to platform documentation, best practices, and engineering playbooks.

What you bring

• Hands‑on engineering experience with Databricks in enterprise environments (Azure or AWS; multi-cloud preferred).
• Strong understanding of Delta Lake, Unity Catalog, cluster architectures, Databricks Jobs/Workflows, and ML runtimes.
• Solid expertise in IaC tools such as Terraform, Pulumi, or ARM/Bicep, and CI/CD platforms such as GitHub Actions, Azure DevOps, or GitLab.
• Deep knowledge of data platform architecture, including ingestion pipelines, ETL/ELT patterns, data governance, lineage, and data quality frameworks.
• Experience operating platforms in regulated, security-sensitive industries, ensuring compliance and strong platform governance.
• Familiarity with enabling AI/ML workloads, data products, feature engineering, or MLOps pipelines.
• Strong grounding in cloud-native engineering, distributed systems, and event-driven architectures.
• Ability to work collaboratively across cross-functional engineering, cloud, security, and AI teams.