Cloud Engineer

Birlasoft; Dadri, Pune District, Bengaluru; Hybrid; INR 2,400,000 - 4,200,000; Full time

Job summary

Birlasoft is seeking Cloud Data Platform Engineers to build and operate enterprise-scale Azure data environments. You will implement Fabric Lakehouses, Databricks pipelines, and Unity Catalog governance, while ensuring cost efficiency and strong platform reliability.

Ideal candidates bring 6–12 years of cloud data engineering or platform engineering experience with Terraform/Bicep, Azure DevOps or GitHub Actions, and FinOps exposure. On-site in India.

Qualifications

• 6–12 years in cloud data engineering or platform engineering roles.
• Strong hands‑on expertise with Azure Data Services (ADLS, ADF, Synapse, Key Vault, VNets).
• Deep experience with Azure Databricks (clusters, jobs, Delta Lake, DLT, Unity Catalog).
• Proficient in Microsoft Fabric (Lakehouse, Pipelines, Warehouse, Dataflows).
• Scripting and automation: Python, PowerShell, Bash, SQL, PySpark.
• IaC with Terraform/Bicep; CI/CD via Azure DevOps or GitHub Actions.

Responsibilities

• Cloud Platform Operations: manage and optimize Azure workloads (ADLS, VNets, Key Vault, ADF, Synapse, Fabric, Databricks).
• Configure and maintain Databricks clusters, jobs, DLT pipelines, Delta Lake storage, and Unity Catalog policies.
• Infrastructure as Code & CI/CD: build Terraform/Bicep templates and end-to-end pipelines for Databricks, Fabric, and Azure components.
• Automate deployment of notebooks, workflows, access policies, networking components, and Fabric artifacts.
• Enforce version control, release governance, and quality gates.
• FinOps, Cost Management & Capacity Planning: dashboards, budgets, and spend governance; cost optimization.
• Environment Management, Security & Governance: RBAC, ACLs, Unity Catalog grants, private endpoints, IAM controls.
• Monitoring, Observability & SRE: Azure Monitor, Log Analytics, Databricks metrics; runbooks and dashboards.
• Lead incident management, root-cause analysis and environment stabilization.

Skills

Azure Data Services

Azure Databricks

Microsoft Fabric

Unity Catalog governance

Terraform

Bicep

CI/CD pipelines

FinOps

SRE practices

Python

PowerShell

Bash

SQL

PySpark

Azure DevOps

GitHub Actions

Tools

Databricks

Fabric

Unity Catalog

Terraform

Bicep

Azure DevOps

GitHub Actions

Job description

We are seeking highly skilled Cloud Data Platform Engineers (45 resources) with deep hands-on expertise across Azure, Databricks, Microsoft Fabric, and Unity Catalog to strengthen our cloud data operations. These roles demand technical execution, not coordination—requiring strong engineering capabilities in infrastructure automation, FinOps, CI/CD, platform governance, environment management, and Site Reliability Engineering (SRE) practices.

The ideal candidates will have proven experience managing enterprise-scale data platforms, ensuring secure, reliable, cost-efficient, and well-governed cloud environments.

Key Responsibilities

1. Cloud Platform Operations
Manage and optimize Azure workloads—ADLS, VNets, Key Vault, ADF, Synapse, Fabric, Databricks.
Configure and maintain Databricks clusters, jobs, DLT pipelines, Delta Lake storage, and Unity Catalog policies.

It was pleasure speaking to you as discussed invite has been shared with you for Monday 11 AM and sent in a sperate email and below is JD.

Job Description: Cloud Data Platform Engineer / SRE (Azure | Databricks | Fabric | Unity Catalog)

Role Overview

Operationalize Fabric Lakehouses, Pipelines, Warehouses, and Semantic Models for production workloads.
Ensure robust platform governance across environments (DEV–QA–UAT–PROD).

InfrastructureasCode & CI/CD

Build and maintain Terraform/Bicep templates for environment provisioning and configuration.
Develop end-to-end CI/CD pipelines for Databricks, Fabric, and Azure components (ADO/GitHub).
Automate deployment of notebooks, workflows, access policies, networking components, and Fabric artifacts.
Enforce version control, release governance, and quality gates.

FinOps, Cost Management & Capacity Planning

Implement FinOps dashboards, alerts, budgets, and spend governance practices.
Perform Databricks and Fabric cost optimization—cluster sizing, autoscaling, idle management, job tuning.
Conduct capacity planning for compute, storage, Fabric engines, and Databricks workloads.
Develop cost-saving recommendations and automated consumption monitoring.

Environment Management, Security & Governance

Provision and manage Azure data environments with consistent policies and naming standards.
Configure RBAC, ACLs, Unity Catalog grants, service principals, network security, Managed Identities.
Implement governance standards for data access, lineage, audit logging, compliance, and risk mitigation.
Ensure secure connectivity using Private Endpoints, VNET integration, and enterprise IAM controls.

Monitoring, Observability & Platform Reliability (SRE)

Implement monitoring and alerting using Azure Monitor, Log Analytics, Databricks Metrics, Fabric Admin APIs.
Build runbooks, dashboards, and automated remediation workflows for platform reliability.
Conduct performance tuning of data workloads, Fabric pipelines, Databricks jobs, and storage layers.
Lead incident management, rootcause analysis, and environment stabilization efforts.

Required Skills & Experience

6–12 years in cloud data engineering, SRE, or platform engineering roles.
Strong hands‑on expertise with:
Azure Data Services (ADLS, ADF, Synapse, Key Vault, VNets)
Azure Databricks (clusters, jobs, Delta Lake, DLT, Unity Catalog)
Microsoft Fabric (Lakehouse, Pipelines, Warehouse, Dataflows)
Unity Catalog governance (catalogs, schemas, access policies, lineage)
Strong scripting and automation experience: Python, PowerShell, Bash, SQL, PySpark.
Experience with Terraform/Bicep for IaC.
Strong knowledge of Azure DevOps or GitHub Actions CI/CD pipelines.
Proven FinOps experience with cost governance and optimization across cloud workloads.
Experience in SRE practices—SLIs, SLOs, operational readiness, automated recovery.

Preferred Qualifications

Certifications in Azure Data Engineer, Azure DevOps Engineer, Databricks Data Engineer, FinOps Practitioner.
Experience in highly regulated environments (BFSI, Healthcare, Retail).
Understanding of zero-trust security models.

Suitable Job Titles

• Cloud Data Platform Engineer
• Databricks Platform Engineer
• Azure/Fabric DevOps Engineer
• Cloud DataOps / SRE Engineer
• Platform Reliability Engineer (Data Platforms)