Senior Data Platform Engineer

Birlasoft ( India ) Limited; India; On-site; INR 900,000 - 1,500,000; Full time

Job summary

Birlasoft ( India ) Limited is seeking a Senior Data Platform Engineer to build and scale enterprise-grade data pipelines using Azure and Databricks. Candidates should possess deep technical expertise and strong ownership.

The role involves developing modular PySpark code, optimizing SQL workloads, and implementing Delta Lake patterns. Ideal candidates will have extensive hands-on experience in cloud platforms, particularly Azure.

Qualifications

• Extensive hands-on experience in building and scaling enterprise-grade data pipelines.
• Strong understanding of cloud platforms, specifically Azure.
• Ability to independently deliver complex, production-ready data solutions.

Responsibilities

• Build scalable pipelines using Databricks and Azure services.
• Develop modular PySpark code and libraries.
• Implement Delta Lake patterns and optimize SQL workloads.

Skills

Azure (ADLS Gen2, Key Vault, Azure SQL, Entra ID)

PySpark

SQL Optimization

CI/CD with Azure DevOps

Data Modeling

Job description

Location: INDIA - NOIDA- BIRLASOFT OFFICE

About the Role

We are seeking a Senior Data Platform Engineer with extensive hands‑on experience to build and scale enterprise‑grade data pipelines on Azure and Databricks. This role requires deep technical expertise, strong ownership, and the ability to independently deliver complex, production‑ready data solutions while setting engineering best practices.

What You'll Do

• Build scalable pipelines using Databricks (DLT, Autoloader, Workflows) and Azure services
• Extend metadata‑driven ingestion frameworks (declarative, reusable)
• Develop modular PySpark code and libraries (WHL packaging)
• Implement Delta Lake patterns (CDC, SCD Type 2, merges)
• Optimize SQL workloads for performance and cost
• Orchestrate pipelines via Synapse or UC4
• Apply data modeling (Kimball, 3NF, lakehouse)
• Implement CI/CD with Azure DevOps
• Enforce governance via Unity Catalog
• Mentor engineers and contribute to engineering standards

Required Technical Skills & Proficiency

• Cloud Platform: Azure (ADLS Gen2, Key Vault, Azure SQL, Entra ID) – Advanced (Deep hands‑on, production‑scale design & troubleshooting)