Sr Technical Lead-Data Engg

Birlasoft; India; Hybrid; INR 4,500,000 - 7,500,000; Full time

Job summary

Birlasoft in Bengaluru is seeking a Sr Technical Lead-Data Engg with deep expertise in batch processing and cloud data platforms. You will design distributed batch systems and lead implementation across ETL workloads using Spring Batch and Azure data services.

You will own architecture decisions, drive DevOps automation with Azure DevOps, and ensure observability with Azure Monitor and Log Analytics for large-scale data pipelines.

Qualifications

• Strong expertise in Spring Batch (job design, partitioning, parallel processing).
• Deep knowledge of enterprise batch frameworks and workload orchestration.
• Experience designing distributed, scalable batch processing systems.
• Strong knowledge of data processing patterns and ETL frameworks.
• Ability to define multi-layer architecture (Orchestrator vs Execution vs Processing).
• CI/CD using Azure DevOps and monitoring with Azure Monitor / Log Analytics / App Insights.
• Experience operationalizing large-scale data pipelines.

Responsibilities

• Design and implement distributed, scalable batch processing systems.
• Define and drive multi-layer architecture for batch workflows.
• Lead DevOps practices and observability for data pipelines.
• Collaborate with cross-functional teams to deliver data solutions.

Skills

Spring Batch

Batch frameworks

Partitioning

Parallel processing

Data processing patterns

ETL frameworks

Tools

Azure Data Factory

Azure Batch

Azure Storage

Azure SQL

Azure Container Apps

Job description

Location: INDIA - BENGALURU - BIRLASOFT OFFICE

Title: Sr Technical Lead-Data Engg

Area(s) of responsibility

Technical Skills (Mandatory)

• Strong expertise in Spring Batch (job design, partitioning, parallel processing)
• Deep knowledge of enterprise batch frameworks and workload orchestration

Azure Stack

• Azure Data Factory (ADF) - orchestration, pipelines, dependency management
• Azure Batch - job scheduling, compute pools, parallel task execution
• Azure Storage (ADLS Gen2 / Blob), Azure SQL
• Understanding of execution platforms (Azure Container Apps / VM-based runtime)

Architecture & Design

• Experience designing distributed, scalable batch processing systems
• Strong knowledge of data processing patterns and ETL frameworks
• Ability to define multi-layer architecture (Orchestrator vs Execution vs Processing)

DevOps & Observability

• CI/CD using Azure DevOps
• Monitoring via Azure Monitor / Log Analytics / App Insights
• Experience in operationalizing large-scale data pipelines