Sr Technical Lead-Data Engg

Birlasoft; Bengaluru; On-site; INR 6,000,000 - 8,000,000; Full time

Job summary

Birlasoft in Bengaluru seeks a Sr Technical Lead-Data Engg to architect and build scalable data pipelines end-to-end, leveraging Azure batch processing and enterprise batch frameworks.

You will design multi-layer architectures, implement ETL patterns, and drive DevOps and observability using Azure Monitor, App Insights, and Log Analytics.

Qualifications

• Strong expertise in Spring Batch and batch processing frameworks.
• Experience with Azure data services including ADF, Batch, Storage and SQL.
• Ability to design distributed, scalable data processing architectures.
• Knowledge of ETL patterns and multi-layer architecture (Orchestrator vs Execution).
• CI/CD and observability using Azure DevOps, Monitor, Log Analytics and App Insights.

Responsibilities

• Design and implement scalable batch data pipelines on Azure stack.
• Define multi-layer architecture (Orchestrator vs Execution vs Processing).
• Drive DevOps and monitoring for large-scale data pipelines.

Skills

Spring Batch

Batch frameworks

Azure Data Factory

Azure Batch

Azure Storage

Azure SQL

Execution platforms

Distributed systems

ETL patterns

DevOps (Azure DevOps)

Monitoring (Azure Monitor)

Log Analytics

App Insights

Tools

Azure Data Factory

Azure Batch

Azure Storage

Azure SQL

Azure DevOps

Azure Monitor

Log Analytics

App Insights

Job description

Select how often (in days) to receive an alert:

Location: INDIA - BENGALURU - BIRLASOFT OFFICE

Title: Sr Technical Lead-Data Engg

Description:

Area(s) of responsibility

Technical Skills (Mandatory)

Core Batch & Processing

• Strong expertise in Spring Batch (job design, partitioning, parallel processing)
• Deep knowledge of enterprise batch frameworks and workload orchestration

Azure Stack

• Azure Data Factory (ADF) – orchestration, pipelines, dependency management
• Azure Batch – job scheduling, compute pools, parallel task execution
• Azure Storage (ADLS Gen2 / Blob), Azure SQL
• Understanding of execution platforms (Azure Container Apps / VM-based runtime)

Architecture & Design

• Experience designing distributed, scalable batch processing systems
• Strong knowledge of data processing patterns and ETL frameworks
• Ability to define multi‑layer architecture (Orchestrator vs Execution vs Processing)

DevOps & Observability

• CI/CD using Azure DevOps
• Monitoring via Azure Monitor / Log Analytics / App Insights
• Experience in operationalizing large-scale data pipelines