Technical Lead - Data Engineering

Birlasoft Limited; Bengaluru; On-site; INR 3,200,000 - 5,200,000; Full time

Job summary

Birlasoft Limited in Bengaluru seeks a Technical Lead-Data Engg to design and implement cloud-based data solutions on Azure. You will lead data integration across Data Warehouse and Data Lake, applying PySpark and Databricks at scale.

The role requires senior experience with data modelling and architecture, strong client collaboration, and the ability to articulate technology trade-offs clearly.

Qualifications

• Senior-level data engineer with 5+ years in data engineering on cloud platforms.
• Must have hands-on experience with Azure Databricks and PySpark.
• Experience designing data warehouses and data lakes with secure, scalable architectures.
• Strong communication to translate client needs into technical solutions.

Responsibilities

• Design and implement secure, scalable cloud-based data solutions on Azure.
• Collaborate with clients to translate requirements into technical designs.
• Tune performance and optimize data workflows and queries.
• Integrate diverse data sources with Data Warehouse and Data Lake architectures.
• Explain pros/cons of technologies to stakeholders.

Skills

Azure Databricks

Python

PySpark

Advanced SQL

Azure Data Factory

Azure Data Lake Storage Gen2

Data Modelling

Data Architecture

Azure

Cloud Solutions

Tools

GitHub

Jira

Confluence

Teams

Job description

Technical Lead-Data Engg Area(s) of responsibility Experience: 5 to 8 Years

• Azure Lead with experience in Azure ADF, ADLS Gen2,Python, Databricks, PySpark and Advanced SQL
• Responsible for designing and implementing secure, scalable, and highly available cloud-based solutions and estimation on Azure Cloud
• 4 Years of experince in Azure Databricks and PySpark
• Experience in Performance Tuning
• Experience with integration of different data sources with Data Warehouse and Data Lake is required
• Experience in creating Data warehouse, data lakes
• Understanding of data modelling and data architecture concepts
• To be able to clearly articulate pros and cons of various technologies and platforms
• Experience in supporting tools GitHub, Jira, Teams, Confluence need to be used
• Collaborate with clients to understand their business requirements and translate them into technical solutions that leverage AWS and Azure cloud platforms.
• Mandatory Skillset: Azure Databricks, Python, PySpark and Advanced SQL
• Experience Level Senior Level