Technical Lead-Data Engg

Birlasoft; Bengaluru; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

Birlasoft seeks an Azure Lead to design and implement secure, scalable cloud solutions on Azure. You will leverage Azure Databricks, PySpark, and Advanced SQL to build performant data pipelines and integrate diverse sources into Data Warehouse and Data Lake.

Responsibilities include architecture planning, client collaboration, and ensuring robust security and availability. Prior experience with Azure cloud services and data modeling is essential.

Qualifications

• Azure Databricks, Python, PySpark and Advanced SQL are mandatory.
• Experience with Azure ADF and ADLS Gen2.
• Experience in designing secure, scalable cloud solutions on Azure.

Responsibilities

• Lead design and implementation of secure, scalable cloud solutions on Azure.
• Collaborate with clients to translate business requirements into Azure cloud-based technical solutions.
• Experience in integrating various data sources with Data Warehouse and Data Lake.
• Contribute to performance tuning and optimization of data pipelines.
• Coordinate with cross-functional teams using GitHub, Jira, Teams, and Confluence.

Skills

Azure ADF

ADLS Gen2

Python

Databricks

PySpark

Advanced SQL

Performance Tuning

Data integration

Data Warehouse

Data Lake

Data modelling

Data architecture

GitHub

Jira

Teams

Confluence

AWS & Azure

Education

null

Tools

GitHub

Jira

Teams

Confluence

Job description

• Azure Lead with experience in Azure ADF, ADLS Gen2,Python, Databricks, PySpark and Advanced SQL
• Responsible for designing and implementing secure, scalable, and highly available cloud-based solutions and estimation on Azure Cloud
• 4 Years of experince in Azure Databricks and PySpark
• Experience in Performance Tuning
• Experience with integration of different data sources with Data Warehouse and Data Lake is required
• Experience in creating Data warehouse, data lakes
• Understanding of data modelling and data architecture concepts
• To be able to clearly articulate pros and cons of various technologies and platforms
• Experience in supporting tools GitHub, Jira, Teams, Confluence need to be used
• Collaborate with clients to understand their business requirements and translate them into technical solutions that leverage AWS and Azure cloud platforms.

Area(s) of responsibility

Experience: 5 to 8 Years

• Azure Lead with experience in Azure ADF, ADLS Gen2,Python, Databricks, PySpark and Advanced SQL
• Responsible for designing and implementing secure, scalable, and highly available cloud-based solutions and estimation on Azure Cloud
• 4 Years of experince in Azure Databricks and PySpark
• Experience in Performance Tuning
• Experience with integration of different data sources with Data Warehouse and Data Lake is required
• Experience in creating Data warehouse, data lakes
• Understanding of data modelling and data architecture concepts
• To be able to clearly articulate pros and cons of various technologies and platforms
• Experience in supporting tools GitHub, Jira, Teams, Confluence need to be used
• Collaborate with clients to understand their business requirements and translate them into technical solutions that leverage AWS and Azure cloud platforms.

Mandatory Skillset

Azure Databricks, Python, PySpark and Advanced SQL