Azure Databricks+ PySpark- Sr Technical Lead-Data Engg

Birlasoft; Pune District; On-site; INR 1,800,000 - 3,600,000; Full time

Job summary

Birlasoft is seeking an experienced Azure Data Engineer to design, develop and deploy scalable data pipelines using Azure Databricks, PySpark, SQL and Data Factory. Candidates should have 8–10 years of experience and a track record of delivering modern data warehouse solutions.

Location coverage includes Mumbai, Pune, Noida, Bangalore and Chennai with on-site work across multiple locations; strong collaboration with BI teams and business stakeholders is required.

Qualifications

• 8–10 years of experience in data engineering roles.
• Experience designing, developing and deploying scalable data pipelines.
• Experience with modern data warehouse solutions on Azure.

Responsibilities

• Perform design, development and deployment using Azure services (Databricks, PySpark, SQL, Data Factory).
• Develop and maintain scalable data pipelines and new data source integrations.
• Create technical specification design and application interface design.
• Develop modern data warehouse solutions using Azure Data Lake and Databricks.

Skills

Azure Databricks

PySpark

SQL

Data Factory

Tools

Azure Data Lake

Azure Databricks

Job description

Area(s) of responsibility

Azure Data Engineer with Databricks and PySpark

Job Description

Years of experience 8 to 10 Years – 5B – Sr Tech Lead

• Experience in Perform Design, Development & Deployment using Azure Services (Databricks, PySpark, SQL, Data Factory,)
• Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity.
• Experience in creating Technical Specification Design, Application Interface Design.
• Developing Modern Data Warehouse solutions using Azure Stack (Azure Data Lake, Azure Databricks) and PySpark
• Develop batch processing and integration solutions and process Structured and Non-Structured Data
• Demonstrated in-depth skills with Azure Databricks and PySpark, and SQL
• Collaborate and engage with BI & analytics and the business team.
• Minimum 2 to 3 year of Project experience in Azure Databricks
• Minimum 2-3 years of experience in ADF
• Minimum 2+ years of experience in PySpark

Location: Mumbai, Pune, Noida, Bangalore and Chennai