Sr Azure Databricks Lead

Birlasoft; Pune District; On-site; INR 1,400,000 - 2,200,000; Full time

Job summary

Birlasoft is seeking a Data Engineer with 8–10 years of experience for complex data integration in India. The role focuses on Databricks, PySpark and data modelling to design scalable pipelines.

You will work across Noida, Mumbai, Pune, Bangalore, Hyderabad, and Chennai, partnering with BI teams to turn data into actionable insights using Azure Data Lake and Data Factory.

Qualifications

• 8 to 10 years of relevant experience.
• Proven experience in design, development and deployment using Azure services.
• Strong data integration, modeling and warehouse design capabilities.
• Collaborate with BI and analytics teams.

Responsibilities

• Design, develop and deploy data solutions using Azure Databricks, PySpark, SQL and Data Factory.
• Build scalable data pipelines and integrate new data sources.
• Create technical specification and interface design.
• Develop modern data warehouse solutions with Azure Data Lake and Databricks.
• Handle batch processing and process structured and unstructured data.
• Showcase Databricks, PySpark, and SQL expertise.
• Collaborate with BI/analytics and business teams.

Skills

Data Engineer

Databricks

PySpark

Data modelling

Tools

Azure Data Factory

SQL

Azure Data Lake

Azure Databricks

Job description

Area(s) of responsibility

Skills: Data Engineer with Databricks + PySpark & Data modelling

Location: Noida, Mumbai, Pune, Bangalore, Hyderabad, Chennai

Job Description

Years of experience 8 to 10 Years

• Experience in Perform Design, Development & Deployment using Azure Services (Databricks, PySpark, SQL, Data Factory,)
• Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity.
• Experience in creating Technical Specification Design, Application Interface Design.
• Developing Modern Data Warehouse solutions using Azure Stack (Azure Data Lake, Azure Databricks) and PySpark
• Develop batch processing and integration solutions and process Structured and Non-Structured Data
• Demonstrated in-depth skills with Databricks and PySpark, and SQL
• Collaborate and engage with BI & analytics and the business team.