Azure Databricks Architect

Birlasoft; Pune District; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

Birlasoft in India is seeking a Sr. Architect to lead data and analytics architecture across Azure platforms, covering multiple cities. You will design scalable data pipelines, build Data Lake and Data Warehouse solutions, and mentor delivery teams.

Ideal candidates have 15+ years of experience, strong client-facing skills, and proven ability to deliver Azure POCs and best-practice guidance across Synapse, Data Factory and Data Lake Storage.

Qualifications

• 15+ years of industry experience with architecture-level responsibilities.
• At least 3 years in an architect role and 3–4 years designing analytics on Azure.
• Experience with data ingestion and integration across structured, semi-structured, and unstructured data.

Responsibilities

• Develop scalable data architectures and pipelines to handle increasing data volumes.
• Design Data Lake and Data Warehouse using Azure services.
• Lead end-to-end analytics solution design and perform Azure POCs.
• Guide Azure environment sizing and service choices across use cases.

Skills

Azure Databricks

Sr. Architect

Python

Pyspark

Data Factory

Data Lake

Tools

Azure Synapse

Azure Data Lake Storage

Databricks

Job description

Skills: Azure Databricks Sr. Architect, Python, Pyspark, Data Factory, Data Lake

Location: Mumbai/ Pune/ Noida/ Bangalore/ CHennai/ Hyderabad

• Develop and maintain scalable architecture, database design and data pipelines and build out new Data Source integrations to support continuing increases in data volume and complexity
• Design and Develop the Data lake, Data warehouse using Azure Cloud Services
• Assist in designing end to end data and Analytics solution architecture and perform POCs within Azure
• Drive the design, sizing, POC setup, etc. of Azure environments and related services for the use cases and the solutions
• Reviews the solution requirements support architecture design to ensure the selection of appropriate technology, efficient use of resources and integration of multiple systems and technology.
• Must possess good client-facing experience with the ability to facilitate requirements sessions and lead teams
• Support internal presentations to technical and business teams
• Provide technical guidance, mentoring and code review, design level technical best practices

Area(s) of responsibility

Skills: Azure Databricks Sr. Architect, Python, Pyspark, Data Factory, Data Lake Experience: 15+ years Location: Mumbai/ Pune/ Noida/ Bangalore/ CHennai/ Hyderabad

Responsibilities

• Develop and maintain scalable architecture, database design and data pipelines and build out new Data Source integrations to support continuing increases in data volume and complexity
• Design and Develop the Data lake, Data warehouse using Azure Cloud Services
• Assist in designing end to end data and Analytics solution architecture and perform POCs within Azure
• Drive the design, sizing, POC setup, etc. of Azure environments and related services for the use cases and the solutions
• Reviews the solution requirements support architecture design to ensure the selection of appropriate technology, efficient use of resources and integration of multiple systems and technology.
• Must possess good client-facing experience with the ability to facilitate requirements sessions and lead teams
• Support internal presentations to technical and business teams
• Provide technical guidance, mentoring and code review, design level technical best practices

Experience Needed

• 12-15 years of industry experience and at least 3 years of experience in architect role is required along with at least 3 to 4 years’ experience designing and building analytics solutions in Azure.
• Experience in architecting data ingestion/integration frameworks capable of processing structured, semi-structured & unstructured data sets in batch & real-time
• Hands-on experience in the design of reporting schemas, data marts and development of reporting solutions
• Develop batch processing, streaming and integration solutions and process Structured and Non-Structured Data
• Demonstrated experience with ETL development both on-premises and in the cloud using SSIS, Data Factory, and Azure Analysis Services and other ETL technologies.
• Experience in Perform Design, Development & Deployment using Azure Services ( Azure Synapse, Data Factory, Azure Data Lake Storage, Databricks, Python and SSIS)
• Worked with transactional, temporal, time series, and structured and unstructured data.
• Deep understanding of the operational dependencies of applications, networks, systems, security, and policy (both on-premise and in the cloud; VMs, Networking, VPN (Express Route), Active Directory, Storage (Blob, etc.), Windows/Linux).

Mandatory Skills: Azure Synapse, Data Factory, Azure Data Lake Storage, Databricks, Python