3628793-Assistant Vice President

EXL; Dadri; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

EXL is seeking an experienced Azure Databricks Architect to design and implement end-to-end data solutions on the Azure cloud. You will work closely with data engineering, data science, and business stakeholders to build scalable, secure data architectures that meet complex requirements.

You will lead governance, cataloging, and modelling efforts, implement data security using Azure Active Directory and Unity Catalog, and develop pipelines and visualizations with Databricks, Azure Data Factory,

Qualifications

• 5–6 years of experience designing data architectures on Azure with Databricks and related tools.
• Strong expertise in data governance, security, cataloging and modelling.
• Experience delivering data pipelines and visualizations with Azure tools.
• Experience collaborating with DevOps to implement CI/CD pipelines.

Responsibilities

• Design scalable, secure data architectures on Azure using Databricks and Azure Data Factory.
• Lead end-to-end data solution development including ingest, processing, storage and visualization.
• Collaborate with data engineering, data science and business teams to meet requirements.
• Develop and maintain governance, cataloging, and modelling frameworks.
• Implement data security and access controls using Azure AD and Unity Catalog.
• Build and maintain data pipelines and visualizations with the stated tools.
• Work with DevOps to implement CI/CD pipelines for data projects.
• Stay updated with Azure cloud trends to improve architectures.

Skills

Data architecture design

Cloud data engineering

Stakeholder collaboration

Data governance

Security best practices

CI/CD collaboration

Education

Bachelor's degree in Computer Science or IT

Tools

Databricks

Azure Data Factory

Azure DevOps

Power BI

Unity Catalog

Azure Active Directory

Tableau

Job description

Job Summary:

We are looking for an experienced Azure Databricks Architect who has a strong background in designing and implementing end-to-end data solutions on Azure Cloud. The ideal candidate should have expertise in Databricks, Azure Data Factory, Azure DevOps, Power BI, Unity Catalog, and data governance, cataloging, and modelling. The Azure Databricks Architect will work closely with our data engineering, data science, and business stakeholders to design and implement scalable, secure, and efficient data architectures that meet our business requirements.

Key Responsibilities:

• Design and implement scalable, secure, and efficient data architectures on Azure Cloud using Databricks, Azure Data Factory, and other related technologies.
• Lead the development of end-to-end data solutions on Azure Cloud, including data ingestion, processing, storage, and visualization.
• Collaborate with data engineering, data science, and business stakeholders to identify business requirements and design data architectures that meet those requirements.
• Develop and maintain data governance, cataloging, and modelling frameworks to ensure data quality, security, and compliance.
• Implement data security and access controls using Azure Active Directory, Unity Catalog, and other related technologies.
• Develop and maintain data pipelines using Azure Data Factory, Databricks, and other related technologies.
• Develop and maintain data visualizations using Power BI, Databricks, and other related technologies.
• Collaborate with DevOps engineers to develop and maintain CI/CD pipelines using Azure DevOps, Databricks, and other related technologies.
• Stay up-to-date with the latest Azure Cloud technologies and trends, and apply that knowledge to improve our data architectures and solutions.
• Requirements: 1. 5-6 years of experience in designing and implementing data architectures on Azure Cloud using Databricks, Azure Data Factory, and other related technologies.
• Strong experience in data governance, cataloging, and modelling, including data quality, security, and compliance.
• Experience in developing and maintaining data pipelines using Azure Data Factory, Databricks, and other related technologies.
• Experience in developing and maintaining data visualizations using Power BI or Tableau.
• Experience in collaborating with DevOps engineers to develop and maintain CI/CD pipelines using Azure DevOps, Databricks, and other related technologies.
• Strong understanding of Azure Cloud security, including Azure Active Directory, Unity Catalog, and other related technologies.
• Strong understanding of data architecture principles, including scalability, security, and efficiency.
• Bachelor's degree in Computer Science, Information Technology, or a related field. Key Technical Expertise on: Python Pyspark SPARK SQL