3628793-Assistant Vice President

EXL Talent Acquisition Team; Dadri; On-site; INR 2,000,000 - 3,600,000; Full time

Job summary

We are seeking an experienced Azure Databricks Architect to design and implement end-to-end data solutions on Azure Cloud. The role requires expertise in Databricks, Azure Data Factory, Unity Catalog, and data governance to deliver scalable, secure architectures aligned with business needs.

The candidate will collaborate with data engineering, data science, and business stakeholders to ensure data quality, security, and compliant data models, while developing and maintaining CI/CD pipelines with

Qualifications

• 5-6 years of experience in designing and implementing data architectures on Azure Cloud using Databricks, Azure Data Factory, and other related technologies.
• Strong experience in data governance, cataloging, and modelling, including data quality, security, and compliance.
• Experience in developing and maintaining data pipelines using Azure Data Factory, Databricks, and other related technologies.
• Experience in developing and maintaining data visualizations using Power BI or Tableau.
• Experience in collaborating with DevOps engineers to develop and maintain CI/CD pipelines using Azure DevOps, Databricks, and other related technologies.
• Strong understanding of Azure Cloud security, including Azure Active Directory, Unity Catalog, and other related technologies.
• Strong understanding of data architecture principles, including scalability, security, and efficiency.
• Bachelor's degree in Computer Science, Information Technology, or a related field.

Responsibilities

• Design and implement scalable, secure, and efficient data architectures on Azure Cloud using Databricks, Azure Data Factory, and other related technologies.
• Lead the development of end-to-end data solutions on Azure Cloud, including data ingestion, processing, storage, and visualization.
• Collaborate with data engineering, data science, and business stakeholders to identify business requirements and design data architectures that meet those requirements.
• Develop and maintain data governance, cataloging, and modelling frameworks to ensure data quality, security, and compliance.
• Implement data security and access controls using Azure Active Directory, Unity Catalog, and other related technologies.
• Develop and maintain data pipelines using Azure Data Factory, Databricks, and other related technologies.
• Develop and maintain data visualizations using Power BI, Databricks, and other related technologies.
• Collaborate with DevOps engineers to develop and maintain CI/CD pipelines using Azure DevOps, Databricks, and other related technologies.
• Stay up-to-date with the latest Azure Cloud technologies and trends, and apply that knowledge to improve our data architectures and solutions.

Skills

Python

Pyspark

SPARK SQL

Education

Bachelor's degree in CS/IT

Job description

Job Summary

We are looking for an experienced Azure Databricks Architect who has a strong background in designing and implementing end-to-end data solutions on Azure Cloud. The ideal candidate should have expertise in Databricks, Azure Data Factory, Azure DevOps, Power BI, Unity Catalog, and data governance, cataloging, and modelling. The Azure Databricks Architect will work closely with our data engineering, data science, and business stakeholders to design and implement scalable, secure, and efficient data architectures that meet our business requirements.

Key Responsibilities

• Design and implement scalable, secure, and efficient data architectures on Azure Cloud using Databricks, Azure Data Factory, and other related technologies.
• Lead the development of end-to-end data solutions on Azure Cloud, including data ingestion, processing, storage, and visualization.
• Collaborate with data engineering, data science, and business stakeholders to identify business requirements and design data architectures that meet those requirements.
• Develop and maintain data governance, cataloging, and modelling frameworks to ensure data quality, security, and compliance.
• Implement data security and access controls using Azure Active Directory, Unity Catalog, and other related technologies.
• Develop and maintain data pipelines using Azure Data Factory, Databricks, and other related technologies.
• Develop and maintain data visualizations using Power BI, Databricks, and other related technologies.
• Collaborate with DevOps engineers to develop and maintain CI/CD pipelines using Azure DevOps, Databricks, and other related technologies.
• Stay up-to-date with the latest Azure Cloud technologies and trends, and apply that knowledge to improve our data architectures and solutions.

Requirements

• 5-6 years of experience in designing and implementing data architectures on Azure Cloud using Databricks, Azure Data Factory, and other related technologies.
• Strong experience in data governance, cataloging, and modelling, including data quality, security, and compliance.
• Experience in developing and maintaining data pipelines using Azure Data Factory, Databricks, and other related technologies.
• Experience in developing and maintaining data visualizations using Power BI or Tableau.
• Experience in collaborating with DevOps engineers to develop and maintain CI/CD pipelines using Azure DevOps, Databricks, and other related technologies.
• Strong understanding of Azure Cloud security, including Azure Active Directory, Unity Catalog, and other related technologies.
• Strong understanding of data architecture principles, including scalability, security, and efficiency.
• Bachelor's degree in Computer Science, Information Technology, or a related field.

Key Technical Expertise

• Python
• Pyspark
• SPARK SQL