Azure Data Engineer

Maveric; Pune District, Chennai District, Bengaluru; Sur place; INR 1 500 000 - 2 100 000; Plein temps

Résumé du poste

Maveric is seeking experts in Databricks and Azure to lead complex data migration initiatives. You will design and implement Lakehouse architectures, leverage Delta Live Tables for data processing, and drive end-to-end validation and reconciliation across bronze, silver, and gold layers.

Key responsibilities include delivering scalable migration programs from Teradata to Databricks, building CI/CD pipelines in Azure DevOps, and integrating ADLS Gen2, Key Vault, and Data Factory into robust data

Qualifications

• Proficient in Databricks Lakehouse architecture for large-scale data platforms.
• Hands-on with Delta Live Tables (DLT) on Databricks; Unity Catalog experience not required.
• Strong experience migrating Teradata environments to Databricks.
• Experience designing scalable data migration and validation frameworks.

Connaissances

Databricks Lakehouse architecture

Databricks DLT / Delta Live Tables

Teradata to Databricks migrations

Data migration frameworks

Bronze/Silver/Gold data layers

Data reconciliation & reporting

Azure cloud expertise

Outils

Azure DevOps

Azure Data Factory

Azure Data Lake Storage Gen2

Azure Key Vault

Description du poste

• Strong expertise in Databricks Lakehouse architecture
• Hands-on experience with Databricks DLT Meta (Delta Live Tables) (not Unity Catalog)
• Expertise in using Azure (Stated requirement is Azure, I would think ADLS Gen 2, Azure Data Factory, Azure Key Vault, Azure DevOps)
• Expertise in CI/CD implementation in Azure DevOps for deployment pipelines
• Experience designing scalable testing and validation frameworks for data migration projects
• Proven experience in Teradata to Databricks migration programs
• Ability to support bronze, silver, and gold layer implementation and optimization
• Strong understanding of enterprise reporting/data reconciliation processes