Data Architect (Azure Databricks)

Perficient India; Chennai District; On-site; INR 3,000,000 - 5,200,000; Full time

Job summary

Perficient India is seeking an experienced Azure Databricks Architect to lead the design, implementation, and optimization of enterprise-scale data platforms on Microsoft Azure. The role requires collaboration with stakeholders, data engineers, data scientists, and solution architects to deliver scalable, secure data ecosystems.

Deep expertise in Azure Databricks, lakehouse architectures, ETL/ELT, and cloud-native analytics is essential.

Qualifications

• Bachelor's or Master's degree in Computer Science, IT, Engineering, or related field.
• 10+ years in Data Engineering and Data Architecture.
• 5+ years hands-on experience with Azure Databricks.
• Experience deploying enterprise-scale cloud data platforms.
• Strong understanding of security, governance, and data compliance.

Responsibilities

• Design and implement end-to-end data platforms using Azure Databricks and Azure services.
• Define scalable Lakehouse architectures with Delta Lake and Medallion principles.
• Establish data models, governance, and security standards.
• Create architecture blueprints, roadmaps, and design documents.
• Drive cloud modernization and data migration initiatives.
• Design and optimize large-scale ingestion, transformation, and orchestration pipelines.
• Develop batch and real-time streaming with Databricks Structured Streaming.
• Event Hubs integration and data ingress design.
• Enable advanced analytics, AI, and ML workloads on Databricks.

Skills

Data Engineering

Cloud Architecture

Big Data Technologies

Azure Databricks

Delta Lake

Medallion Architecture

ETL/ELT

Data Governance

Security & Compliance

CI/CD

Education

Bachelor's or Master's in Computer Science/IT/Engineering

Tools

Azure Databricks

Delta Lake

Unity Catalog

Event Hubs

CI/CD

Job description

Experience

10+ Years in Data Engineering, Cloud Architecture, and Big Data Technologies

Job Summary

We are seeking an experienced Azure Databricks Architect to lead the design, implementation, and optimization of enterprise-scale data and analytics platforms on Microsoft Azure. The ideal candidate will possess deep expertise in Azure Databricks, data lake architecture, ETL/ELT frameworks, cloud-native data solutions, and modern analytics platforms. This role will partner with business stakeholders, data engineers, data scientists, and solution architects to deliver scalable, secure, and high-performing data ecosystems.

Key Responsibilities

• Design and implement end-to-end data platforms leveraging Azure Databricks and Azure-native services.
• Define scalable Lakehouse architectures using Delta Lake and Medallion Architecture principles.
• Establish enterprise data models, governance frameworks, and security standards.
• Create architecture blueprints, technical roadmaps, and solution design documents.
• Drive cloud modernization and data migration initiatives.
• Design and optimize large-scale data ingestion, transformation, and orchestration pipelines.
• Develop batch and real-time streaming solutions using Databricks Structured Streaming.
• Event Hubs
• Enable advanced analytics, AI, and machine learning workloads on Databricks.

Platform & Governance

• Implement data governance, lineage, cataloging, and access control strategies.
• Leverage Unity Catalog for centralized data governance.
• Establish CI/CD and DevOps practices for data engineering projects.
• Define monitoring, alerting, performance tuning, and cost optimization strategies.
• Ensure compliance with enterprise security and regulatory requirements.

Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or related field.
• 10+ years of experience in Data Engineering and Data Architecture.
• 5+ years of hands-on experience with Azure Databricks.
• Experience designing and deploying enterprise-scale cloud data platforms.
• Strong understanding of security, governance, and data compliance frameworks.

Preferred Certifications

• Microsoft Certified: Azure Solutions Architect Expert
• Databricks Certified Solution Architect