Azure databricks architect

Raad7 Informatics; Chennai District; On-site; INR 3,000,000 - 6,000,000; Full time

Job summary

Raad7 Informatics seeks a senior data engineering architect to design enterprise-scale Azure Databricks and cloud data platforms. You will lead Lakehouse, batch and real-time data pipelines, and drive governance, security, performance, and cost optimization.

Collaborate with business, product, data science and engineering teams to integrate AI/ML, MLOps, and DataOps, while guiding cloud modernization and migrations across the organization.

Qualifications

• 12+ years of experience in Data Engineering and Data Architecture.
• Hands-on experience with Azure Databricks (5+ years).
• Proficient in Azure data services (ADLS, ADF, Synapse, Azure SQL, Event Hub, Key Vault, Functions).
• Strong Spark, PySpark, SQL, Delta Lake, Lakehouse skills.
• Experience with ETL/ELT, data modeling and data warehousing.
• Experience in real-time streaming and event-driven architectures.
• CI/CD, DevOps practices, Terraform/Bicep.
• Azure AI/ML and MLOps experience.

Responsibilities

• Design enterprise-scale Azure Databricks & cloud data platforms.
• Build Lakehouse, batch & real-time data pipelines.
• Drive data architecture, governance, security, performance & cost optimization.
• Integrate AI/ML, MLOps & DataOps solutions.
• Lead cloud modernization/migration and provide technical guidance to teams.
• Work closely with business, product, data science and engineering stakeholders.

Skills

Data Engineering/Data Architecture

Azure Databricks

Spark/PySpark

SQL

Delta Lake/Lakehouse

ETL/ELT

Real-time streaming

CI/CD/DevOps

MLOps

Tools

ADLS

ADF

Synapse

Azure SQL

Event Hub

Key Vault

Azure Functions

Terraform

Bicep

Job description

Role & responsibilities

• Design enterprise-scale Azure Databricks & cloud data platforms.
• Build Lakehouse, batch & real-time data pipelines.
• Drive data architecture, governance, security, performance & cost optimization.
• Integrate AI/ML, MLOps & DataOps solutions.
• Lead cloud modernization/migration and provide technical guidance to teams.
• Work closely with business, product, data science and engineering stakeholders.

Preferred candidate profile

• 12+ yrs in Data Engineering/Data Architecture.
• 5+ yrs hands-on Azure Databricks.
• Strong ADLS, ADF, Synapse, Azure SQL, Event Hub, Key Vault, Azure Functions.
• Spark, PySpark, SQL, Delta Lake, Lakehouse.
• ETL/ELT, data modeling & data warehousing.
• Real-time streaming/event-driven architecture.
• CI/CD, DevOps, Terraform/Bicep.
• Azure AI/ML & MLOps experience.