Databricks Architect

Yantran; Chennai District; On-site; INR 2,400,000 - 4,800,000; Full time

Job summary

Yantran seeks a Databricks Architect to design enterprise-scale Lakehouse, data engineering, analytics, and AI platforms using Databricks.

You will define data ingestion, transformation, storage, and processing strategies, and design Delta Lake and Unity Catalog solutions for scalable, governed data workloads across cloud environments.

Qualifications

• Experience designing Databricks Lakehouse architectures in enterprise environments.

Responsibilities

• Design enterprise Databricks and Lakehouse architectures.
• Define data ingestion, transformation, storage and processing strategies.
• Design Delta Lake and Unity Catalog solutions.
• Architect batch and real-time data pipelines.
• Establish data governance, security, and access controls.
• Integrate Databricks with Azure, AWS, or GCP.
• Design ML/AI workloads on Databricks.
• Lead cloud data modernization initiatives.
• Provide technical leadership to Data Engineering teams.

Skills

Databricks

Lakehouse architecture

Delta Lake

Unity Catalog

Apache Spark/PySpark

Python and SQL

Cloud platforms

Data governance

Data engineering

ML/AI platform experience

Job description

Seeking a Databricks Architect to design enterprise-scale Lakehouse, data engineering, analytics, and AI platforms using Databricks.

Responsibilities:

• Design enterprise Databricks and Lakehouse architecture.
• Define data ingestion, transformation, storage, and processing strategies.
• Design Delta Lake and Unity Catalog solutions.
• Architect batch and real-time data pipelines.
• Establish data governance, security, and access controls.
• Integrate Databricks with Azure, AWS, or GCP.
• Design ML/AI workloads on Databricks.
• Lead cloud data modernization initiatives.
• Provide technical leadership to Data Engineering teams.

Required Skills:

• Databricks.
• Lakehouse Architecture.
• Delta Lake.
• Unity Catalog.
• Apache Spark/PySpark.
• Python and SQL.
• Cloud platforms.
• Data Governance.
• Data Engineering.
• ML/AI platform experience preferred.