Senior Databricks Lakehouse Architect | Cloud Data Platform

Tata Consultancy Services Limited; Irvine (CA); On-site; USD 170,000 - 210,000; Full time

Job summary

Tata Consultancy Services Limited in California seeks a seasoned Databricks Architect to design and implement enterprise Databricks Lakehouse platforms across cloud environments. The role emphasizes strong data governance, security, and leadership to guide multi-disciplinary teams.

The successful candidate will bring 12+ years of IT experience, 5+ years in Databricks architecture, hands-on Spark/PySpark, and deep knowledge of lakehouse patterns, Unity Catalog, and data modeling.

Qualifications

• 12+ years of IT experience.
• 5+ years of Databricks architecture experience.
• Strong lakehouse architecture expertise.
• Hands-on Spark/PySpark experience.
• Data governance and security expertise.
• Stakeholder management and leadership experience.

Responsibilities

• Design and implement enterprise-scale Databricks Lakehouse platforms.
• Define end-to-end data architecture for batch, streaming, and real-time analytics.
• Develop cloud-native data platform strategies aligned with business objectives.
• Establish architectural standards, governance frameworks and best practices.
• Lead modernization initiatives including legacy data warehouse migration to Databricks.
• Design scalable ETL/ELT pipelines and medallion architecture across platforms.

Skills

Lakehouse architecture

Spark/PySpark

Data governance

Stakeholder management

Leadership

Databricks platform

Cloud architecture

Tools

Databricks Lakehouse Platform

Photon Engine

Unity Catalog

Databricks Workflows

MLflow

Auto Loader

Structured Streaming

Databricks SQL

Databricks Asset Bundles

PySpark

Spark SQL

Scala

Python

SQL

Terraform

GitHub

Docker

Job description

Tata Consultancy Services Limited in California seeks a seasoned Databricks Architect to design and implement enterprise Databricks Lakehouse platforms across cloud environments. The role emphasizes strong data governance, security, and leadership to guide multi-disciplinary teams.

The successful candidate will bring 12+ years of IT experience, 5+ years in Databricks architecture, hands-on Spark/PySpark, and deep knowledge of lakehouse patterns, Unity Catalog, and data modeling.