Databricks Lakehouse Architect - Data Platform Lead

Valiant Technologies LLC

Austin (TX)

On-site

USD 110,000 - 152,000

Full time

28 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Valiant Technologies LLC in Austin, TX seeks a senior Databricks Architect to lead enterprise-scale data platform modernization. You will drive migration from legacy ETL to the Databricks Lakehouse and design scalable architectures leveraging Delta Lake, Unity Catalog, and Databricks Workflows.

The role requires leadership across AWS-based data ecosystems, data governance and security, and collaboration with business stakeholders to define roadmaps and target architectures.

Qualifications

  • Experience designing and implementing enterprise-scale Databricks Lakehouse architectures.
  • Proficiency with Unity Catalog, Delta Lake, and Databricks Workflows.
  • Strong knowledge of PySpark, Spark SQL and Python in production environments.
  • Hands-on experience with AWS data services (S3, IAM, Redshift, Glue).

Responsibilities

  • Lead modernization of data platforms, migrating from legacy ETL to Databricks.
  • Architect scalable Lakehouse solutions and govern end-to-end pipelines.
  • Provide architecture leadership for large AWS-based data ecosystems.
  • Develop data governance, security, lineage, and observability frameworks.
  • Mentor teams and drive best-practices in CI/CD and IaC.
  • Collaborate with stakeholders to define roadmaps and target architectures.
  • Lead architecture reviews and deliver solution sign-offs.

Skills

Databricks Lakehouse
Unity Catalog
Databricks Workflows
Auto Loader
PySpark
Python
AWS
Data Governance
CI/CD

Tools

Airflow
GitHub
Jenkins
Lambda
S3
Redshift

Job description

Valiant Technologies LLC in Austin, TX seeks a senior Databricks Architect to lead enterprise-scale data platform modernization. You will drive migration from legacy ETL to the Databricks Lakehouse and design scalable architectures leveraging Delta Lake, Unity Catalog, and Databricks Workflows.

The role requires leadership across AWS-based data ecosystems, data governance and security, and collaboration with business stakeholders to define roadmaps and target architectures.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Databricks Lakehouse Architect — Enterprise Data Leader
Databricks Lakehouse Architect — Enterprise Data Leader

Ethereum Technologies LLC • Austin (TX)

On-site
USD 100,000 - 142,000
Lead Databricks Lakehouse Architect
Lead Databricks Lakehouse Architect

Robotics Technologies • Jackson (TN)

On-site
USD 100,000 - 142,000
Databricks Lakehouse Architect & Platform Lead
Databricks Lakehouse Architect & Platform Lead

Valiant Technologies LLC • Boston (MA)

On-site
USD 180,000 - 260,000
Senior Databricks Architect - AWS Lakehouse Leader
Senior Databricks Architect - AWS Lakehouse Leader

Valiant Technologies LLC • Atlanta (GA)

On-site
USD 170,000 - 210,000
Databricks Lakehouse Architect
Databricks Lakehouse Architect

Valiant Technologies LLC • Washington

On-site
USD 180,000 - 240,000
Databricks Lakehouse Architect | AWS Data Platform Lead
Databricks Lakehouse Architect | AWS Data Platform Lead

Robotic Process Automation LLC • Austin (TX)

On-site
USD 110,000 - 152,000
Databricks Lakehouse Architect – AWS Migration Leader
Databricks Lakehouse Architect – AWS Migration Leader

Quantum Technologies LLC • Austin (TX)

On-site
USD 100,000 - 142,000
Databricks Lakehouse Architect - Modernization Lead
Databricks Lakehouse Architect - Modernization Lead

Anblicks Inc. • Dallas (TX)

On-site
USD 150,000 - 190,000
Databricks Lakehouse Architect — Hybrid Data Platform
Databricks Lakehouse Architect — Hybrid Data Platform

Persistent Systems • Village of Tarrytown (NY)

Hybrid
USD 180,000 - 230,000
Hybrid work model
Flexible hours
Assistive technologies
+1
Databricks Architect - Lakehouse Modernization
Databricks Architect - Lakehouse Modernization

Anblicks Inc. • Dallas (TX)

On-site
USD 150,000 - 190,000