Senior Databricks Data Architect - Hybrid Lakehouse Lead

NewVision; San Francisco (CA); Hybrid; USD 140,000 - 190,000; Full time

Benefits offered by this job

Hybrid work model

Job summary

New Vision Softcom & Consultancy Pvt. Ltd is seeking a Databricks Data Architect to lead a 10+ person data engineering team in San Francisco.

You will own end-to-end Databricks Lakehouse architecture, Unity Catalog governance, and Azure-based deployment strategies to deliver scalable data solutions for financial services. You will collaborate with application developers and analytics teams to design robust data pipelines, optimize Spark workloads, and ensure cost efficiency and governance across

Qualifications

• Bachelor’s degree in Computer Science, Information Systems, or related field.
• 7+ years of experience in data engineering or data architecture.
• Hands-on Databricks Azure experience and Spark ecosystem proficiency.

Responsibilities

• Lead and mentor a team of 10+ data engineers.
• Own Databricks platform architecture and Lakehouse design.

Skills

Lead Data Engineers

Databricks Platform

Unity Catalog

Cluster Provisioning

Databricks SQL

Performance Tuning

DevOps Integration

Data Governance

Data Platform Architecture

Stakeholder Collaboration

Education

Bachelor's degree in CS/IS

Tools

Databricks Lakehouse

Azure Databricks

Delta Lake

Unity Catalog

Apache Spark

PySpark/Scala

Azure DevOps

Job description

New Vision Softcom & Consultancy Pvt. Ltd is seeking a Databricks Data Architect to lead a 10+ person data engineering team in San Francisco.

You will own end-to-end Databricks Lakehouse architecture, Unity Catalog governance, and Azure-based deployment strategies to deliver scalable data solutions for financial services. You will collaborate with application developers and analytics teams to design robust data pipelines, optimize Spark workloads, and ensure cost efficiency and governance across