Databricks Lakehouse Architect — Hybrid Data Platform

Persistent Systems; Village of Tarrytown (NY); Hybrid; USD 180,000 - 230,000; Full time

Benefits offered by this job

Hybrid work model

Flexible hours

Assistive technologies

Equal opportunity employer

Job summary

Persistent Systems is seeking a highly experienced Databricks Architect to lead enterprise-scale Lakehouse design and AWS-based modernization initiatives in the New York area. You will guide migration from legacy platforms, define governance and security standards, and mentor senior engineers across multiple projects.

The role requires 13+ years of experience, deep Databricks expertise, and a collaborative, architecture-led approach.

Qualifications

• 13+ years of experience in data engineering or architecture roles.
• Proven experience designing and delivering enterprise-scale Databricks Lakehouse architectures on AWS.
• Strong knowledge of Delta Lake, Unity Catalog, and Databricks Workflows.

Responsibilities

• Lead enterprise-scale Databricks Lakehouse Architecture design and implementations on AWS.
• Drive large-scale data platform modernization and cloud transformation.
• Architect data pipelines for batch, streaming, CDC, and real-time workloads.

Skills

Databricks

AWS

PySpark

Delta Lake

Unity Catalog

ETL/ELT

CI/CD

DevOps

Python

Tools

EMR

NiFi

Redshift

Airflow

S3

Glue

Lambda

Databricks Workflows

Delta Live Tables

Job description

Persistent Systems is seeking a highly experienced Databricks Architect to lead enterprise-scale Lakehouse design and AWS-based modernization initiatives in the New York area. You will guide migration from legacy platforms, define governance and security standards, and mentor senior engineers across multiple projects.

The role requires 13+ years of experience, deep Databricks expertise, and a collaborative, architecture-led approach.