Senior Data Architect - Lakehouse & AI Platform

Pho Prime, LLC; Shelton (CT); On-site; USD 120,000 - 190,000; Full time

Benefits offered by this job

Mobility Allowance

Job summary

Subway is seeking a Senior Data Architect to define and evolve the enterprise data platform on Databricks. You will lead lakehouse, streaming, and batch designs powering analytics, reporting, and AI/ML use cases while guiding modernization of legacy workloads.

You will mentor engineers, collaborate with Data Engineering, Analytics, Security, and Business teams, and enforce data governance with secure access controls. Strong communication is essential.

Qualifications

• Deep expertise with the Databricks platform including Delta Lake, Unity Catalog, MLflow, and Delta Live Tables.
• Strong understanding of lakehouse, data lake, data warehouse, and data mesh concepts.
• Expert SQL and Python/PySpark; Scala knowledge is a plus.
• Experience with distributed data processing frameworks at enterprise scale.
• Experience with cloud platforms (AWS, Azure, or GCP) and native data services.
• Proficiency with orchestration tools such as Databricks Workflows, Airflow, or Azure Data Factory.
• Experience with data governance, security, and access-control frameworks.
• IaC experience with Terraform, Pulumi, or ARM/Bicep.
• Ability to translate business requirements into scalable designs.
• Strong communication and architecture-influence skills.
• Bachelor’s or higher with 8–12+ years in data engineering/architecture.
• Experience building production-grade data platforms on Databricks, Snowflake, or Redshift.

Responsibilities

• Define and lead enterprise data platform architecture on Databricks, including lakehouse, streaming, and batch architectures.
• Architect Medallion patterns and design self-service capabilities with Unity Catalog and Delta Lake.
• Modernize legacy data warehouses onto the Databricks lakehouse and set standards across teams.
• Mentor engineers on Databricks best practices and cost-optimization strategies.
• Collaborate with Data Engineering, Analytics, Security, and Business teams.
• Enforce data governance practices and secure access models.
• Lead architecture reviews and influence long-term platform direction.
• Track KPIs for reliability, freshness, and efficiency.

Skills

Databricks expertise

SQL

Python/PySpark

Scala knowledge

Spark at enterprise scale

Cloud platforms (AWS/Azure/GCP)

Data governance & security

Data quality & observability

IaC (Terraform/Pulumi/ARM)

Communication & architecture influence

Architectural leadership

Education

Bachelor's degree in Computer Science/Engineering/Data or related field

Master's degree preferred

Tools

Delta Lake

Unity Catalog

MLflow

Databricks Workflows

Airflow

Terraform

Job description

Subway is seeking a Senior Data Architect to define and evolve the enterprise data platform on Databricks. You will lead lakehouse, streaming, and batch designs powering analytics, reporting, and AI/ML use cases while guiding modernization of legacy workloads.

You will mentor engineers, collaborate with Data Engineering, Analytics, Security, and Business teams, and enforce data governance with secure access controls. Strong communication is essential.