Databricks Platform Architect - Spark | MLOps (Remote)

Empiric; United States; Remote; USD 124,000 - 145,000; Part time

Job summary

Empiric is seeking a Databricks Architect to own the design and delivery of a modern lakehouse platform. You will lead moves from legacy data systems to Databricks, set technical direction for data engineering and ML workloads, and mentor engineers while staying hands-on with code.

This role focuses on architecture, roadmapping, and aligning delivery teams with business priorities, while enabling scalable, secure data and ML workflows.

Qualifications

• Significant Databricks architecture experience in enterprise settings.
• Hands-on with Spark, Delta Lake and Unity Catalog.
• Proficient in Python or Scala and production-grade code review.

Responsibilities

• Design end-to-end Databricks architecture including workspace strategy and governance.
• Lead migrations from legacy systems to Databricks with risk management.
• Build and optimise large-scale Spark workloads (batch and streaming).
• Develop and guide MLOps capabilities using MLflow and model deployment pipelines.
• Collaborate with data scientists to productionise models and ensure governance.

Skills

Databricks architecture

Cloud experience

Stakeholder management

Leadership

Python/Scala coding

Tools

Databricks

Delta Lake

Unity Catalog

MLflow

Apache Spark

Terraform

Job description

Empiric is seeking a Databricks Architect to own the design and delivery of a modern lakehouse platform. You will lead moves from legacy data systems to Databricks, set technical direction for data engineering and ML workloads, and mentor engineers while staying hands-on with code.

This role focuses on architecture, roadmapping, and aligning delivery teams with business priorities, while enabling scalable, secure data and ML workflows.