Remote Databricks Platform Architect

SFE; Edison (NJ); Remote; USD 110,000 - 165,000; Full time

Job summary

SFE is seeking a Data Architect to oversee a remote, long‑term contract for enterprise Databricks platform administration. You will manage Unity Catalog, compute policies, and security controls while driving CI/CD pipelines for notebooks and jobs.

You will partner with data engineering and architecture teams to define standards, governance, and best practices, ensuring scalable, cost‑effective workloads in cloud environments.

Qualifications

• 8+ years of data engineering/architecture experience with cloud platforms.
• 4+ years specifically working with Databricks.
• Experience with Unity Catalog, compute policies, and platform security controls.
• Experience establishing CI/CD and automated deployment patterns for Databricks jobs.

Responsibilities

• Engineer and administer an enterprise Databricks platform for secure, scalable data workloads.
• Configure and manage Unity Catalog, compute policies, permissions, service principals, and platform security controls.
• Establish CI/CD and automated deployment patterns for Databricks jobs, notebooks and configurations.
• Monitor and troubleshoot platform, cluster and workload performance; drive reliability and cost optimization.
• Collaborate with data engineering and architecture teams to set Databricks standards and governance.

Skills

Databricks platform administration

CI/CD for data platforms

Cloud data governance

Tools

Databricks

Terraform

Azure DevOps

Unity Catalog

Job description

SFE is seeking a Data Architect to oversee a remote, long‑term contract for enterprise Databricks platform administration. You will manage Unity Catalog, compute policies, and security controls while driving CI/CD pipelines for notebooks and jobs.

You will partner with data engineering and architecture teams to define standards, governance, and best practices, ensuring scalable, cost‑effective workloads in cloud environments.