Data Architect

SFE; Edison (NJ); Remoto; USD 110.000 - 165.000; Tempo pieno

Descrizione del lavoro

SFE is seeking a Data Architect to oversee a remote, long‑term contract for enterprise Databricks platform administration. You will manage Unity Catalog, compute policies, and security controls while driving CI/CD pipelines for notebooks and jobs.

You will partner with data engineering and architecture teams to define standards, governance, and best practices, ensuring scalable, cost‑effective workloads in cloud environments.

Competenze

• 8+ years of data engineering/architecture experience with cloud platforms.
• 4+ years specifically working with Databricks.
• Experience with Unity Catalog, compute policies, and platform security controls.
• Experience establishing CI/CD and automated deployment patterns for Databricks jobs.

Mansioni

• Engineer and administer an enterprise Databricks platform for secure, scalable data workloads.
• Configure and manage Unity Catalog, compute policies, permissions, service principals, and platform security controls.
• Establish CI/CD and automated deployment patterns for Databricks jobs, notebooks and configurations.
• Monitor and troubleshoot platform, cluster and workload performance; drive reliability and cost optimization.
• Collaborate with data engineering and architecture teams to set Databricks standards and governance.

Conoscenze

Databricks platform administration

CI/CD for data platforms

Cloud data governance

Strumenti

Databricks

Terraform

Azure DevOps

Unity Catalog

Descrizione del lavoro

Title: Data Architect

Location: 100% Remote

Duration: Long term contract

Description:

Databricks Platform Administration, Unity Catalog, Cluster/Compute Management, Security/RBAC, Performance Optimization, Databricks Deployment Azure/AWS, Terraform, Azure DevOps, Asset Bundles, Service Principals, Monitoring/Observability, networking 8+ years, including 4+ years Databricks.

Engineer and administer an enterprise Databricks platform supporting secure and scalable data workloads.

Configure and manage Unity Catalog, compute policies, permissions, service principals and platform security controls.

Establish CI/CD and automated deployment patterns for Databricks jobs, notebooks and platform configuration.

Monitor and troubleshoot platform, cluster and workload performance while driving reliability and cost optimization.

Partner with data engineering and architecture teams to establish Databricks platform standards, governance and best practices.

We are an equal opportunity employer with a diverse workforce.

Please consider the environment before printing.