Senior Databricks Platform Engineer - Azure DataOps

Greystar Worldwide, LLC; Charleston (SC); Hybrid; USD 125,000 - 150,000; Full time

Benefits offered by this job

Medical benefits

401(k) with company match

Paid time off

Job summary

Greystar is seeking a senior Platform Engineer to join the Data team. You will own Databricks workspace administration, Unity Catalog governance, and Azure infrastructure operations for a Databricks-native medallion architecture on Azure.

You will enforce platform standards, manage identity and access, optimize compute and storage spend, and provide platform support across EDP, DALDW, ADF, Synapse, Cosmos DB, and SQL Server.

Qualifications

• 5+ years of platform engineering, infrastructure engineering, or data operations experience in a production environment.
• Expert-level Databricks administration: Unity Catalog, cluster policies, workspace management, compute configuration, and Delta Lake internals.
• Strong command of the Azure data services ecosystem: ADLS Gen2, ADF, Azure Monitor, Log Analytics, Key Vault, Cost Management, and Event Hub.
• Identity and access management: Azure Active Directory, service principals, RBAC, and Unity Catalog governance policies.

Responsibilities

• Own Databricks workspace administration: upgrades, cluster policies, compute configurations, and Delta table lifecycle management.
• Administer Unity Catalog: access controls, service principal provisioning, governance policies, and data lineage.
• Tune Spark jobs for performance, reliability, and cost — profiling bottlenecks, optimizing partitioning, managing Z-ordering, and controlling compute spend.
• Architect and enforce DMP platform standards: naming conventions, schema evolution policies, SLA tiers, and medallion layer contracts.
• Leverage Databricks Mosaic AI and Genie to build AI-native DataOps capabilities including intelligent pipeline monitoring and anomaly detection.

Skills

Databricks administration

Azure data services

CI/CD automation

Python/SQL scripting

Terraform IaC

Azure DevOps

Security governance

Tools

GitHub Enterprise

Delta Lake

Azure Monitor

ADLS Gen2

ADF

Databricks Mosaic AI

Job description

Greystar is seeking a senior Platform Engineer to join the Data team. You will own Databricks workspace administration, Unity Catalog governance, and Azure infrastructure operations for a Databricks-native medallion architecture on Azure.

You will enforce platform standards, manage identity and access, optimize compute and storage spend, and provide platform support across EDP, DALDW, ADF, Synapse, Cosmos DB, and SQL Server.