Senior Databricks Platform Engineer - Azure DataOps

Greystar; South Carolina; Hybrid; USD 125,000 - 150,000; Full time

Benefits offered by this job

Medical, Dental, Vision & Disability

Life insurance

401(k) with company match

Sabbatical after 10 years

Paid time off

Parental leave

Employee Assistance Program

Job summary

Greystar is seeking a senior platform engineer to own Databricks workspace administration and Azure data services integration. You will optimize compute, governance, and data pipelines while enforcing standards and enabling AI-driven observability across the DMP platform.

The role emphasizes platform reliability, cost efficiency, and collaboration with cross-functional teams in a remote, US-wide setting.

Qualifications

• 5+ years of platform engineering, infrastructure engineering, or data operations in a production environment.
• Expert-level Databricks administration: Unity Catalog, cluster policies, workspace mgmt.
• Strong command of the Azure data services ecosystem: ADLS Gen2, ADF, Azure Monitor, Key Vault.
• Hands-on experience with CI/CD pipelines using GitHub Enterprise for data pipelines.

Responsibilities

• Own Databricks workspace administration: upgrades, policies,compute configurations.
• Administer Unity Catalog: access controls, provisioning, governance policies.
• Tune Spark jobs for performance, cost, and reliability; optimize partitioning and Z-ordering.
• Architect and enforce DMP platform standards, naming conventions, schema evolution.
• Build AI-native DataOps capabilities using Databricks Mosaic AI and Genie.

Skills

Databricks administration

Azure data services

CI/CD with GitHub Enterprise

Python/SQL automation

Tools

Databricks

Azure

GitHub Enterprise

Terraform IaC

Job description

Greystar is seeking a senior platform engineer to own Databricks workspace administration and Azure data services integration. You will optimize compute, governance, and data pipelines while enforcing standards and enabling AI-driven observability across the DMP platform.

The role emphasizes platform reliability, cost efficiency, and collaboration with cross-functional teams in a remote, US-wide setting.