DataOps Engineer

Greystar

United States

On-site

USD 140,000 - 180,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Greystar is seeking a DataOps Engineer to own the reliability and scalability of the Data Marketplace on Databricks and Azure. You will work within a DataOps pod to ensure robust data infrastructure and observability across the platform.

You will leverage AI-driven diagnostics, manage Delta Live Tables and Unity Catalog, and partner with Azure data services to implement scalable, self-healing pipelines. This senior role emphasizes automation, cost governance, and production-grade tooling.

Qualifications

  • Experience with Databricks and Azure data services.
  • Strong CI/CD discipline and release management experience.
  • Familiarity with AI-driven data observability and pipeline diagnostics.

Responsibilities

  • Own AI-powered observability and anomaly detection for data pipelines.
  • Design and maintain Azure data service pipelines (ADF, ADLS Gen2).
  • Administer Databricks workspace including Unity Catalog and Delta Live Tables.
  • Drive deployment pipelines using CI/CD and environment promotion practices.

Skills

Databricks
Azure
AI/ML
CI/CD
PySpark
DataOps
Observability

Tools

Delta Live Tables
Unity Catalog
Azure Data Factory
ADLS Gen2
Key Vault
Event Hub

Job description

ABOUT GREYSTAR

Greystar is a leading, fully integrated global real estate platform offering expertise in property management, investment management, development, and construction services in institutional-quality rental housing. Headquartered in Charleston, South Carolina, Greystar manages and operates over $350 billion of real estate in more than 260 markets globally with offices throughout North America, Europe, South America, and the Asia-Pacific region. Greystar is the largest operator of apartments in the United States, managing over one million units/beds globally. Across its platforms, Greystar has nearly $79 billion of assets under management, including over $34 billion of development assets and over $36.5 billion of regulatory assets under management. Greystar was founded by Bob Faith in 1993 to become a provider of world‑class service in the rental residential real estate business. To learn more, visit www.greystar.com .


JOB DESCRIPTION SUMMARY

Greystar is seeking a DataOps Engineer to join the Data Marketplace (DMP) team. This is a deeply technical, hands‑on platform engineering role at the core of Greystar’s enterprise data infrastructure - a Databricks‑native medallion architecture (Bronze Silver Gold) running entirely on Microsoft Azure. You will own the reliability, scalability, and operational excellence of the DMP platform, working within DataOps pod inside the broader Analytics Engineering umbrella.


This role is Databricks and Azure‑heavy. Most of your day lives inside Databricks - Delta Live Tables, Unity Catalog, Jobs, Workflows - backed by the full Azure data services stack including ADF, ADLS Gen2, Azure Monitor, Key Vault, and more. Deep mastery of both platforms is a baseline expectation, not a differentiator.


Critically, we expect this engineer to use AI as a first‑class tool in their DataOps and observability practice - today, not eventually. That means AI‑driven pipeline diagnostics, LLM‑assisted root cause analysis, intelligent anomaly detection, and agentic observability agents that surface issues before they reach production. If you are still approaching DataOps the same way you did three years ago, this is not the right role. We are building self‑aware, self‑healing data infrastructure and need an engineer who is already operating that way.


You will also own the full deployment lifecycle - promoting data pipeline changes and platform configurations across dev, staging, and production environments using GitHub Enterprise and Linear for structured release management. Strong CI/CD discipline, environment promotion hygiene, and release coordination are as important here as pipeline engineering craft.


JOB DESCRIPTION


Key Responsibilities


AI-Driven DataOps & Observability


  • Implement AI-powered observability - using LLMs and ML models to detect pipeline drift, classify anomalies, predict SLA risk, and generate automated incident summaries

  • Build agentic monitoring workflows that proactively surface data quality degradation, pipeline dropout, schema drift, and volume anomalies across all DMP layers

  • Integrate AI tooling (Databricks Mosaic AI, Genie, OpenAI APIs, or equivalent) into operational DataOps processes - not as experiments, but as production‑grade capabilities

  • Develop and maintain AI‑assisted root cause analysis tooling to reduce MTTR on pipeline failures, with structured learnings fed back into the platform

  • Contribute to Greystar's 18-month agentic AI roadmap, leading near‑term delivery of self‑healing pipeline capabilities



Azure Infrastructure & Integration


  • Operate the full Azure data services stack supporting DMP: ADLS Gen2, Azure Data Factory (ADF), Azure Monitor, Log Analytics, Key Vault, and Event Hub

  • Design and maintain ADF pipelines for source system ingestion, including orchestration patterns for multi‑tenant ERP environments (Yardi, Entrata, RealPage)

  • Collaborate with Azure infrastructure and cloud engineering teams on networking, identity, security, and resource provisioning

  • Drive cost governance through Azure Cost Management, Databricks DBU optimization, and storage lifecycle policies



Databricks Platform Engineering


  • Own the design, build, and optimization of data pipelines on Databricks using Delta Live Tables (DLT), PySpark, Workflows, and Jobs across the full DMP medallion stack

  • Administer and govern the Databricks workspace: Unity Catalog, cluster policies, access controls, compute configurations, and Delta table lifecycle management

  • Tune Spark jobs for performance, reliability, and cost - profiling bottlenecks, optimizing partitioning, managing Z‑ordering, and controlling compute spend

  • Leverage Databricks Mosaic AI and Genie to build AI‑native DataOps capabilities including intelligent pipeline monitoring, anomaly detection, and natural language data access

  • Architect and enforce DMP platform standards: naming conventions, schema evolution policies, SLA tiers, and medallion layer contracts



CI/CD & Environment Deployments

Own the full deployment pipeline f


Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer, AI & Data Platform
Senior Data Engineer, AI & Data Platform

Greystar • United States

On-site
USD 140,000 - 190,000
Remote DataOps Engineer: AI-Powered Databricks Platform
Remote DataOps Engineer: AI-Powered Databricks Platform

Greystar Worldwide, LLC • Charleston (SC)

Hybrid
USD 120,000 - 150,000
Medical, Dental, Vision
PTO & Holidays
Housing discount
+4
Cloud Platform Engineer
Cloud Platform Engineer

Greystar • United States

On-site
USD 120,000 - 160,000
AI-Driven DataOps Engineer - Azure & Databricks
AI-Driven DataOps Engineer - Azure & Databricks

Greystar • United States

On-site
USD 140,000 - 180,000
AI-Driven DataOps Engineer — Azure & Databricks (Remote)
AI-Driven DataOps Engineer — Azure & Databricks (Remote)

Greystar • Charleston (SC)

Remote
USD 120,000 - 150,000
Medical insurance
Dental insurance
Vision insurance
+6
Remote Data Platform Engineer - Databricks & Azure
Remote Data Platform Engineer - Databricks & Azure

Greystar Management Services, LLC • South Carolina

Hybrid
USD 125,000 - 150,000
Senior Databricks Engineer
Senior Databricks Engineer

Remote • San Francisco (CA)

On-site
USD 150,000 - 190,000
DataOps Engineer
DataOps Engineer

Greystar Worldwide, LLC • Charleston (SC)

Hybrid
USD 120,000 - 150,000
Medical, Dental, Vision
PTO & Holidays
Housing discount
+4
Senior Databricks Platform Engineer - Azure DataOps AI
Senior Databricks Platform Engineer - Azure DataOps AI

Greystar Real Estate Partners, LLC • Mount Pleasant (SC)

Hybrid
USD 125,000 - 150,000
Competitive compensation
401(k) with Company Match
Paid Time off
+3
Remote Data Platform Engineer (Databricks + Azure)
Remote Data Platform Engineer (Databricks + Azure)

Greystar • United States

Remote
USD 125,000 - 150,000
Medical benefits
Dental benefits
Paid time off
+3