Remote AI-Driven DataOps Engineer (Databricks & Azure)
greystar
A complete application in a minute — tailored resume and cover letter, ready to send.
Benefits offered by this job
Job summary
Greystar seeks a DataOps Engineer to own AI-driven observability and the Databricks-based DMP platform on Azure. You will manage the full deployment lifecycle, design multi-tenant data ingestions, and partner with governance and product teams to deliver reliable, self-healing data pipelines.
You will apply Delta Live Tables, Unity Catalog, and AI tools to automate diagnostics, monitor data quality, and optimize compute spend across a modern medallion architecture.
Qualifications
- 7+ years of DataOps, data engineering, or platform engineering in production.
- Expert Databricks experience: Delta Live Tables, Jobs/Workflows, Unity Catalog.
- Strong Azure data services knowledge: ADF, ADLS Gen2, Monitor, Key Vault.
- Proven production use of AI tools in DataOps or observability workflows.
- CI/CD with GitHub Enterprise and release management for data pipelines.
- Python and/or Scala skills; SQL for Gold layer transformation.
Responsibilities
- Own AI-driven observability and anomaly detection for data pipelines.
- Develop AI-assisted root cause analysis tooling to reduce MTTR.
- Operate full Azure data services stack for the DMP platform.
- Design and maintain ADF pipelines for multi-tenant ingestions.
- Own deployment pipelines from dev to production with strong governance.
- Collaborate across engineering, governance, and product stakeholders.
Skills
Tools
Job description
Greystar seeks a DataOps Engineer to own AI-driven observability and the Databricks-based DMP platform on Azure. You will manage the full deployment lifecycle, design multi-tenant data ingestions, and partner with governance and product teams to deliver reliable, self-healing data pipelines.
You will apply Delta Live Tables, Unity Catalog, and AI tools to automate diagnostics, monitor data quality, and optimize compute spend across a modern medallion architecture.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
