DataOps Lead: Azure & Databricks CI/CD Architect

Harvey Nash; New York (NY); Hybrid; USD 140,000 - 160,000; Full time

Job summary

Harvey Nash seeks a DataOps leader to build and scale our data operations from the ground up. You’ll drive CI/CD, standards, automation, and operational discipline across Data Engineering, DevOps, Enterprise Architecture, Security, and BI teams.

The role centers on Azure and Databricks, including SQL, Terraform, and on-prem/cloud data platforms. You’ll be a hands-on technical leader who shapes how data engineering is delivered and operated, while mentoring engineers and enabling teams to deliver

Qualifications

• 8+ years in data engineering, analytics engineering, or platform engineering.
• 3+ years in a lead/senior engineering or data platform role.
• Strong experience with Azure and Databricks/Lakehouse environments.
• Hands-on experience with SQL, Python/PySpark, data pipelines, and orchestration.
• Strong understanding of CI/CD and Azure DevOps.

Responsibilities

• Build and evolve the DataOps operating model, standards, and best practices.
• Lead CI/CD, automation, orchestration, monitoring, and data quality initiatives.
• Partner with Data Engineering, Architecture, Analytics, AI/ML, DevOps, Security teams.
• Improve reliability, scalability, performance, and operational consistency of data platforms.
• Drive cloud cost optimization and operational excellence; mentor engineers and shape the DataOps organization.

Skills

Azure

Databricks/Lakehouse

SQL

Python/PySpark

Data pipelines

Orchestration

CI/CD

Azure DevOps

Tools

ADF

Airflow

Dagster

dbt

Terraform

GitHub Actions

GitLab

Job description

Harvey Nash seeks a DataOps leader to build and scale our data operations from the ground up. You’ll drive CI/CD, standards, automation, and operational discipline across Data Engineering, DevOps, Enterprise Architecture, Security, and BI teams.

The role centers on Azure and Databricks, including SQL, Terraform, and on-prem/cloud data platforms. You’ll be a hands-on technical leader who shapes how data engineering is delivered and operated, while mentoring engineers and enabling teams to deliver