Azure DevOps Engineer for Data Platform & Databricks

Monogram Health, Inc; Brentwood (TN); On-site; USD 138,000 - 182,000; Full time

Job summary

Monogram Health is seeking a DevOps Engineer to bridge development and operations in a data-driven environment. You will build and maintain CI/CD pipelines in Azure DevOps to deploy notebooks, jobs, and workflows to Azure Databricks, and automate notebook execution.

You will integrate Databricks Repos with Azure Repos, manage IaC with Terraform, and monitor deployments across development, staging, and production. Collaboration with Data Engineers and Platform teams is essential.

Qualifications

• Bachelor’s degree in computer science, information technology, or related field.
• 3+ years of experience in DevOps with a focus on Microsoft Azure.
• Experience with data analytics platforms and automating notebook execution.
• Proficiency in scripting languages for automation and various programming.

Responsibilities

• Develop and maintain CI/CD pipelines in Azure DevOps to deploy notebooks, jobs, and workflows to Azure Databricks.
• Integrate Databricks Repos with Azure Repos (Git) for source control of PySpark/R notebooks.
• Automate job runs in Databricks using Databricks CLI, REST API, or DevOps tasks.
• Maintain infrastructure-as-code practices (e.g., using Terraform).
• Monitor and troubleshoot pipeline failures, notebook issues, and deployment inconsistencies.
• Collaborate with Data Engineers and Platform teams to maintain development, staging, and production environments.
• Implement best practices for version control, testing, and notebook promotion in a multi-environment setup.
• Store and manage Databricks secrets, tokens, and configuration securely within Azure Key Vault and DevOps variable groups.
• Understand and apply DevOps practices in a data platform context.

Skills

Azure DevOps

Scripting languages

Data analytics platforms

AI platforms

Education

Bachelor’s degree in computer science, Information Technology, or related or an equivalent combination of education and experience.

Job description

Monogram Health is seeking a DevOps Engineer to bridge development and operations in a data-driven environment. You will build and maintain CI/CD pipelines in Azure DevOps to deploy notebooks, jobs, and workflows to Azure Databricks, and automate notebook execution.

You will integrate Databricks Repos with Azure Repos, manage IaC with Terraform, and monitor deployments across development, staging, and production. Collaboration with Data Engineers and Platform teams is essential.