Azure Databricks DevOps Engineer - Hybrid NYC

ESR Healthcare; New York (NY); Hybrid; USD 90,000 - 140,000; Full time

Job summary

An established industry player is seeking a skilled Azure Databricks DevOps Administrator to join their dynamic team. This role is pivotal in managing and optimizing the Databricks platform, ensuring seamless operations and security across various environments. You will leverage your expertise in Azure Cloud services and CI/CD practices to automate workflows and enhance data solutions. Collaborating with cross-functional teams, you'll implement best practices in security and monitoring, contributing to innovative data-driven insights. If you are passionate about cloud technologies and thrive in a collaborative environment, this opportunity is perfect for you.

Qualifications

• 7+ years of experience in DevOps with a focus on Azure and Databricks.
• Proficient in scripting languages and automating administrative tasks.

Responsibilities

• Manage and maintain Azure Databricks platform and ensure optimal performance.
• Design and implement CI/CD pipelines using Azure DevOps and GitHub.

Skills

Azure Cloud Services

CI/CD Pipelines

Scripting Languages (Python/PySpark, PowerShell, Bash)

Infrastructure as Code (IaC)

Security Best Practices

Automation

Monitoring & Logging

Data Governance

Education

Bachelor's degree in Computer Science

Bachelor's degree in Information Systems

Bachelor's degree in Engineering

Tools

Azure DevOps

Terraform

Azure Monitor

Log Analytics

Azure Data Factory

Azure Key Vault

Job description

An established industry player is seeking a skilled Azure Databricks DevOps Administrator to join their dynamic team. This role is pivotal in managing and optimizing the Databricks platform, ensuring seamless operations and security across various environments. You will leverage your expertise in Azure Cloud services and CI/CD practices to automate workflows and enhance data solutions. Collaborating with cross-functional teams, you'll implement best practices in security and monitoring, contributing to innovative data-driven insights. If you are passionate about cloud technologies and thrive in a collaborative environment, this opportunity is perfect for you.