Azure DevOps Engineer Quincy - MA - Massachusetts

Sierra Business Solution LLC

Quincy (MA)

On-site

USD 120,000 - 190,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Sierra Business Solution LLC is seeking an Azure DevOps Databricks Platform Engineer to design, deploy, and manage Databricks across multiple environments in the Azure cloud. The role emphasizes IaC with Terraform, robust security, and cost-aware cluster optimization.

The candidate should have 7+ years in platform/DevOps roles, 2+ years on Databricks infrastructure, and strong experience with Azure DevOps, CI/CD, scripting, and cloud security. Hybrid or on-site options may be available.

Qualifications

  • 7+ years of platform or DevOps engineering experience.
  • 2+ years Databricks infrastructure setup.
  • 3+ years Azure cloud services experience.
  • 2+ years Azure DevOps (Pipelines, Repos, Artifacts).
  • Strong IaC using Terraform Enterprise.
  • CI/CD knowledge and scripting (Bash, Python).
  • Linux/Unix experience; Docker/Kubernetes familiarity.
  • Networking, security, and identity management in cloud.

Responsibilities

  • Platform & Infrastructure Design, deploy, and manage Databricks workspaces across dev, staging, production.
  • IaC solutions using Terraform for Databricks resources.
  • Establish and maintain security best practices, including RBAC and data governance.
  • Configure and optimize cluster management, including auto-scaling and cost optimization.
  • Manage Databricks workspace connectivity and networking (VNets, private endpoints, firewalls).
  • Build CI/CD pipelines using Azure DevOps for notebooks, jobs, and configurations.
  • Create runbooks and operational procedures; mentor team on Databricks practices.
  • Establish monitoring, alerting, and logging for Databricks environments.
  • Automate workspace provisioning and deprovisioning processes.

Skills

DevOps Engineering
Platform design
Security best practices

Tools

Azure DevOps
Terraform
Databricks
Docker
Kubernetes
Azure

Job description

Azure Devops Databricks platform Engineer

Skills: Azure Devops

Exp: 7+ Years

Key Responsibilities
  • Platform & Infrastructure Design, deploy, and manage Databricks workspaces across multiple Azure subscriptions and environments (dev, staging, production)
  • Implement Infrastructure-as-Code (IaC) solutions using Terraform for Databricks resources
  • Establish and maintain security best practices, including network isolation, RBAC, and data governance
  • Configure and optimize cluster management, including auto-scaling policies and cost optimization strategies
  • Manage Databricks workspace connectivity and networking (VNets, private endpoints, firewalls)
DevOps & Automation
  • Build CICD pipelines using Azure DevOps for deploying Databricks notebooks, jobs, and configurations
  • Implement automated testing and validation of data pipelines
  • Create self-service deployment frameworks and templates for development teams
  • Establish monitoring, alerting, and logging solutions for Databricks environments
  • Automate workspace provisioning and deprovisioning processes
Collaboration & Enablement
  • Partner with data engineers and analysts to understand platform requirements
  • Provide technical guidance and documentation for platform usage
  • Develop runbooks and operational procedures for incident response
  • Mentor team members on Databricks best practices and Azure DevOps tools
Governance & Compliance
  • Implement access controls and audit logging across Databricks workspaces
  • Ensure compliance with organizational security and data governance policies
  • Monitor and manage workspace usage, costs, and resource utilization
  • Document architecture decisions and maintain platform documentation
Required Qualifications
  • 7+ years of experience in platform engineering, infrastructure engineering, or DevOps
  • 2+ years of hands‑on experience with Databricks infrastructure setup (or Apache SparkDelta Lake environments)
  • 3+ years of experience with Azure cloud services and infrastructure
  • 2+ years of experience with Azure DevOps (Pipelines, Repos, Artifacts)
  • Strong proficiency in Infrastructure-as-Code tools (Terraform Enterprise)
  • Solid understanding of CICD principles and implementation
  • Experience with LinuxUnix environments and scripting (Bash, Python, or similar)
  • Familiarity with containerization technologies (Docker, Kubernetes)
  • Strong knowledge of networking, security, and identity management in cloud environments
Preferred Qualifications
  • Experience with Unity Catalog and Databricks governance features
  • Knowledge of Apache Spark architecture and optimization
  • Experience with other IaC tools (Terraform)
  • Familiarity with cost optimization strategies in cloud environments
  • Azure certifications (AZ-900, AZ-104, AZ-305)
  • Databricks Certification Experience with Git and version control workflows Knowledge of data governance and data mesh architectures Experience with monitoring tools (Datadog, New Relic, Azure Monitor)
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Databricks Platform Engineer
Databricks Platform Engineer

KPG99 INC • Quincy (MA)

Hybrid
USD 140,000 - 190,000
Azure Databricks Admin
Azure Databricks Admin

TechDigital Group • Cincinnati (OH)

On-site
USD 110,000 - 160,000
Databricks Platform Engineer
Databricks Platform Engineer

Tata Consultancy Services Limited • Quincy (MA)

On-site
USD 100,000 - 117,000
Discretionary Annual Incentive
Comprehensive Medical Coverage: Health
401K Plan
+2
DataBricks Administrator
DataBricks Administrator

Mothership • Cincinnati (OH)

On-site
USD 120,000 - 160,000
Cloud Engineer Azure Databricks
Cloud Engineer Azure Databricks

Turtle Trax S.A. • United States

Remote
USD 140,000 - 190,000
TOSCA Automation Engineer
TOSCA Automation Engineer

TechDigital Group • Atlanta (GA)

On-site
USD 90,000 - 150,000
Cloud Engineer Azure Databricks
Cloud Engineer Azure Databricks

VALCE T@lent Solutions • United States

Remote
USD 150,000 - 210,000
Databricks Platform Engineer - Azure, IaC & DevOps Expert
Databricks Platform Engineer - Azure, IaC & DevOps Expert

Tata Consultancy Services Limited • Quincy (MA)

On-site
USD 100,000 - 117,000
Discretionary Annual Incentive
Comprehensive Medical Coverage: Health
401K Plan
+2
Databricks Platform Engineer - Azure, IaC & DevOps
Databricks Platform Engineer - Azure, IaC & DevOps

KPG99 INC • Quincy (MA)

Hybrid
USD 140,000 - 190,000
Databricks Platform Engineer | Azure DevOps Expert
Databricks Platform Engineer | Azure DevOps Expert

Sierra Business Solution LLC • Quincy (MA)

On-site
USD 120,000 - 190,000