Azure Data Platform Engineer - Scale & Automate Data Pipelines

Five Guys Enterprises; Alexandria (VA); On-site; USD 140,000 - 190,000; Full time

Job summary

Five Guys Enterprises is seeking a Data Platform Engineer (Azure) to design, build, and operate the enterprise data platform on Microsoft Azure. You will implement IaC, manage CI/CD pipelines, and ensure observability, security, and cost controls across data workloads.

You will collaborate with Data Engineering, IT Infrastructure, Cybersecurity, and business stakeholders to deliver scalable data pipelines, governance, and reliable analytics capabilities in a fast-paced environment.

Qualifications

• Design, implement, and maintain IaC for Azure data environments.
• Build and support scalable, secure Azure cloud environments.
• Administer and govern Databricks workspaces and platforms.

Responsibilities

• Design, implement, and maintain Infrastructure as Code (IaC) for Azure-based data environments using Terraform, Bicep, and/or ARM Templates.
• Build and support highly available, scalable, and secure Azure cloud environments.
• Configure and maintain Azure networking components including VNETs, Private Endpoints, NSGs, and policies.
• Build and maintain CI/CD pipelines using Azure DevOps and/or GitHub Actions.
• Automate deployment of Data Factory, Databricks Notebooks, Data Pipelines, and platform services.
• Establish deployment standards and environment promotion processes.
• Manage source control, versioning, branching strategies, and release processes.
• Administer Databricks workspaces and governance (Cluster Provisioning, Unity Catalog, Access Controls).
• Manage Azure Data Lake Storage Gen2 and data governance controls.
• Implement observability via Azure Monitor, Log Analytics, alerts, and dashboards.
• Participate in incident response and root cause analysis.
• Automate secrets management using Azure Key Vault; support IAM initiatives.
• Monitor costs and optimize cloud consumption (FinOps).
• Document architecture, procedures, runbooks, and incident processes.

Skills

Azure

Terraform

Databricks

CI/CD

SRE

Security

Observability

PowerShell/Python

GitHub Actions

Education

Bachelor's degree

Tools

Terraform

Bicep

ARM Templates

Azure DevOps

GitHub Actions

Databricks

PowerShell

Job description

Five Guys Enterprises is seeking a Data Platform Engineer (Azure) to design, build, and operate the enterprise data platform on Microsoft Azure. You will implement IaC, manage CI/CD pipelines, and ensure observability, security, and cost controls across data workloads.

You will collaborate with Data Engineering, IT Infrastructure, Cybersecurity, and business stakeholders to deliver scalable data pipelines, governance, and reliable analytics capabilities in a fast-paced environment.