Data Platform Engineer (Azure)

Five Guys Enterprises

Alexandria (VA)

On-site

USD 140,000 - 190,000

Full time

2 days ago

Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Five Guys Enterprises is seeking a Data Platform Engineer (Azure) to design, build, and operate the enterprise data platform on Microsoft Azure. You will implement IaC, manage CI/CD pipelines, and ensure observability, security, and cost controls across data workloads.

You will collaborate with Data Engineering, IT Infrastructure, Cybersecurity, and business stakeholders to deliver scalable data pipelines, governance, and reliable analytics capabilities in a fast-paced environment.

Qualifications

Design, implement, and maintain IaC for Azure data environments.
Build and support scalable, secure Azure cloud environments.
Administer and govern Databricks workspaces and platforms.

Responsibilities

Design, implement, and maintain Infrastructure as Code (IaC) for Azure-based data environments using Terraform, Bicep, and/or ARM Templates.
Build and support highly available, scalable, and secure Azure cloud environments.
Configure and maintain Azure networking components including VNETs, Private Endpoints, NSGs, and policies.
Build and maintain CI/CD pipelines using Azure DevOps and/or GitHub Actions.
Automate deployment of Data Factory, Databricks Notebooks, Data Pipelines, and platform services.
Establish deployment standards and environment promotion processes.
Manage source control, versioning, branching strategies, and release processes.
Administer Databricks workspaces and governance (Cluster Provisioning, Unity Catalog, Access Controls).
Manage Azure Data Lake Storage Gen2 and data governance controls.
Implement observability via Azure Monitor, Log Analytics, alerts, and dashboards.
Participate in incident response and root cause analysis.
Automate secrets management using Azure Key Vault; support IAM initiatives.
Monitor costs and optimize cloud consumption (FinOps).
Document architecture, procedures, runbooks, and incident processes.

Skills

Azure

Terraform

Databricks

CI/CD

SRE

Security

Observability

PowerShell/Python

GitHub Actions

Education

Bachelor's degree

Tools

Terraform

Bicep

ARM Templates

Azure DevOps

GitHub Actions

Databricks

PowerShell

Job description

The Data Platform Engineer (Azure) is responsible for building, automating, and operating the infrastructure that supports the organization's enterprise data platform. This role ensures data pipelines, cloud environments, and platform services are reliable, scalable, secure, and observable across Microsoft Azure.

The position focuses on Infrastructure as Code (IaC), DevOps, CI/CD automation, cloud operations, platform governance, FinOps, security, and Site Reliability Engineering (SRE) practices. The Data Platform Engineer partners closely with Data Engineering, IT Infrastructure, Cybersecurity, and Business stakeholders to deliver a stable and high-performing data platform that supports analytics, reporting, and enterprise data initiatives.

Essential Duties & Responsibilities

Cloud Infrastructure & Platform Engineering

Design, implement, and maintain Infrastructure as Code (IaC) for Azure-based data environments using Terraform, Bicep, and/or ARM Templates.
Build and support highly available, scalable, and secure Azure cloud environments.
Configure and maintain Azure networking components including:
- Virtual Networks (VNETs)
- Private Endpoints
- Network Security Groups
- Access Security Policies

Essential Duties & Responsibilities

Cloud Infrastructure & Platform Engineering

Design, implement, and maintain Infrastructure as Code (IaC) for Azure-based data environments using Terraform, Bicep, and/or ARM Templates.
Build and support highly available, scalable, and secure Azure cloud environments.
Configure and maintain Azure networking components including:
- Virtual Networks (VNETs)
- Private Endpoints
- Network Security Groups
- Access Security Policies

CI/CD & Automation

Build and maintain CI/CD pipelines using Azure DevOps and/or GitHub Actions.
Automate deployment of:
- Azure Data Factory
- Databricks Notebooks
- Data Pipelines
- Infrastructure Components
- Platform Services
Establish deployment standards and environment promotion processes across Development, QA, and Production environments.
Manage source control, versioning, branching strategies, and release processes.

Databricks Administration

Administer and govern Databricks workspaces.
Manage:
- Cluster Provisioning
- Cluster Policies
- Cost Controls
- Unity Catalog
- Access Controls
- Identity Management
Support data engineering teams by maintaining a reliable Databricks platform environment.

Data Storage & Platform Governance

Manage Azure Data Lake Storage Gen2 environments.
Configure:
- Access Control Lists (ACLs)
- Lifecycle Management Policies
- Encryption Standards
- Storage Optimization Policies
Ensure compliance with data governance and security requirements.

Monitoring, Reliability & Operations

Implement observability and monitoring strategies using:
- Azure Monitor
- Log Analytics
- Alerting Tools
- Operational Dashboards
Monitor platform performance and reliability.
Troubleshoot:
- Infrastructure Failures
- Performance Bottlenecks
- Platform Incidents
- Cloud Service Issues
Participate in incident response and root cause analysis activities.

Security & Compliance

Automate secrets and credential management using Azure Key Vault.
Support identity and access management initiatives.
Partner with Information Security teams to maintain compliance with governance and security standards.
Implement secure deployment and infrastructure management practices.

Cost Management & Optimization (FinOps)

Monitor Azure and Databricks cloud consumption costs.
Analyze usage trends and identify optimization opportunities.
Recommend cost-saving initiatives while maintaining platform performance and reliability.

Documentation & Operational Excellence

Document:
- Infrastructure Architecture
- Operational Procedures
- Runbooks
- Incident Response Processes
- Platform Standards
Establish best practices for platform reliability and operational support.

QualificationsEducation

Bachelor's degree in Computer Science, Information Systems, Engineering, or related field required.

Experience

5+ years of experience in:
- DevOps
- Platform Engineering
- Site Reliability Engineering (SRE)
- Cloud Infrastructure
- Related technical disciplines
3-5+ years of hands‑on experience with:
- Microsoft Azure
- Databricks
- Azure Data Services
- Cloud Infrastructure Management