Job Overview
Title: Data and DevOps Engineer Technical Specialist
Resume Due Date:September 2nd, 2026 (5:00PM EST)
Number of Vacancies: 1
Level: MP5, $90 - $100/hr INC
Duration: 12 Months
Hours of work:35 Hours
Location: CHQ – 1908 Colonel Sam Dr.(Hybrid – 3 days remote)
We are seeking an experienced Azure & Databricks DevOps Engineer to design, automate, secure, and support cloud-based data platforms and DevOps capabilities across Microsoft Azure and Databricks. This role will be responsible for building scalable infrastructure, implementing CI/CD pipelines, managing platform reliability, and enabling data engineering teams to deliver high-quality analytics and data products efficiently.
The ideal candidate has strong hands‑on experience with Azure cloud services, Azure DevOps or GitHub Actions, Terraform, Databricks workspace administration, Unity Catalog, CI/CD automation, security controls, monitoring, and production support.
- Design, deploy, and manage cloud infrastructure on Microsoft Azure using Infrastructure as Code.
- Build and maintain CI/CD pipelines for data engineering, analytics, and platform services.
- Administer and support Azure Databricks workspaces, clusters, jobs, repos, workflows, and permissions.
- Implement and manage Databricks Unity Catalog, including catalogs, schemas, external locations, storage credentials, and access controls.
- Automate deployment of Databricks notebooks, jobs, workflows, libraries, clusters, policies, and workspace configurations.
- Develop reusable DevOps frameworks and deployment templates for data platform teams.
- Manage Azure services such as:
- Azure Data Lake Storage Gen2
- Azure Key Vault
- Azure Synapse Analytics
- Azure Data Factory
- Azure Monitor / Log Analytics
- Azure Functions
- Implement security best practices including RBAC, managed identities, service principals, secrets management, private endpoints, network security, and least‑privilege access.
- Support production operations, incident response, troubleshooting, monitoring, alerting, and performance optimization.
- Collaborate with data engineers, architects, security teams, product owners, and application teams.
- Manage environment promotion across development, UAT, and production environments.
- Support cost monitoring and optimization for Azure and Databricks workloads.
- Create and maintain technical documentation, runbooks, deployment guides, and operational procedures.
Qualifications
- Proven experience as a DevOps Engineer, Cloud Engineer, Data Platform Engineer.
- Strong hands‑on experience with Microsoft Azure cloud services.
- Understanding of cloud identity and access management, including Azure AD / Microsoft Entra ID, RBAC, service principals, managed identities, and group-based access control
- Experience with monitoring and logging tools such as Azure Monitor, Log Analytics, Application Insights, or Databricks system tables.
- Familiarity with Git branching strategies, pull requests, code reviews, and release management.
- Strong troubleshooting, communication, and documentation skills.
- Hands‑on experience with Azure Databricks administration and deployment automation.
- Experience building CI/CD pipelines using one or more of:
- Azure DevOps Pipelines
- GitHub Actions
- Jenkins
- Strong Infrastructure as Code experience using:
- Experience with Databricks platform components, including:
- Workspaces
- Clusters
- Jobs / Workflows
- Repos
- Libraries
- Secret scopes
- Cluster policies
- Unity Catalog
- Strong scripting or programming skills using: