DevOps Engineer

Compunnel, Inc.; Irving (TX); Hybrid; USD 90,000 - 120,000; Full time

Job summary

A technology company is seeking a DevOps Engineer to support Azure Synapse and Azure Data Factory. The successful candidate will manage CI/CD pipelines, infrastructure as code, and automation of operational tasks. Key responsibilities include collaborating with data teams, ensuring security compliance, and optimizing Azure data services. Proficiency in Azure DevOps, Terraform, and Python is essential. This role offers a unique opportunity to enhance cloud solutions and foster a DevOps culture.

Qualifications

• Hands-on experience with CI/CD platforms.
• Proficiency in scripting languages including Python and PowerShell.
• Strong understanding of ETL/ELT processes.

Responsibilities

• Design and maintain CI/CD pipelines for data pipelines.
• Provision and manage Azure data services using IaC.
• Monitor performance and troubleshoot pipeline failures.

Skills

CI/CD pipelines

Infrastructure as Code (IaC)

Automation & Scripting

Security & Compliance

Collaboration

Tools

Azure DevOps

GitHub Actions

Terraform

Bicep

ARM templates

Python

PowerShell

Bash

Azure Monitor

Log Analytics

Application Insights

Job description

The DevOps Engineer will support Azure Synapse and Azure Data Factory from a DevOps perspective, providing a hybrid skill set spanning cloud infrastructure management, automation, and CI/CD practices. This role is part of the Analytics Platform Engineering team, responsible for deploying Synapse Analytics Workspaces and Azure Data Factory as PaaS offerings for internal teams. The engineer will also contribute to CI/CD solutions, including integration with a custom GitLab-to-GitHub adapter written in GoLang.

Key Responsibilities

• CI/CD Pipelines: Design and maintain continuous integration and deployment pipelines using Azure DevOps or GitHub Actions for data pipelines and infrastructure changes.
• Infrastructure as Code (IaC): Provision and manage Azure data services (Synapse, ADF, Data Lake) using Terraform, ARM templates, or Bicep to ensure consistency and repeatability.
• Platform Operations: Deploy, manage, and optimize Azure data services, monitor performance, and troubleshoot pipeline failures.
• Automation & Scripting: Automate operational tasks and deployments using Python, PowerShell, or Bash.
• Security & Compliance: Implement identity and access management, encryption, and compliance with data governance policies (e.g., GDPR).
• Collaboration: Partner with data engineers, scientists, and analysts to translate requirements into technical solutions and foster a DevOps culture.

Required Qualifications

• Experience with CI/CD platforms (Azure DevOps, GitHub Actions).
• Proficiency in version control (Git) and branching strategies.
• Hands‑on experience with Infrastructure as Code tools (Terraform, Bicep, ARM templates).
• Proficiency in Python, SQL (T‑SQL, query optimization), and scripting languages (PowerShell, Bash).
• Strong understanding of ETL/ELT processes, data modeling, and data warehousing concepts.
• Experience with monitoring and logging tools (Azure Monitor, Log Analytics, Application Insights).
• Excellent problem‑solving, analytical, and communication skills.

Preferred Qualifications

• Experience with Docker and container orchestration (Azure Kubernetes Service – AKS).
• Familiarity with ELT and data engineering practices.
• Experience working in agile, fast‑paced environments.