Azure Data CI/CD Engineer: Pipelines & Automation

TechDigital Group; Georgia; Hybrid; USD 120,000 - 150,000; Full time

Job summary

TechDigital Group in Georgia seeks a hands-on DevOps Engineer to design, build, and support Jenkins CI/CD pipelines for Azure-based data engineering workloads. You will automate build, test, deployment, configuration, and release processes across development, test, QA, and production environments to ensure reliable data solutions.

You will collaborate with Data Engineers to incorporate pipelines and notebooks into repeatable deployment workflows, manage Git workflows, implement pipeline-as-code,

Qualifications

• Hands-on Jenkins experience required.
• CI/CD design, development, administration, and troubleshooting.
• Strong Microsoft Azure experience.
• DevOps automation to support data workloads.
• Git and enterprise source-control practices.
• PowerShell, Bash, and/or Python scripting.
• Azure Data Factory and/or Azure Databricks deployment experience.
• Automated build, test, deployment, and release-management experience.
• Agile/Scrum delivery experience.
• Strong troubleshooting and root-cause-analysis skills.

Responsibilities

• Design, develop, maintain, and troubleshoot Jenkins CI/CD pipelines for Azure data engineering solutions.
• Automate build, test, deployment, configuration, and release processes across environments.
• Support deployment/release processes for Azure data workloads (ADF, Databricks, Storage).
• Collaborate with Data Engineers to integrate pipelines into repeatable deployment workflows.
• Manage Git branching, merging, PRs, artifacts, and release processes.
• Build pipeline-as-code and reusable automation to reduce manual activities.
• Troubleshoot failures across builds, deployments, permissions, dependencies, credentials, and configs.
• Support Azure identities, secrets, service connections, and secure access for pipelines.
• Implement deployment controls, logging, and traceability in CI/CD lifecycle.
• Assist with production deployments, incident resolution, and root-cause analysis.
• Maintain pipeline docs, runbooks, and operational procedures.
• Participate in Agile/Scrum ceremonies and continuous improvement.

Skills

Jenkins

CI/CD design

Azure

DevOps automation

Git

Scripting (PowerShell/Bash/Python)

ADF/Databricks deployment

Build/deploy automation

Agile/Scrum

Troubleshooting

Tools

Azure Data Factory

Azure Databricks

Azure DevOps

Terraform

Docker

Kubernetes

YAML/JSON

SQL

Job description

TechDigital Group in Georgia seeks a hands-on DevOps Engineer to design, build, and support Jenkins CI/CD pipelines for Azure-based data engineering workloads. You will automate build, test, deployment, configuration, and release processes across development, test, QA, and production environments to ensure reliable data solutions.

You will collaborate with Data Engineers to incorporate pipelines and notebooks into repeatable deployment workflows, manage Git workflows, implement pipeline-as-code,