Senior Devops Engineer (DataOps-Azure)

YASH Technologies; Pune District; On-site; INR 1,800,000 - 2,800,000; Full time

Job summary

YASH Technologies seeks an experienced Senior DevOps Engineer to lead end‑to‑end Azure DevOps, YAML CI/CD pipelines, and Terraform‑driven infrastructure across multiple projects in Pune. You will design reusable deployment templates, ensure secure, compliant releases, and drive automation for Databricks and Data Factory pipelines.

The role requires 8–15 years of IT experience with strong collaboration and communication skills, enabling independent leadership in a fast‑paced, enterprise

Qualifications

• 8–15 years of IT experience with senior‑level DevOps ownership.
• Strong, hands‑on expertise with Azure DevOps and its internal working model.
• Expert‑level experience building and troubleshooting YAML‑based CI/CD pipelines.
• Strong experience with CI/CD for Azure Databricks.
• Strong experience with CI/CD for Azure Data Factory.
• Proven experience integrating ADO with JIRA, SonarQube, and other external tools.
• Medium to strong hands‑on experience with Terraform for deployment automation and infrastructure lifecycle management.
• Solid understanding of Azure cloud architecture, security, and access patterns.
• Experience supporting shared DevOps platforms across multiple projects.
• Strong analytical, troubleshooting, and problem‑solving skills.
• Ability to work independently as a trusted senior DevOps resource.
• Good communication skills – written and verbal

Responsibilities

• Act as a central/shared DevOps SME supporting multiple projects simultaneously.
• Own and manage Azure DevOps (ADO) end‑to‑end, including repos, pipelines, service connections, variable groups, approvals, and environments.
• Design, implement, and maintain YAML‑based CI/CD pipelines with reusable templates and standards.
• Build and manage CI/CD pipelines for Azure Databricks, including deployment of notebooks, jobs, clusters, and workspace artifacts.
• Build and manage CI/CD pipelines for Azure Data Factory (ADF) using ARM templates and parameterized deployments.
• Troubleshoot and resolve CI/CD pipeline failures, including YAML syntax and template resolution issues, pipeline execution and dependency failures, service principal, permissions, and secret‑related errors, environment‑specific deployment issues (DEV / QA / PROD).
• Implement and maintain multi‑environment deployment strategies with proper promotion controls.
• Integrate Azure DevOps with external tools, including JIRA, SonarQube, and other enterprise DevOps or quality tools.
• Ensure traceability between code commits, pipelines, deployments, and work items.
• Use Terraform to automate deployment of Azure infrastructure and core resources, Azure Databricks workspaces and components, Azure Data Factory, Azure Logic Apps and related services.
• Maintain Terraform modules, state management, and environment separation.
• Enable Infrastructure as Code (IaC) practices for both initial provisioning and ongoing infrastructure changes.
• Collaborate with platform, data engineering, and security teams to ensure secure, compliant, and stable deployments.
• Monitor pipeline health and proactively identify recurring failure patterns.
• Provide guidance and best practices for DevOps and automation across project teams.

Skills

Azure DevOps

YAML pipelines

CI/CD design

Automation

Collaboration

Communication

Multi-project support

Environment governance

Tools

Terraform

Azure Databricks

Azure Data Factory

JIRA

SonarQube

Job description

Responsibilities

• Act as a central/shared DevOps SME supporting multiple projects simultaneously.
• Own and manage Azure DevOps (ADO) end‑to‑end, including repos, pipelines, service connections, variable groups, approvals, and environments.
• Design, implement, and maintain YAML‑based CI/CD pipelines with reusable templates and standards.
• Build and manage CI/CD pipelines for Azure Databricks, including deployment of notebooks, jobs, clusters, and workspace artifacts.
• Build and manage CI/CD pipelines for Azure Data Factory (ADF) using ARM templates and parameterized deployments.
• Troubleshoot and resolve CI/CD pipeline failures, including:
  • YAML syntax and template resolution issues
  • Pipeline execution and dependency failures
  • Service principal, permissions, and secret‑related errors
  • Environment‑specific deployment issues (DEV / QA / PROD)
• Implement and maintain multi‑environment deployment strategies with proper promotion controls.
• Integrate Azure DevOps with external tools, including JIRA, SonarQube, and other enterprise DevOps or quality tools.
• Ensure traceability between code commits, pipelines, deployments, and work items.
• Use Terraform to automate deployment of Azure infrastructure and core resources, Azure Databricks workspaces and components, Azure Data Factory, Azure Logic Apps and related services.
• Maintain Terraform modules, state management, and environment separation.
• Enable Infrastructure as Code (IaC) practices for both initial provisioning and ongoing infrastructure changes.
• Collaborate with platform, data engineering, and security teams to ensure secure, compliant, and stable deployments.
• Monitor pipeline health and proactively identify recurring failure patterns.
• Provide guidance and best practices for DevOps and automation across project teams.

Qualifications

• 8–15 years of overall IT experience with senior‑level DevOps ownership.
• Strong, hands‑on expertise with Azure DevOps (ADO) and its internal working model.
• Expert‑level experience building and troubleshooting YAML‑based CI/CD pipelines.
• Strong experience with CI/CD for Azure Databricks.
• Strong experience with CI/CD for Azure Data Factory.
• Proven experience integrating ADO with JIRA, SonarQube, and other external tools.
• Medium to strong hands‑on experience with Terraform for deployment automation and infrastructure lifecycle management.
• Solid understanding of Azure cloud architecture, security, and access patterns.
• Experience supporting shared DevOps platforms across multiple projects.
• Strong analytical, troubleshooting, and problem‑solving skills.
• Ability to work independently as a trusted senior DevOps resource.
• Good communication skills – written and verbal