Azure Data Engineer

Statusneo Technology Consulting; Gurugram District, Bengaluru; On-site; INR 1,200,000 - 2,000,000; Full time

Job summary

Statusneo Technology Consulting in India seeks an Azure data specialist to design, build, and maintain scalable data pipelines using Azure Data Factory, and to lead migrations from SSIS to ADF.

You will implement CI/CD pipelines, manage infrastructure with Terraform, write PowerShell scripts, and develop code in Python or C# for data processing, while ensuring security, monitoring, and performance across Azure environments.

Qualifications

• Design, build, and maintain scalable data pipelines using Azure Data Factory (ADF).
• Lead migration projects from SSIS to ADF, ensuring performance, reliability, and cost efficiency.
• Implement CI/CD pipelines using Jenkins, GitHub Actions, or Bamboo.
• Develop and manage infrastructure using Terraform (IaC).
• Write and maintain PowerShell scripts for automation and operational tasks.
• Collaborate with cross-functional teams to integrate data solutions with business applications.
• Develop and optimize code in Python or C# for data processing and transformation.
• Ensure best practices in security, monitoring, and performance tuning across Azure environments.

Responsibilities

• Design, build, and maintain scalable data pipelines using Azure Data Factory (ADF).
• Lead migration projects from SSIS to ADF, ensuring performance, reliability, and cost efficiency.
• Implement CI/CD pipelines using Jenkins, GitHub Actions, or Bamboo.
• Develop and manage infrastructure using Terraform (IaC).
• Write and maintain PowerShell scripts for automation and operational tasks.

Skills

Python or C#

PowerShell scripting

Data processing

Tools

Azure Data Factory

SSIS to ADF migration

CI/CD tools (Jenkins, GitHub Actions, Bamboo)

Terraform

Job description

Role & responsibilities

• Design, build, and maintain scalable data pipelines using Azure Data Factory (ADF).
• Lead migration projects from SSIS to ADF, ensuring performance, reliability, and cost efficiency.
• Implement CI/CD pipelines using tools such as Jenkins, GitHub Actions, or Bamboo.
• Develop and manage infrastructure using Terraform (IaC).
• Write and maintain PowerShell scripts for automation and operational tasks.
• Collaborate with cross-functional teams to integrate data solutions with business applications.
• Develop and optimize code in Python or C# for data processing and transformation.
• Ensure best practices in security, monitoring, and performance tuning across Azure environments.

Preferred candidate profile

• Strong hands-on experience with Microsoft Azure services, particularly Azure Data Factory.
• Proven track record of migrating ETL solutions from SSIS to ADF.
• Solid understanding of CI/CD tools (Jenkins, GitHub Actions, Bamboo).
• Proficiency in Terraform for infrastructure automation.
• Intermediate-level PowerShell scripting skills.
• Development experience with Python or C#.
• Strong problem-solving skills and ability to work in agile, fast-paced environments.