Microsoft Azure Data services

Orcapod Consulting Services; Pune District; On-site; INR 1,800,000 - 2,400,000; Part time

Job summary

Orcapod Consulting Services in Pune is seeking an experienced Microsoft Azure Data Engineer to design, develop, and maintain scalable data pipelines on the Azure cloud. You will build ETL/ELT processes, work with ADLS Gen2, Azure Data Factory, and Azure Databricks to deliver analytics-ready datasets for data scientists and analysts.

The role requires strong PySpark, SQL, and Python skills, with hands‑on experience in CI/CD using Azure DevOps and Git, plus solid data warehousing concepts and

Qualifications

• 6+ years of experience in Azure data engineering.
• Hands-on experience with Azure Data Factory (ADF).
• Strong PySpark/ Spark and Python skills.
• Experience with ADLS Gen2 and data warehousing concepts.

Responsibilities

• Design, develop, and maintain ETL/ELT pipelines using ADF.
• Build scalable data processing with Databricks and PySpark.
• Develop and maintain data lakes (ADLS Gen2) and warehousing solutions.
• Write optimized SQL queries and database objects.
• Collaborate with data scientists and analysts on analytics-ready datasets.
• Implement CI/CD pipelines using Azure DevOps and Git.

Skills

ETL/ELT design

Python

SQL

PySpark

Apache Spark

Azure Data Factory

Azure Databricks

Azure Data Lake Storage Gen2

Azure DevOps

Git

REST APIs

Agile/Scrum

Tools

Azure Data Factory

Azure Databricks

ADLS Gen2

Azure DevOps

Git

PySpark

Job description

Job Title: Microsoft Azure Data Engineer

Location: Pune
Experience: 610 Years
Employment Type: Contract

Job Summary

We are looking for an experienced Microsoft Azure Data Engineer to design, develop, and maintain scalable data engineering solutions on the Azure cloud platform. The ideal candidate should have strong expertise in building ETL pipelines, Azure Data Factory, Azure Databricks, Azure Data Lake, Python/Scala, SQL, and modern data warehousing concepts. The candidate will work closely with business stakeholders, data scientists, and analysts to deliver high-quality data solutions that support analytics and machine learning initiatives.

Key Responsibilities

• Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory (ADF).
• Build scalable data processing solutions using Azure Databricks and PySpark/Spark.
• Develop and maintain data lakes using Azure Data Lake Storage (ADLS Gen2).
• Design and optimize data warehouse solutions using dimensional modeling techniques.
• Develop data integration solutions from multiple structured and unstructured data sources.
• Write optimized SQL queries, stored procedures, and database objects.
• Collaborate with data scientists and business analysts to deliver analytics-ready datasets.
• Implement CI/CD pipelines using Azure DevOps and Git.
• Monitor, troubleshoot, and optimize Azure data pipelines for performance and reliability.
• Participate in Agile ceremonies, code reviews, and technical discussions.

Required Skills

• 6+ years of experience in Azure Data Engineering.
• Hands‑on experience with Azure Data Factory (ADF).
• Strong experience with Azure Databricks and Apache Spark/PySpark.
• Experience with Azure Data Lake Storage (ADLS Gen2).
• Strong programming skills in Python (Scala is an added advantage).
• Advanced SQL knowledge and experience with relational databases such as SQL Server, PostgreSQL, or Oracle.
• Experience with ETL development and data warehousing concepts.
• Hands‑on experience with Azure DevOps, Git, and CI/CD pipelines.
• Experience working with REST APIs for data integration.
• Good understanding of Agile/Scrum methodologies.