Azure Data Engineer

Honeybee Tech Solutions; Pune District; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

Atlas Copco is seeking an Azure Data Engineer with 3+ years of experience to design, build, and maintain scalable data pipelines on the Azure cloud. The role focuses on ETL/ELT processes, data modeling, and ensuring data quality and governance across ADLS, Databricks, Synapse, and SQL databases.

You will collaborate with business and technical teams to translate requirements into production-ready data solutions, optimize performance, and maintain comprehensive documentation.

Qualifications

• 4 to 7 years of relevant experience in Azure Data Engineering.
• Strong experience with Azure Data Services.
• Hands-on experience with ETL technologies and techniques.
• Strong hands-on experience with Python.
• Advanced SQL skills.
• Strong knowledge of Python & PySpark.
• Experience with Data Warehouse Design Concepts.
• ADLS, Azure Synapse Analytics, Azure Data Factory, Azure Databricks, Azure SQL Database.

Responsibilities

• Develop and deploy scalable data solutions on the Azure Cloud Platform.
• Build and maintain ETL/ELT data pipelines from various data sources.
• Work with Azure Data Factory, Databricks, Synapse, ADLS, and Azure SQL.
• Collaborate with business and technical teams to understand data requirements.
• Translate business requirements into production-ready data solutions.
• Design and maintain data models based on business requirements.
• Ensure data quality, security, governance, and compliance.
• Optimize data pipelines and database designs for performance.
• Maintain clear technical documentation for data pipelines and solutions.
• Troubleshoot and resolve data performance and integration issues.

Skills

Python

PySpark

SQL

Azure Data Services

ETL concepts

Data modelling

Data pipelines

Communication

Tools

ADLS

Azure Synapse

Azure Data Factory

Azure Databricks

Azure SQL Database

Azure Data Lake Storage

Job description

We have an urgent requirement for an Azure Data Engineer with 3+ years of experience for our client Atlas Copco.

Must-Have Skills

• 4 to 7 years of relevant experience in Azure Data Engineering
• Strong experience with Azure Data Services
• Hands-on experience with ETL technologies and techniques
• Strong hands‑on experience with Python
• Advanced SQL skills
• Strong knowledge of Python & PySpark
• Experience with Data Warehouse Design Concepts
• Hands‑on experience with:
  • Azure Data Lake Storage (ADLS)
  • Azure Synapse Analytics
  • Azure Data Factory (ADF)
  • Azure Databricks
  • Azure SQL Database
• Experience with Data Warehouse, Data Lake, and Big Data Platform technologies
• Good understanding of data modelling, including conceptual, logical, and physical data models
• Experience optimizing data pipelines for performance
• Strong communication and collaboration skills

Good-to-Have Skills

• Azure Logic Apps
• Azure Functions
• Azure Stream Analytics
• Microsoft Purview
• Machine Learning project exposure
• Terraform
• ARM Templates
• Azure DevOps
• Azure Monitoring & Alerting

Key Responsibilities

• Develop and deploy scalable data solutions on the Azure Cloud Platform
• Build and maintain ETL/ELT data pipelines from various data sources
• Work with Azure Data Factory, Databricks, Synapse, ADLS, and Azure SQL
• Collaborate with business and technical teams to understand data requirements
• Translate business requirements into production-ready data solutions
• Design and maintain data models based on business requirements
• Ensure data quality, security, governance, and compliance
• Optimize data pipelines and database designs for performance
• Maintain clear technical documentation for data pipelines and solutions
• Troubleshoot and resolve data performance and integration issues

Role Summary

The Azure Data Engineer will be responsible for building and maintaining scalable data pipelines and integration solutions on the Azure Data Platform. The role involves delivering secure, reliable, and high-performance data solutions using Azure Data Factory, Azure Databricks, Azure Synapse, ADLS, and Azure SQL, while ensuring data quality, governance, and performance.