Azure Data Engineer

Advance Career Solutions; Hyderabad; Hybrid; INR 4,000,000 - 7,500,000; Full time

Job summary

Advance Career Solutions in Hyderabad is seeking experienced Azure Data Engineers with hands-on expertise in Azure Data Factory and Databricks to design, develop, and maintain scalable data engineering solutions.

The role focuses on building batch and streaming pipelines, ETL/ELT processes, data migration and transformation, and ensuring data quality, security, and compliance while collaborating with DevOps and data stakeholders.

Qualifications

• Experience designing and developing scalable data pipelines using ADF and Databricks.
• Strong hands-on experience with ETL/ELT processes and data integration patterns.
• Ability to design, implement, and optimize batch and streaming data workflows.
• Deep knowledge of data quality, governance, and security practices.

Responsibilities

• Design and implement scalable batch and streaming data pipelines using ADF and Databricks.
• Develop and maintain efficient ETL/ELT processes.
• Implement data migration, ingestion, transformation, and processing workflows.
• Optimize data pipelines for performance, scalability, and reliability.
• Ensure data quality, security, and compliance.
• Troubleshoot and resolve pipeline and production issues.
• Collaborate with DevOps, product owners, source-data teams, and stakeholders.
• Provide technical guidance and mentorship to junior engineers.
• Drive continuous improvement and follow Azure data engineering best practices.

Skills

ADF

Databricks

Azure Data Engineering

ETL/ELT

Data Pipeline Development

Data Migration & Transformation

Azure cloud services

PySpark / Python

SQL

Streaming data pipelines

DevOps / CI-CD

Data Governance & Security

Production Support

Job description

Azure Data Engineer ADF & Databricks

Experience: 8–22 Years
Location: Hyderabad
Employment Type: Permanent

Job Summary

We are looking for experienced Azure Data Engineers with strong hands-on expertise in Azure Data Factory (ADF) and Databricks to design, develop, and maintain scalable data engineering solutions.

Mandatory Skills

• Azure Data Factory (ADF)
• Databricks
• Azure Data Engineering
• ETL/ELT
• Data Pipeline Development
• Data Migration & Transformation

Key Responsibilities

• Design and implement scalable batch and streaming data pipelines using ADF and Databricks.
• Develop and maintain efficient ETL/ELT processes.
• Implement data migration, ingestion, transformation, and processing workflows.
• Optimize data pipelines for performance, scalability, and reliability.
• Ensure data quality, security, and compliance.
• Troubleshoot and resolve pipeline and production issues.
• Collaborate with DevOps, product owners, source-data teams, and stakeholders.
• Provide technical guidance and mentorship to junior engineers.
• Drive continuous improvement and follow Azure data engineering best practices.

Good-to-Have Skills

• Azure cloud services
• PySpark / Python
• SQL
• Streaming data pipelines
• DevOps / CI-CD
• Data Governance & Security
• Production Support