Azure Data Engineer

NITYO; Hyderabad; On-site; INR 3,000,000 - 4,600,000; Full time

Job summary

NITYO in Hyderabad seeks an experienced Azure Data Engineer to design, build, and maintain scalable data pipelines for analytics and BI initiatives. You will work with Azure Databricks, PySpark, Delta Lake, and ADLS/ADF/Synapse to deliver robust data solutions.

The role requires strong Python/SQL skills, data governance, and CI/CD practices with Azure DevOps, plus collaboration with stakeholders and analysts to produce reliable runbooks and documentation.

Qualifications

• Strong hands-on experience with Azure Databricks and PySpark.
• Proficiency in Python and SQL.
• Experience with ADLS, ADF, and Synapse deployment.

Responsibilities

• Design, develop, and optimize ETL/ELT pipelines using Azure Databricks and PySpark.
• Build scalable batch and real-time data processing solutions.
• Develop and maintain data ingestion frameworks from multiple data sources.
• Implement data models, Delta Lake architecture, and performance optimization techniques.
• Work with Azure Data Lake Storage (ADLS), Azure Data Factory (ADF), and Azure Synapse Analytics.
• Ensure data quality, security, governance, and monitoring across the platform.
• Troubleshoot and resolve data pipeline performance issues.
• Implement CI/CD processes using Azure DevOps.
• Collaborate with business stakeholders, architects, and data analysts to deliver data solutions.
• Create technical documentation, HLD/LLD, and operational runbooks.

Skills

Azure Databricks

PySpark

Python

SQL

Azure Data Factory

Delta Lake

Unity Catalog

Data Governance

ETL/ELT

Azure DevOps

Job description

Azure Data Engineer

A highly skilled Azure Data Engineer with strong hands-on experience in Azure Databricks, PySpark, and Azure Data Services is required. The candidate will be responsible for designing, developing, and maintaining scalable data pipelines and enterprise data platforms that support analytics, reporting, and business intelligence initiatives.

Key Responsibilities

• Design, develop, and optimize ETL/ELT pipelines using Azure Databricks and PySpark.
• Build scalable batch and real-time data processing solutions.
• Develop and maintain data ingestion frameworks from multiple data sources.
• Implement data models, Delta Lake architecture, and performance optimization techniques.
• Work with Azure Data Lake Storage (ADLS), Azure Data Factory (ADF), and Azure Synapse Analytics.
• Ensure data quality, security, governance, and monitoring across the platform.
• Troubleshoot and resolve data pipeline performance issues.
• Implement CI/CD processes using Azure DevOps.
• Collaborate with business stakeholders, architects, and data analysts to deliver data solutions.
• Create technical documentation, HLD/LLD, and operational runbooks.

Requirements

• Strong experience in Azure Databricks and PySpark.
• Hands‑on expertise in Python and SQL.
• Experience with Azure Data Factory (ADF).
• Experience with Delta Lake, Unity Catalog, and data governance.
• Strong understanding of ETL/ELT, data warehousing, and data modeling.
• Experience with Azure DevOps, Git, and CI/CD pipelines.
• Knowledge of batch and streaming data processing.
• Good analytical, troubleshooting, and communication skills.

Work Arrangements

• Work schedule: 11 a.m. to 8 p.m.
• Work mode: Hybrid (Face to Face, WFO/WFH)
• Shift timings: 11 a.m. to 8 p.m.