Azure Data Engineer

SRS Infoway; Pune District; Hybrid; INR 900,000 - 1,500,000; Full time

Job summary

SRS Infoway is seeking a Data Engineer to design and optimize scalable batch and real-time data pipelines on Azure. The role emphasizes building ETL/ELT workflows with Databricks and Azure Data Factory, implementing Lakehouse architectures with Delta Lake, and integrating data from multiple sources.

The ideal candidate will ensure data quality, security, and governance while collaborating with stakeholders to deliver analytics solutions and dashboards in a fast-paced environment.

Qualifications

• Design, build, and optimize scalable batch and real-time data pipelines on Azure.
• Develop ETL/ELT workflows using Databricks and Azure Data Factory.
• Implement Lakehouse architectures using Delta Lake and Medallion layers (Bronze-Silver-Gold).
• Integrate data from multiple enterprise and external sources.
• Ensure data quality, performance, security, and governance standards.
• Collaborate with business and technical stakeholders to deliver analytics solutions and dashboards.

Responsibilities

• Design, build, and optimize scalable batch and real-time data pipelines on Azure.
• Develop ETL/ELT workflows using Databricks and Azure Data Factory.
• Implement Lakehouse architectures using Delta Lake and Medallion (Bronze-Silver-Gold) layers.
• Integrate data from multiple enterprise and external sources.
• Ensure data quality, performance, security, and governance standards.
• Collaborate with business and technical stakeholders to deliver analytics solutions and dashboards.

Skills

Azure Databricks

PySpark/Scala

Spark SQL

Delta Lake

Power BI

SQL Optimization

CI/CD

Git

Unity Catalog

Data Governance & Security

Tools

Azure Data Factory (ADF)

ADLS Gen2

Azure SQL/Synapse

Event Hubs/Kafka

Job description

We are looking for a Data Engineer with 810 years of experience, including 4+ years of hands‑on expertise in Azure Databricks and Azure data services.

Key Skills: Azure Databricks, PySpark/Scala, Spark SQL, Delta Lake

Azure Data Factory (ADF), ADLS Gen2

Azure SQL/Synapse, Event Hubs/Kafka

Power BI, SQL Optimization

CI/CD (Azure DevOps/GitLab), Git

Unity Catalog, Data Governance & Security

• Responsibilities: Design, build, and optimize scalable batch and real-time data pipelines on Azure.
• Develop ETL/ELT workflows using Databricks and Azure Data Factory.
• Implement Lakehouse architectures using Delta Lake and Medallion (Bronze-Silver-Gold) layers.
• Integrate data from multiple enterprise and external sources.
• Ensure data quality, performance, security, and governance standards.
• Collaborate with business and technical stakeholders to deliver analytics solutions and dashboards.