Azure Data Engineer

Iagami; Chennai District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Iagami is seeking an experienced data engineer to design and operate scalable data pipelines in Azure, focusing on Databricks, Data Lake, and governance integration. You will implement robust ELT processes, ensure data quality, and collaborate with cross-functional teams to model metadata and catalog data effectively.

The role requires strong SQL and Python skills, experience with Medallion architecture, and hands-on work with Purview, Data Factory, and Synapse.

Qualifications

• Bachelor's degree in computer science, engineering, information systems, or related field.
• Hands-on data engineering with Azure Databricks and Azure Data Lake.
• Proficiency in PySpark, SQL, and ETL/ELT pipeline design.
• Experience building granular data quality checks and integrating governance logic into pipelines.
• Working knowledge of Microsoft Purview for metadata management, lineage, and classification.
• Experience with Azure Data Factory or equivalent orchestration tools.
• Understanding of data modeling, metadata structures, and data cataloging concepts.
• Strong debugging, performance tuning, and problem-solving skills.
• Document pipeline logic and collaborate with cross-functional teams.
• Hands-on experience with Microsoft Fabric or Azure Synapse/Data Factory.
• Strong experience with Fivetran or similar ELT tools.
• Experience handling high-volume datasets (hundreds of millions of records).
• Proficiency in SQL, Python, and data modeling concepts.
• Strong understanding of Medallion architecture.

Skills

PySpark

SQL

ETL/ELT pipelines

Azure Databricks

Azure Data Lake

Data quality checks

Governance in pipelines

Microsoft Purview

Azure Data Factory

Data modeling

Metadata management

Data cataloging

Fivetran

Python

Medallion architecture

Documentation

Cross-functional collaboration

Azure Synapse

Microsoft Fabric

Education

Bachelor's degree in CS/Engineering/IS or related field

Tools

Azure Synapse

Microsoft Fabric

Fivetran

Job description

Required Qualifications

• Bachelors degree in computer science, Engineering, Information Systems, or related field
• Hands-on data engineering experience, with Azure Databricks and Azure Data Lake
• Proficiency in PySpark, SQL, and ETL/ELT pipeline design
• Demonstrated experience building granular data quality checks and integrating governance logic into pipelines
• Working knowledge of Microsoft Purview for metadata management, lineage capture, and classification
• Experience with Azure Data Factory or equivalent orchestration tools
• Understanding of data modeling, metadata structures, and data cataloging concepts
• Strong debugging, performance tuning, and problem-solving skills
• Ability to document pipeline logic and collaborate with cross-functional teams
• Hands-on experience with Microsoft Fabric or Azure Synapse/Data Factory
• Strong experience with Fivetran or similar ELT tools
• Experience handling high-volume datasets (hundreds of millions of records)
• Proficiency in SQL, Python, and data modeling concepts
• Strong understanding of Medallion architecture