Azure Databrick Developer

Qikrecruit; Gurugram District, Bengaluru, Mumbai; On-site; INR 1,500,000 - 2,300,000; Full time

Job summary

eLabs Infotech in Pune, Mumbai (All Areas) seeks a data engineering specialist to design and deliver scalable data pipelines and governance-driven data quality processes.

You will build workflows with Databricks and PySpark, test MDM systems, and perform migration/integration testing to ensure enterprise-wide data consistency.

Qualifications

• Experience designing end-to-end data pipelines using modern data tooling.
• Strong understanding of data governance and data quality practices.
• Familiarity with MD mappings, data migration and testing processes.

Responsibilities

• Design, develop, and deliver scalable end-to-end data pipelines using Azure Data Factory.
• Build and optimize data engineering workflows using Databricks and PySpark.
• Test MDM systems and workflows and validate master data across systems.
• Perform data migration and integration testing to ensure data integrity.
• Ensure data governance and data quality standards are met.

Skills

Data governance

Data quality

Data migration

Testing

Tools

Azure Data Factory

Databricks

PySpark

Job description

eLabs Infotech

Service based Mid-Sized B2B Firm in IT Services

Pune, Mumbai (All Areas)

Job Description

• Design, develop, and deliver scalable end-to-end data pipelines using Azure Data Factory, ensuring robust integration of enterprise-wide data from diverse sources.
• Build and optimize data engineering workflows using Databricks and PySpark.
• Test MDM systems and workflows.
• Validate master data across systems for consistency and accuracy.
• Perform data migration and integration testing.
• Ensure data governance and data quality standards are met.

Skills highlighted with ‘‘ are preferred keyskills