Senior Data Engineer - MDM & Data Integration

Quantiphi; Hinoba-an; On-site; PHP 995,000 - 1,724,000; Full time

Job summary

Quantiphi in Mumbai, Bengaluru, and Trivandrum seeks a Senior Data Engineer to design and implement enterprise MDM solutions using Profisee or alternatives like Informatica MDM or Reltio. This role requires 3-5 years of data engineering and strong MDM knowledge.

You will build and optimize ETL/ELT pipelines with Azure Data Factory and Databricks, ensure data quality, and collaborate with stakeholders in a hybrid work culture.

Qualifications

• 3+ years of hands-on Data Engineering experience with enterprise data integration and MDM.
• Hands-on experience with Profisee MDM is highly preferred.
• Strong understanding of MDM concepts including: Golden Record, Matching, Deduplication, Survivorship.
• Strong SQL skills and experience with relational databases.
• Strong programming skills in Python and/or PySpark.
• Experience designing and developing ETL/ELT and data integration pipelines.
• Experience with Azure Data Factory, Databricks/Spark, or equivalent data integration technologies.
• Experience integrating MDM platforms with APIs, databases, data lakes, data warehouses, and downstream applications.
• Understanding of data modeling, metadata, lineage, data quality, and governance.
• Experience with incremental loads, CDC, data reconciliation, error handling, and production support.
• Good understanding of Agile development methodologies.

Responsibilities

• Design and develop MDM solutions using Profisee, with Informatica MDM or Reltio as an alternative.
• Develop scalable data ingestion, integration, transformation, and publishing pipelines for master data.
• Implement data cleansing, standardization, validation, matching, deduplication, and survivorship rules to create trusted Golden Records.
• Design and implement Golden Record/Golden Entity, hierarchy, and relationship management solutions.
• Integrate MDM platforms with databases, APIs, data lakes, data warehouses, and downstream applications.
• Develop and maintain ETL/ELT pipelines using technologies such as Azure Data Factory, Databricks/Spark, or equivalent tools.
• Implement incremental/CDC processing, error handling, reconciliation, and data quality checks.
• Analyze and troubleshoot complex data integration, MDM, and data quality issues in production environments.
• Collaborate with Data Architects, Data Governance teams, Business stakeholders, and application teams to understand requirements and design effective MDM solutions.
• Define and maintain data mappings, transformation rules, business rules, data models, and technical documentation.
• Ensure solutions follow enterprise standards for data quality, security, governance, metadata, and lineage.
• Participate in solution design, code reviews, testing, deployment, and production support.
• Provide technical guidance and mentor junior data engineers and contribute to continuous improvement of MDM and data engineering practices.

Skills

MDM

Profisee

Python

PySpark

SQL

Azure Data Factory

Databricks

Spark

ETL/ELT

API integration

Tools

Profisee MDM

Informatica MDM

Reltio

Azure Data Factory

Databricks

Python

PySpark

SQL

Job description

Quantiphi in Mumbai, Bengaluru, and Trivandrum seeks a Senior Data Engineer to design and implement enterprise MDM solutions using Profisee or alternatives like Informatica MDM or Reltio. This role requires 3-5 years of data engineering and strong MDM knowledge.

You will build and optimize ETL/ELT pipelines with Azure Data Factory and Databricks, ensure data quality, and collaborate with stakeholders in a hybrid work culture.