Senior Data Engineer - India - (Profisee)

Quantiphi; Hinoba-an; On-site; PHP 995,000 - 1,724,000; Full time

Job summary

Quantiphi in Mumbai, Bengaluru, and Trivandrum seeks a Senior Data Engineer to design and implement enterprise MDM solutions using Profisee or alternatives like Informatica MDM or Reltio. This role requires 3-5 years of data engineering and strong MDM knowledge.

You will build and optimize ETL/ELT pipelines with Azure Data Factory and Databricks, ensure data quality, and collaborate with stakeholders in a hybrid work culture.

Qualifications

• 3+ years of hands-on Data Engineering experience with enterprise data integration and MDM.
• Hands-on experience with Profisee MDM is highly preferred.
• Strong understanding of MDM concepts including: Golden Record, Matching, Deduplication, Survivorship.
• Strong SQL skills and experience with relational databases.
• Strong programming skills in Python and/or PySpark.
• Experience designing and developing ETL/ELT and data integration pipelines.
• Experience with Azure Data Factory, Databricks/Spark, or equivalent data integration technologies.
• Experience integrating MDM platforms with APIs, databases, data lakes, data warehouses, and downstream applications.
• Understanding of data modeling, metadata, lineage, data quality, and governance.
• Experience with incremental loads, CDC, data reconciliation, error handling, and production support.
• Good understanding of Agile development methodologies.

Responsibilities

• Design and develop MDM solutions using Profisee, with Informatica MDM or Reltio as an alternative.
• Develop scalable data ingestion, integration, transformation, and publishing pipelines for master data.
• Implement data cleansing, standardization, validation, matching, deduplication, and survivorship rules to create trusted Golden Records.
• Design and implement Golden Record/Golden Entity, hierarchy, and relationship management solutions.
• Integrate MDM platforms with databases, APIs, data lakes, data warehouses, and downstream applications.
• Develop and maintain ETL/ELT pipelines using technologies such as Azure Data Factory, Databricks/Spark, or equivalent tools.
• Implement incremental/CDC processing, error handling, reconciliation, and data quality checks.
• Analyze and troubleshoot complex data integration, MDM, and data quality issues in production environments.
• Collaborate with Data Architects, Data Governance teams, Business stakeholders, and application teams to understand requirements and design effective MDM solutions.
• Define and maintain data mappings, transformation rules, business rules, data models, and technical documentation.
• Ensure solutions follow enterprise standards for data quality, security, governance, metadata, and lineage.
• Participate in solution design, code reviews, testing, deployment, and production support.
• Provide technical guidance and mentor junior data engineers and contribute to continuous improvement of MDM and data engineering practices.

Skills

MDM

Profisee

Python

PySpark

SQL

Azure Data Factory

Databricks

Spark

ETL/ELT

API integration

Tools

Profisee MDM

Informatica MDM

Reltio

Azure Data Factory

Databricks

Python

PySpark

SQL

Job description

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth. If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

Role: Senior Data Engineer (Informatica or Reltio)

Experience Level: 3 to 5 Years

Work location: Mumbai, Bangalore & Trivandrum

Role & Responsibilities:

• Design and develop enterprise Master Data Management (MDM) solutions using Profisee, with experience in Informatica MDM or Reltio as an alternative.
• Develop scalable data ingestion, integration, transformation, and publishing pipelines for master data.
• Implement data cleansing, standardization, validation, matching, deduplication, and survivorship rules to create trusted Golden Records.
• Design and implement Golden Record/Golden Entity, hierarchy, and relationship management solutions.
• Integrate MDM platforms with databases, APIs, data lakes, data warehouses, and downstream applications.
• Develop and maintain ETL/ELT pipelines using technologies such as Azure Data Factory, Databricks/Spark, or equivalent tools.
• Implement incremental/CDC processing, error handling, reconciliation, and data quality checks.
• Analyze and troubleshoot complex data integration, MDM, and data quality issues in production environments.
• Collaborate with Data Architects, Data Governance teams, Business stakeholders, and application teams to understand requirements and design effective MDM solutions.
• Define and maintain data mappings, transformation rules, business rules, data models, and technical documentation.
• Ensure solutions follow enterprise standards for data quality, security, governance, metadata, and lineage.
• Participate in solution design, code reviews, testing, deployment, and production support.
• Provide technical guidance and mentor junior data engineers and contribute to continuous improvement of MDM and data engineering practices.

Skills expectation:

• 3+ years of hands-on Data Engineering experience with strong experience in enterprise data integration and Master Data Management.
• Hands-on experience with Profisee MDM is highly preferred.
• Strong understanding of MDM concepts including: Golden Record / Golden Entity Matching & Deduplication Survivorship Data Quality & Standardization Hierarchy Management Reference Data Entity Resolution Data Governance
• Strong SQL skills and experience with relational databases.
• Strong programming skills in Python and/or PySpark.
• Experience designing and developing ETL/ELT and data integration pipelines.
• Experience with Azure Data Factory, Databricks/Spark, or equivalent data integration technologies.
• Experience integrating MDM platforms with APIs, databases, data lakes, data warehouses, and downstream applications.
• Understanding of data modeling, metadata, lineage, data quality, and governance.
• Experience with incremental loads, CDC, data reconciliation, error handling, and production support.
• Good understanding of Agile development methodologies.

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Thank you for your interest in Quantiphi! We are a team that dreams together and collaborates to ensure success.

We are currently looking for exceptional individuals who can join us and contribute to a fun, diverse and hybrid work culture. As a part of the Quantiphi family, you will get ample opportunities to learn, grow and interact with colleagues from varied experience and backgrounds around the globe.

Quantiphi is an award-winning AI‑first digital engineering company driven by the desire to reimagine and realize transformational opportunities at the heart of business. We solve the toughest and most complex business problems with the latest and cutting‑edge technologies and to make this happen, we have a vibrant, diverse and talented set of professionals we proudly refer to as the Quantiphi family. Our culture is built on transparency, diversity, integrity, learning and growth. We are committed to provide our teams with an environment that helps them to learn, grow and flourish in their professional as well as personal lives.