Senior Data Engineer MDM Data Vault

Forward Eye Technologies; Mumbai, Bengaluru, New Delhi; On-site; INR 4,000,000 - 6,000,000; Full time

Job summary

Forward Eye Technologies seeks an senior data engineer to design and develop MDM/data vault solutions using DBT, with a focus on Data Vault 2.0 principles and data quality. You will build robust data warehouse structures in Snowflake and write efficient SQL, while automating workflows with Python.

You will collaborate with data analysts, scientists, and business stakeholders to deliver scalable data solutions aligned with company objectives.

Qualifications

• Minimum of 8 years of experience in data engineering or related roles.
• Proven expertise in DBT-based data modeling concepts and best practices, including project structure, testing automation, packages, and deployment.
• Experience implementing Data Vault 2.0 architecture and MDM solutions, including knowledge of Hubs, Links, and Satellites.

Responsibilities

• MDM Data Vault Design and Development using DBT and data modeling.
• Design, develop and maintain enterprise Snowflake data warehouse structures.
• Create, debug and optimize stored procedures, functions and views in SQL.
• Use Python for scripting and automation to streamline data workflows.
• Implement data quality checks and data cleansing processes.
• Collaborate with data analysts, data scientists, and stakeholders to meet business needs.

Skills

DBT-based data modeling

Data Vault 2.0

MDM

SQL

Python

Data Warehousing

Tools

DBT (Data Build Tool)

Snowflake

Airflow

Job description

Job Responsibilities :

MDM Data Vault Design and Development :

• - Efficiently design and develop DBT-based data models and entities by understanding project requirements.
• - Implement Data Vault 2.0 architecture principles, including the creation of Hubs, Links, and Satellites for master data management (MDM).

Data Warehousing :

• - Design, develop, and maintain robust data structures to facilitate efficient data processing, storage, and retrieval within an enterprise data warehouse (Snowflake).
• - Collaborate with data architects to ensure data warehousing solutions align with business needs and scalability requirements.

SQL Development :

• - Create, debug, and optimize stored procedures, functions, and views to ensure data accuracy, performance, and availability.
• - Write complex SQL queries to support data integration, transformation, and reporting needs.

Python Scripting and Automation :

• - Utilize Python for scripting and automation tasks to enhance data workflows and streamline processes.
• - Develop automated data quality checks and data validation routines using Python and other relevant tools.

Data Quality Assurance :

• - Implement data quality checks and processes to validate and cleanse data, ensuring integrity and accuracy.
• - Identify and resolve data anomalies and inconsistencies proactively.

Collaboration and Stakeholder Engagement :

• - Work closely with cross-functional teams, including data analysts, data scientists, and business stakeholders, to understand data requirements.
• - Deliver actionable insights and data solutions that meet business objectives.

Required Qualifications :

Experience :

• - Minimum of 8 years of experience in data engineering or related roles.
• - Proven expertise in DBT-based data modeling concepts and best practices, including project structure, testing automation, packages, and deployment.
• - Experience implementing Data Vault 2.0 architecture and MDM solutions, including knowledge of Hubs, Links, and Satellites.

Technical Skills :

• - Strong proficiency in SQL programming, including the ability to create and debug stored procedures, functions, and views.
• - Experience with Python for scripting and automation tasks.
• - Knowledge of data warehousing concepts and experience working with Snowflake or similar platforms.
• - Familiarity with data orchestration tools such as Airflow is preferred.

Soft Skills :

• - Self-motivated with a strong sense of ownership and responsibility for projects.
• - Strong problem-solving skills and meticulous attention to detail.
• - Excellent communication skills for effective collaboration with technical and non-technical stakeholders.

Keywords :

• - Data Vault 2.0
• - Python
• - MDM
• - DBT (Data Build Tool)
• - Data Warehousing
• - SQL
• - Snowflake
• - Data Quality Assurance