Senior Data Engineer MDM Data Vault

Forward Eye Technologies; Pune District; On-site; INR 450,000 - 700,000; Full time

Job summary

Forward Eye Technologies is seeking an experienced data engineer to design and implement DBT-based data models and abundance of MDM using Data Vault 2.0 principles. You will build scalable data warehousing solutions on Snowflake, write complex SQL, and automate data quality checks with Python.

The role emphasizes collaboration with data analysts, data scientists, and business stakeholders to deliver robust data solutions aligned with business needs.

Qualifications

• Minimum 8 years of experience in data engineering or related roles.
• Proven expertise in DBT-based data modeling concepts and best practices, including project structure, testing automation, packages, and deployment.
• Experience implementing Data Vault 2.0 architecture and MDM solutions, including knowledge of Hubs, Links, and Satellites.
• Strong proficiency in SQL programming, including the ability to create and debug stored procedures, functions, and views.
• Experience with Python for scripting and automation tasks.
• Knowledge of data warehousing concepts and experience working with Snowflake or similar platforms.

Responsibilities

• Design and develop DBT-based data models and entities.
• Implement Data Vault 2.0 architecture for MDM.
• Design, develop, and maintain data structures in a data warehouse (Snowflake).
• Create, debug, and optimize SQL procedures, functions and views.
• Use Python for scripting and automation tasks and quality checks.
• Collaborate with data analysts, data scientists, and stakeholders to deliver data solutions.

Skills

Data modeling

MDM

Data quality

SQL proficiency

Python scripting

Communication

Tools

DBT (Data Build Tool)

Snowflake

Airflow

Data warehousing

SQL

Python

Job description

Job Responsibilities :

MDM Data Vault Design and Development :

• Efficiently design and develop DBT-based data models and entities by understanding project requirements.
• Implement Data Vault 2.0 architecture principles, including the creation of Hubs, Links, and Satellites for master data management (MDM).

Data Warehousing :

• Design, develop, and maintain robust data structures to facilitate efficient data processing, storage, and retrieval within an enterprise data warehouse (Snowflake).
• Collaborate with data architects to ensure data warehousing solutions align with business needs and scalability requirements.

SQL Development :

• Create, debug, and optimize stored procedures, functions, and views to ensure data accuracy, performance, and availability.
• Write complex SQL queries to support data integration, transformation, and reporting needs.

Python Scripting and Automation :

• Utilize Python for scripting and automation tasks to enhance data workflows and streamline processes.
• Develop automated data quality checks and data validation routines using Python and other relevant tools.

Data Quality Assurance :

• Implement data quality checks and processes to validate and cleanse data, ensuring integrity and accuracy.
• Identify and resolve data anomalies and inconsistencies proactively.

Collaboration and Stakeholder Engagement :

• Work closely with cross-functional teams, including data analysts, data scientists, and business stakeholders, to understand data requirements.
• Deliver actionable insights and data solutions that meet business objectives.

Required Qualifications :

Experience :

• Minimum of 8 years of experience in data engineering or related roles.
• Proven expertise in DBT-based data modeling concepts and best practices, including project structure, testing automation, packages, and deployment.
• Experience implementing Data Vault 2.0 architecture and MDM solutions, including knowledge of Hubs, Links, and Satellites.

Technical Skills :

• Strong proficiency in SQL programming, including the ability to create and debug stored procedures, functions, and views.
• Experience with Python for scripting and automation tasks.
• Knowledge of data warehousing concepts and experience working with Snowflake or similar platforms.
• Familiarity with data orchestration tools such as Airflow is preferred.

Soft Skills :

• Self-motivated with a strong sense of ownership and responsibility for projects.
• Strong problem-solving skills and meticulous attention to detail.
• Excellent communication skills for effective collaboration with technical and non-technical stakeholders.

Keywords :

• Data Vault 2.0
• Python
• MDM
• DBT (Data Build Tool)
• Data Warehousing
• SQL
• Snowflake
• Data Quality Assurance