DBT/Informatica Lead

Compunnel, Inc.; Chicago (IL); Vor Ort; USD 120.000 - 150.000; Vollzeit

Zusammenfassung

A data engineering firm based in Chicago is seeking a DBT/Informatica Lead to define the target ELT architecture and lead migrations from Informatica to dbt on Snowflake. The ideal candidate will have over 8 years of experience in data engineering, strong Snowflake expertise, and a proven track record in leading data migrations. Key responsibilities include developing dbt models, establishing best practices, and ensuring high-quality production-grade data pipelines. This role requires a strong understanding of Azure data stack and excellent collaboration skills.

Qualifikationen

• 8+ years of experience in Data Engineering, ETL, and Data Warehousing.
• 3+ years of hands-on dbt experience building production-grade pipelines.
• Proven experience leading an Informatica to dbt migration on Snowflake.
• Strong Snowflake expertise including schema design and performance tuning.
• Solid working knowledge of Azure data stack including ADF and ADLS.

Aufgaben

• Define the target ELT architecture using dbt on Snowflake.
• Lead the migration strategy from Informatica workflows to dbt.
• Analyze ETL logic to design equivalent dbt logic.
• Develop dbt models and ensure secure deployment in Azure.

Kenntnisse

Data Engineering

ETL Modernization

Snowflake Optimization

Azure Ecosystem Integration

Informatica to dbt Migration

Data Modeling Standards

Communication Skills

Tools

dbt

Snowflake

Azure Data Factory

ADLS

Databricks

Jobbeschreibung

The DBT/Informatica Lead will be responsible for defining the target ELT architecture using dbt on Snowflake and leading the migration of legacy Informatica workflows into modern, modular dbt pipelines.

This role requires strong expertise in data engineering, ELT modernization, Snowflake optimization, and Azure data ecosystem integration.

The ideal candidate will drive the migration strategy, establish modeling and coding standards, oversee conversion activities, and ensure high-quality, production‑grade data pipelines.

Key Responsibilities

• Define the target ELT architecture using dbt on Snowflake, integrated with Azure services such as ADF, ADLS, Synapse/Databricks, and Key Vault.
• Establish modeling standards including naming conventions, layer structure (staging, integration, marts), and package organization.
• Define and implement performance‑optimized patterns in dbt and Snowflake (incremental models, clustering, partitioning, query tuning).
• Lead the overall migration strategy and roadmap for converting Informatica workflows to dbt on Snowflake.
• Translate legacy Informatica mappings, sessions, and workflows into modular dbt models.
• Analyze Informatica ETL logic, dependencies, and schedules to design equivalent or improved dbt logic.
• Build a repeatable “migration factory” including templates, accelerators, mapping sheets, and conversion playbooks.
• Oversee conversion, unit testing, and parallel runs to validate output parity (row counts, aggregates, business rules).

dbt Development & Testing

• Lead hands‑on development of dbt models, seeds, snapshots, macros, tests, and documentation.
• Define and implement dbt testing strategy (schema tests, data tests, custom tests) integrated with broader data quality frameworks.
• Set up and maintain dbt environments (dev/test/prod), profiles, and Snowflake connections.
• Enforce code quality practices such as modular design, reusable packages, code reviews, and PR workflows.
• Integrate dbt with Azure Data Factory, ADLS, Azure DevOps/GitHub for orchestration and DevOps enablement.
• Optimize Snowflake performance through warehouse design, schema engineering, and compute optimization.
• Ensure secure and scalable deployment of dbt pipelines within the Azure cloud ecosystem.

Required Qualifications

• 8+ years of experience in Data Engineering, ETL, and Data Warehousing.
• 3+ years of hands‑on dbt experience (Core or Cloud) building production‑grade pipelines.
• Proven experience leading an Informatica ? dbt migration on Snowflake (Azure preferred).
• Strong Snowflake expertise including schema design, performance tuning, and ELT development.
• Solid working knowledge of Azure data stack including ADF, ADLS, Azure DevOps/GitHub.
• Strong understanding of data modeling standards for staging, integration, and data marts.
• Ability to analyze, optimize, and modernize complex ETL logic.
• Excellent communication and stakeholder‑collaboration skills.

Preferred Qualifications

• Experience with Databricks or Azure Synapse pipelines.
• Knowledge of data quality frameworks and testing automation.
• Experience designing reusable frameworks, accelerators, and best‑practice guidelines.
• Exposure to large‑scale cloud migrations or enterprise data modernization initiatives.