ETL/ Datawarehouse QA

TechDigital Group; San Antonio (TX); On-site; USD 60,000 - 100,000; Full time

Job summary

An established industry player is seeking a QA Engineer to define and implement QA strategies for a hybrid ETL stack. This role involves validating data transformations using Informatica and dbt, ensuring data integrity, and automating testing processes. The ideal candidate will have strong SQL skills and experience with CI/CD pipelines. Join a dynamic team where your contributions will enhance data quality and drive the success of analytics initiatives. If you're passionate about quality assurance and data integrity, this is the perfect opportunity for you.

Qualifications

• Experience with Informatica and dbt for ETL processes.
• Strong SQL skills for data validation and reconciliation.

Responsibilities

• Define QA strategy for ETL stack involving Informatica and dbt.
• Validate data transformations and monitor job runs via Informatica.

Skills

SQL

Informatica

dbt

Data Validation

ETL Processes

Automation

CI/CD Pipelines

Defect Management

Education

Bachelor's Degree in Computer Science or related field

Tools

JIRA

git

Job description

Responsibilities

1. QA Strategy and Planning
   • Define QA strategy for a hybrid ETL stack involving Informatica and dbt for transformation/modeling.
   • Analyze STTMs (Source-to-Target Mapping documents), business rules, and dbt model definitions to derive test scope.
   • Plan and manage test phases across Program Increments (PIs) or releases: unit testing support, system testing, integration testing, and UAT support.
2. Informatica-Specific QA Responsibilities
   • Review and validate Informatica mappings, workflows, sessions, and parameter files.
   • Validate source data extraction (flat files, RDBMS, mainframes, etc.), data transformations, and load strategies to staging/ODS layers.
   • Use SQL queries and data comparison tools for reconciliation and validation.
   • Validate job dependencies, control table mechanisms, and monitor job runs via Informatica Monitor/Workflow logs.
3. dbt-Specific QA Responsibilities
   • Validate dbt models, tests, and documentation.
   • Review and test model SQL logic, YAML files, and dbt tests.
   • Execute dbt test suites, investigate failures, and collaborate with analytics engineers on model strategies.
   • Review generated SQL to ensure correct transformations.
4. Data Validation & Reconciliation
   • Perform data validation across source to analytics layers.
   • Write complex SQL queries for data comparison and validation.
   • Ensure data consistency, integrity, and validate PII masking where applicable.
5. Automation and DevOps Integration
   • Build reusable SQL-based test automation scripts.
   • Integrate QA checks into CI/CD pipelines using git Actions.
   • Monitor and validate batch schedules and jobs, and contribute to QA dashboards and reports.
6. Defect Management & Reporting
   • Log and track defects in JIRA, categorize by layer and severity.
   • Facilitate defect triage calls and provide status reports and coverage metrics.