ETL Testing with Azure Data Factory

Hexaware Technologies; Hyderabad; Hybrid; INR 3,500,000 - 6,000,000; Full time

Job summary

Hexaware Technologies is seeking a Data Test Lead to define and drive end-to-end data testing strategies for large-scale data migration programs, with a focus on cloud-native architectures and governance.

You will oversee source-to-target validation, data quality, and reconciliation across Ab Initio, Snowflake, and Azure Data Factory, mentoring onsite and offshore QA teams and collaborating with data architects and analysts.

Qualifications

• 10+ years in Data Warehouse and ETL testing, with leadership.
• Experience with cloud-native migration testing methodologies.
• Strong SQL and data validation skills.
• Experience with Ab Initio workflows and data processing.

Responsibilities

• Define and lead end-to-end data testing strategy for large-scale EDW migrations.
• Drive source-to-target reconciliation and transformation validation across Azure Data Factory and dbt.
• Design and automate robust data validation frameworks using SQL and dbt tests.
• Validate complex transformation logic across staging, curated, and reporting layers.
• Mentor distributed QA teams across onsite and offshore delivery models.
• Coordinate SIT, UAT, regression, and production validation activities.
• Track testing progress, defects, data quality KPIs, and reporting metrics.
• Build reusable frameworks for data quality monitoring, automated reconciliation, lineage validation, and regression testing.
• Collaborate with Data Architects, ETL Developers, and Platform Teams to ensure migration success.
• Support root cause analysis and defect triage for data discrepancies and pipeline failures.
• Ensure adherence to governance, audit, and data quality standards.

Skills

Data Warehouse Testing

ETL Testing Leadership

Azure Data Factory

dbt

SQL

Data Validation

Reconciliation Testing

Data Quality Assurance

Stakeholder Management

Team Leadership

Tools

Ab Initio

dbt

Snowflake

Azure DevOps

JIRA

Job description

Job Description: Data Test Lead

Key Responsibilities

• Define and lead the end-to-end data testing strategy for large-scale EDW migration programmes from legacy ETL platforms to cloud-native architectures.
• Drive source-to-target reconciliation, parallel testing, and transformation validation to ensure Azure Data Factory and dbt outputs align with existing Ab Initio processing logic and business rules.
• Design, develop, and automate robust data validation frameworks using:
  • dbt testing capabilities
  • SQL-based reconciliation techniques
  • ADF validation activities
  • Custom validation and audit frameworks
• Validate complex transformation logic, aggregations, business rules, and dimensional models across staging, curated, and reporting layers.
• Lead and mentor distributed QA and testing teams across onsite and offshore delivery models.
• Coordinate SIT, UAT, regression, reconciliation, and production validation activities.
• Track test execution progress, defect management, data quality KPIs, and testing metrics for stakeholder and programme reporting.
• Build reusable frameworks for:
  • Continuous data quality monitoring
  • Automated reconciliation
  • Data lineage validation
  • Source-to-target validation
  • Regression testing
• Collaborate closely with Data Architects, ETL Developers, Business Analysts, and Platform Teams to ensure successful migration delivery.
• Support root cause analysis and defect triage activities for data discrepancies and pipeline failures.
• Ensure adherence to enterprise governance, audit, compliance, and data quality standards.

Required Skills & Experience

• 10+ years of experience in Data Warehouse and ETL Testing, including leadership responsibilities.
• Strong understanding of ETL/ELT concepts and legacy-to-cloud migration testing methodologies.
• Extensive experience in:
  • Data validation
  • Transformation testing
  • Reconciliation testing
  • Source-to-target testing
  • Data quality assurance
• Strong knowledge of Ab Initiocomponents and validation of graphs, mappings, and processing workflows.
• Experience testing Azure Data Factorypipelines, orchestration flows, and metadata-driven frameworks.
• Hands-on expertise in dbtincluding:
  • dbt tests
  • snapshots
  • SQL-based transformation validation
  • model validation
  • lineage verification
• Advanced SQL expertise with modern cloud databases such as Snowflake.
• Strong understanding of dimensional modelling and enterprise data warehousing concepts.
• Experience with defect management and test management tools such as JIRA, Azure DevOps, or equivalent.
• Strong stakeholder management, communication, and leadership capabilities.