Project description
We are seeking a highly experienced and hands-on Senior ETL Test Engineer with at least 7 years of ETL and Data Warehouse testing experience. You will be responsible for validating complex data pipelines, ETL workflows, database transformations, APIs, and data migration processes across enterprise systems.The three primary requirements for this position are:Strong hands-on Python automationAdvanced Oracle database and SQL expertiseExtensive hands-on ETL testing experienceYou need to have strong data testing capabilities with practical Python automation skills. You should be able to independently design test strategies, write complex SQL queries, automate data validation, investigate data discrepancies, and perform end-to-end testing of batch and real-time data pipelines.This is a senior, hands-on engineering position that requires direct involvement in testing, automation, troubleshooting, and defect resolution.
Responsibilities
- Validate end-to-end ETL workflows, including data extraction, ingestion, transformation, loading, and reporting.Review and validate source-to-target mappings, data transformation rules, business rules, and data quality requirements.Design, develop, and execute comprehensive ETL test cases for:Batch data pipelinesReal-time and near-real-time data pipelinesData warehouse solutionsData migration initiativesData integration processesPerform hands-on database testing across Oracle Database and MongoDB environments.Write and execute complex SQL queries for:Source-to-target validationData reconciliationRecord-count verificationDuplicate detectionReferential integrity checksData completeness and accuracy checksTransformation-rule validationAggregation and reporting validationDevelop and maintain reusable test automation frameworks and scripts using Python and PyTest.Use Python to automate data extraction, comparison, reconciliation, validation, and test reporting activities.Validate data files and datasets stored, transferred, or processed through AWS S3.Test REST APIs and verify data flow, payload structure, response codes, error handling, and system-to-system integration.Use tools such as Postman and Swagger to perform API validation and troubleshooting.Perform end-to-end testing of data ingestion, transformation, storage, integration, and reporting processes.Execute functional, integration, regression, system, and data validation testing.Test data warehouse components, including fact tables, dimension tables, staging layers, aggregates, historical data, and reporting outputs.
SKILLS
Must have
- 7+ years of hands-on ETL and Data Warehouse testing experienceStrong hands-on Python development and test automation experienceAdvanced hands-on experience with Oracle Database and SQLStrong experience with ETL testing concepts, methodologies, and validation techniquesProven ability to write complex SQL queries involving:Multiple joinsSubqueriesCommon table expressionsAggregationsAnalytical functionsStored proceduresData reconciliation logicStrong experience validating source-to-target mappings and complex data transformation rulesHands-on experience testing data warehouse and data migration solutionsPractical experience with MongoDB and testing MongoDB-based applicationsHands-on experience validating data stored and processed through AWS S3Strong experience with REST API testingExperience using Postman, Swagger, or similar API testing toolsHands-on experience developing automation scripts and frameworks using PythonPractical experience with PyTest or similar Python testing frameworksExperience performing:Functional testingIntegration testingRegression testingEnd-to-end testingDatabase testingData validation testingStrong knowledge of data reconciliation, data quality, data integrity, and data accuracy validationExperience with defect management tools such as Jira and/or Azure DevOpsStrong analytical, debugging, troubleshooting, and root cause analysis skillsExcellent stakeholder communication, collaboration, and coordination skillsAbility to work independently in a senior, hands-on testing role
Nice to have
N/A