Lead Data Platform QA & Automation Engineer

VIRTUSA; Poland; Remote; PLN 250,000 - 360,000; Full time

Job summary

VIRTUSA in Poland is seeking an experienced QA automation professional to design and implement scalable frameworks for data pipelines, APIs, and end-to-end data product validation.

You will drive SQL-based assertions, data contracts, schema validation, and observability integrations using Great Expectations, Soda, Airflow, and cloud tools. The role requires 9+ years in automation with a track record of reliability improvements and strong CI/CD experience.

Qualifications

• 9+ years in automation and QE.
• 5+ years building data platform frameworks at scale.
• Track record of improving reliability and reducing incidents.

Responsibilities

• Own scalable automation framework for data pipelines and APIs.
• Develop data testing with SQL assertions and data contracts.
• Validate schema, lineage, and freshness across pipelines.
• Destructive testing: drift, late-arriving data, partial failures, DLQ handling.
• ETL/Streaming validation at scale: reconciliation and backfill checks.
• Data quality & observability: integrate Great Expectations or Soda.
• CI/CD & DataOps: pre-merge gates, GitHub Actions/Jenkins integration.
• Test data management: synthetic data generation and masking.
• Performance & reliability testing: benchmarks and concurrency tests.
• Security & compliance: PII/PHI exposure checks and controls.
• Cross-functional leadership: collaborate with data engineers and platform teams.
• Incident analysis: root-cause analysis and prevention of flaky tests.

Skills

Python

SQL

Data testing

ETL/ELT

Airflow

DBT

Snowflake

Great Expectations

Soda

CI/CD

Git workflows

AWS

Tools

Terraform

CloudFormation

GitHub Actions

Jenkins

Job description

VIRTUSA in Poland is seeking an experienced QA automation professional to design and implement scalable frameworks for data pipelines, APIs, and end-to-end data product validation.

You will drive SQL-based assertions, data contracts, schema validation, and observability integrations using Great Expectations, Soda, Airflow, and cloud tools. The role requires 9+ years in automation with a track record of reliability improvements and strong CI/CD experience.