Senior Data Quality SDET - Databricks & Fabric

DataArt Poland sp. z o.o.; Warszawa; On-site; PLN 120,000 - 190,000; Full time

Job summary

DataArt Poland sp. z o.o. is seeking a seasoned Quality Engineer focused on data testing and validation.

You will design and implement QA frameworks for data pipelines and products, ensuring source-to-target reconciliation and robust regression packs. The role emphasizes automated tests within CI/CD and handling schema drift to protect release quality. The project migrates data from legacy systems to a modern platform built on Databricks and Microsoft Fabric.

Qualifications

• 5+ years of experience in quality engineering.
• Strong Python and SQL skills, used for building test automation.
• Experience with pipeline validation, including row counts, control totals, referential integrity, and business rule assertions.
• Experience with source to target reconciliation using defined tolerances.
• Experience with test automation within CI/CD, including gates that block a release.
• Experience with Azure DevOps.
• Experience with SQL Server.
• English proficiency at a level suitable for direct client conversations.

Responsibilities

• Design and implement data testing and quality assurance frameworks.
• Build automated validation for data pipelines and data products.
• Own source to target reconciliation between legacy systems and the new platform.
• Build repeatable regression packs that run unattended.
• Write unit tests that execute automatically within CI/CD, with quality gates that can block a release.
• Detect and handle schema drift and unexpected structural changes.
• Validate reports, dashboards, and semantic models, including measure definitions, filter behaviour, and totals.
• Apply AI assisted techniques to test generation and coverage analysis, with human review.

Skills

Quality engineering

Python

SQL

CI/CD testing

Azure DevOps

SQL Server

English communication

Tools

Azure Databricks

dbt

Great Expectations

Databricks

Soda

Deequ

Job description

DataArt Poland sp. z o.o. is seeking a seasoned Quality Engineer focused on data testing and validation.

You will design and implement QA frameworks for data pipelines and products, ensuring source-to-target reconciliation and robust regression packs. The role emphasizes automated tests within CI/CD and handling schema drift to protect release quality. The project migrates data from legacy systems to a modern platform built on Databricks and Microsoft Fabric.