Senior Data Quality Engineer - Databricks & Fabric QA

DataArt; Poland; Hybrid; PLN 120,000 - 190,000; Full time

Benefits offered by this job

Vacation days: Up to 26 business days

Health and life insurance (Luxmed)

English language classes from day one

Flexible workplace: hybrid or remote

Certification reimbursement (AWS, GCP,

Learning platforms access: O'Reilly, L

Mentoring and training programs

Idle (bench) time fully paid

Job summary

DataArt is shaping the data testing landscape for a UK financial services client from Poland. You will design automated data testing, own reconciliation between legacy and new platforms built on Databricks and Microsoft Fabric, and integrate quality gates into the delivery pipeline.

Join a team driving data quality across reports and semantic models, with AI-assisted test generation and human review. Hybrid work options and ongoing learning opportunities are offered.

Qualifications

• 5+ years of quality engineering focused on data/ETL testing.
• Strong Python and SQL for building test automation, not just running it.
• Experience with pipeline validation: row counts, control totals, referential integrity.
• Experience with source-to-target reconciliation using tolerances.
• CI/CD test automation with gates that block releases.
• Experience with Azure DevOps.
• Experience with SQL Server.
• English proficiency for direct client conversations.

Responsibilities

• Design and implement data testing and quality assurance frameworks.
• Build automated validation for data pipelines and data products.
• Own source to target reconciliation between legacy systems and the new platform.
• Build repeatable regression packs that run unattended.
• Write unit tests that execute automatically within CI/CD, with quality gates that can block a release.
• Detect and handle schema drift and unexpected structural changes.
• Validate reports, dashboards, and semantic models, including measure definitions, filter behaviour, and totals.
• Apply AI assisted techniques to test generation and coverage analysis, with human review.

Skills

Python

SQL

CI/CD

Azure DevOps

Data testing

ETL testing

English communication

Tools

Azure Databricks

Microsoft Fabric

dbt tests

Great Expectations

Databricks Expectations

Soda

Deequ

Job description

DataArt is shaping the data testing landscape for a UK financial services client from Poland. You will design automated data testing, own reconciliation between legacy and new platforms built on Databricks and Microsoft Fabric, and integrate quality gates into the delivery pipeline.

Join a team driving data quality across reports and semantic models, with AI-assisted test generation and human review. Hybrid work options and ongoing learning opportunities are offered.