Data Quality Automation Engineer — Observability

Fetcherr Ltd; Warszawa; Hybrid; PLN 120,000 - 160,000; Full time

Job summary

A forward-thinking AI technology firm is looking for a Data Quality Assurance Engineer to join its Price Optimization Department. The ideal candidate will have extensive experience in Python development, focusing on automation and observability within data pipelines. Responsibilities include designing validation frameworks and collaborating closely with teams to maintain high data quality. The role demands strong problem-solving skills and adaptability in a dynamic startup environment.

Qualifications

• 4+ years of hands-on Python development experience in Data Quality Assurance or similar role.
• Proficiency with standard data libraries such as Pandas and NumPy.
• Strong understanding of ETL/data pipeline testing and Big Data platforms.
• SQL and OLAP databases proficiency, especially ClickHouse.
• Experience with cloud platforms, particularly GCP.

Responsibilities

• Design and implement automated validation procedures for pipelines and transformations.
• Develop monitoring and observability tools to ensure data quality and reliability.
• Contribute to performance testing and optimization of large-scale data systems.
• Collaborate with data engineers, scientists, and analysts to define quality metrics.

Skills

Python development

Data Quality Assurance

ETL/data pipeline testing

SQL

Pandas

Tools

ClickHouse

Dagster

Ray Data

Job description

A forward-thinking AI technology firm is looking for a Data Quality Assurance Engineer to join its Price Optimization Department. The ideal candidate will have extensive experience in Python development, focusing on automation and observability within data pipelines. Responsibilities include designing validation frameworks and collaborating closely with teams to maintain high data quality. The role demands strong problem-solving skills and adaptability in a dynamic startup environment.