Data Engineer - Build Clean, Scalable Pipelines

Koda Tech; Luik; Sur place; EUR 65 000 - 90 000; Plein temps

Résumé du poste

Gaming1 is seeking a Data Engineer to design, build, and optimize data pipelines and data products, ensuring data quality, reliability, and scalability across the organization. You will collaborate with fellow Data Engineers to strengthen our data capabilities and maintain long-term solutions.

Ideal candidates have 3+ years of cloud data pipeline experience, strong SQL and Python, and familiarity with testing frameworks like Great Expectations.

Qualifications

• 3+ years building cloud data pipelines with SQL, Python/PySpark, and Airflow.
• Idempotent or merge-based ingestion patterns.
• Familiarity with automated testing frameworks for data (Great Expectations, Soda tests).
• Strong collaboration, documentation mindset, mentoring.

Responsabilités

• Capability Focused QA – Implement data quality tests that reflect business rules of the capability (completeness, thresholds, referential checks) as well as technical validation tests.
• Collaboration & Handover – Collaborate with the domain cluster’s Data Engineer(s) or relevant stakeholders, document every step (readme.md, Confluence), and conduct knowledge-transfer sessions before roll-off to ensure long-term sustainability.
• Performance Tuning – Optimize jobs and implement data contracts; identify schema or pipeline improvements that reduce long-term compute and enhance maintainability.
• Issue Resolution – Investigate failed loads or QA breaches quickly and coordinate fixes with relevant stakeholders.

Connaissances

SQL

Python/PySpark

Airflow

Outils

Great Expectations

Soda tests

Description du poste

Gaming1 is seeking a Data Engineer to design, build, and optimize data pipelines and data products, ensuring data quality, reliability, and scalability across the organization. You will collaborate with fellow Data Engineers to strengthen our data capabilities and maintain long-term solutions.

Ideal candidates have 3+ years of cloud data pipeline experience, strong SQL and Python, and familiarity with testing frameworks like Great Expectations.