Senior Data Engineer

IG KnowHow; Kraków; On-site; PLN 177,723 - 212,877; Full time

Benefits offered by this job

Tailored development programmes

Mentoring opportunities

Clear career progression

Extra time off for volunteering

Job summary

IG KnowHow is seeking a Senior Data Engineer based in Kraków, Poland. In this role, you will design and build robust data pipelines on GCP, ensuring data quality and integrity. You will work collaboratively within a hybrid model, balancing office presence and remote work.

The ideal candidate will have proven experience with production-grade data pipelines, strong SQL and Python skills, and familiarity with data governance in a regulated environment. Join us and leverage your expertise in a supportive and growth-focused environment.

We offer tailored development programs and mentoring opportunities to fuel your career progression.

Qualifications

• Proven hands-on experience building and operating production-grade data pipelines on GCP.
• Solid experience with Apache Kafka or equivalent streaming technologies.
• Familiarity with modern transformation tooling, particularly dbt.
• Experience implementing data contracts, lineage tracking, and observability tooling.
• Understanding of data governance requirements and change control processes.

Responsibilities

• Design and build robust batch and real-time data pipelines on GCP.
• Own data quality within your delivery area and implement data contracts.
• Develop in-house connectors and third-party integrations.
• Contribute to engineering standards and best practices across the squad.
• Support feature engineering and model data pipelines for Data Science.

Skills

Production-grade data pipelines

Strong SQL skills

Python

Apache Kafka

Data governance

Tools

GCP (Google Cloud Platform)

BigQuery

Cloud Composer/Airflow

dbt

Job description

Job Title: Senior Data Engineer

Minimum compensation: starting from 17500PLN. Final offer will be determined based on experience and competencies.

IG Group is a FTSE 100 fintech operating across five continents, serving over 1.3million customers and handling billions of dollars in transactions – built on scale, trust, and proof. We didn't pivot to innovation; it has always been our core. Here, you will face genuinely complex problems, have the technology and resources to tackle them properly, and enjoy a scope rare in established businesses. Bring a curious and forward‑thinking mindset and we’ll give you the platform to define what comes next.

Team & Role

Your team: IG’s Data function is a central capability serving both central and divisional business lines across the entire IG estate. The Data Engineering team builds and operates platforms that underpin analytics, reporting, compliance, and client‑facing data products, and will increasingly power AI and machine‑learning use cases across the firm.

Responsibilities

• Design and build robust batch and real‑time data pipelines on GCP, including Kafka‑based event streams, BigQuery transformations, and Airflow‑orchestrated workflows as part of the GCP consolidation and Medallion architecture build‑out.
• Own data quality within your delivery area: define and implement data contracts, quality checks, and observability instrumentation so that pipeline health is visible and SLAs are met.
• Develop and maintain in‑house connectors and third‑party native integrations that form part of IG’s ingestion estate, ensuring resilience, monitoring, and long‑term maintainability.
• Contribute to engineering standards and best practices across the squad – including code review, dbt modelling patterns, CI/CD pipeline hygiene, and change control for shared datasets.
• Support feature engineering and model data pipelines for Data Science, and help lay the foundations for AI‑ready data – including lineage, reproducibility, and freshness guarantees for ML workloads.

Qualifications & Requirements

• Proven hands‑on experience building and operating production‑grade data pipelines on GCP – including BigQuery, Cloud Composer/Airflow, GCS, and Cloud Run – with strong SQL and Python skills.
• Solid experience with Apache Kafka or equivalent streaming technologies, including designing event‑driven ingestion patterns and troubleshooting real‑time data flows under operational conditions.
• Familiarity with modern transformation tooling, particularly dbt, and an appreciation of Medallion (Bronze/Silver/Gold) architecture patterns and how they support self‑service analytics.
• A quality‑first mindset: experience implementing data contracts, lineage tracking, observability tooling, and pipeline SLO monitoring in a production environment.
• Comfortable working in a regulated financial services environment, with an understanding of data governance requirements (lineage, access control, audit trails) and the discipline to operate within change control processes.

How We Work

We take a thoughtful approach to our ways of working. We follow a hybrid model with 3 days in the office, balancing collaboration and connection. Our high‑performance priorities are: lead and inspire, think big, champion the client, deliver at pace, and raise the bar.

Benefits & Perks

Your growth fuels our success! Thrive with tailored development programmes, mentoring opportunities with leaders, clear career progression, expanded network through committees, sports and social clubs, and extra time off for volunteering and community work.