Data Engineer - GCP Pipelines, Quality & AI Readiness

IG Group; Kraków; Hybrid; PLN 180,000 - 240,000; Full time

Benefits offered by this job

Home office equipment reimbursement

Performance related bonus

Private medical cover (Medicover)

LinkedIn Learning platform free access

Three extra days off for Birthday and

Job summary

IG Group is seeking a Data Engineer to design and operate data pipelines powering analytics, compliance, and AI initiatives. You will contribute to the GCP consolidation, tackle ingestion and reliability challenges, and mentor junior engineers while raising the data quality bar across the team.

In this role, you will work within a squad led by the Data Engineering Team Lead, focusing on scalable data platforms, self-service analytics, and trustworthy data practices in a regulated financial

Qualifications

• Proven hands-on experience building and operating production-grade data pipelines on GCP including BigQuery, Cloud Composer/Airflow, GCS and Cloud Run.
• Strong SQL and Python skills are required.
• Experience with Apache Kafka or equivalent streaming technologies and real-time data flows.
• Familiarity with dbt modelling and Medallion architecture patterns for self-service analytics.
• Experience implementing data contracts, lineage, observability tooling, and pipeline SLO monitoring.
• Knowledge of data governance in regulated financial services environments.

Responsibilities

• Design and build robust batch and real-time data pipelines on GCP, including Kafka streams, BigQuery transformations, and Airflow workflows.
• Own data quality within the delivery area: data contracts, quality checks, and observability.
• Develop and maintain connectors and integrations for IG's ingestion estate with resilience and maintainability.
• Contribute to engineering standards and best practices across the squad, including code review and CI/CD hygiene.
• Support feature engineering and model data pipelines for Data Science and AI readiness.

Skills

SQL

Python

GCP

BigQuery

Cloud Composer/Airflow

GCS

Cloud Run

Apache Kafka

dbt

Medallion architecture

Job description

IG Group is seeking a Data Engineer to design and operate data pipelines powering analytics, compliance, and AI initiatives. You will contribute to the GCP consolidation, tackle ingestion and reliability challenges, and mentor junior engineers while raising the data quality bar across the team.

In this role, you will work within a squad led by the Data Engineering Team Lead, focusing on scalable data platforms, self-service analytics, and trustworthy data practices in a regulated financial