Data Engineer

IG KnowHow; Kraków; On-site; PLN 180,000 - 260,000; Full time

Benefits offered by this job

Private medical cover

Home office equipment reimbursement

Performance related bonus

LinkedIn Learning platform free access

Three additional days off a year

Job summary

IG Group is seeking a Data Engineer to design and operate production data pipelines in a hybrid model. You will own ingestion, transformation, and data quality across the analytics, compliance, and AI-ready data platforms, contributing to a scalable, self-service data environment.

You'll partner with a squad led by the Data Engineering Team Lead, tackle complex ingestion challenges, and help raise the bar for data governance and reliability across the firm.

Qualifications

• Proven hands-on experience building production data pipelines on GCP.
• Strong SQL and Python skills with real-time and batch processing.
• Familiar with data contracts, lineage, and observability in production.

Responsibilities

• Design and operate batch and real-time data pipelines on GCP with Kafka, BigQuery, and Airflow.
• Own data quality, contracts, observability, and SLA adherence.
• Develop in-house connectors and third-party integrations for ingestion stability.
• Contribute to standards, code reviews, and CI/CD for shared datasets.
• Support feature engineering and ML data pipelines with lineage and reproducibility.

Skills

BigQuery

Python

SQL

Airflow

Kafka

GCP

Tools

dbt

Cloud Composer

Airflow

Cloud Run

GCS

Job description

Data Engineer

Job Title Data Engineer Job Description

Compensation details will be shared by the recruiter during the first interview.

So, who are we? IG Group is a FTSE 100 fintech operating across five continents, serving over 1.3m customers and handling billions of dollars in transactions – built on scale, trust, and proof. We didn't pivot to innovation; it's how we've always operated. What that means for the people who work here is real: genuinely complex problems to solve, the technology and resources to tackle them properly, and the kind of scope that's rare in established businesses. The bar is high – bring a curious and forward-thinking mindset and we'll give you the platform to define what comes next. Join us at IG – the future gets built here.

Your team

IG’s Data function is a central capability serving both central and divisional business lines across the entire IG estate. The Data Engineering team is responsible for the platforms that underpin analytics, reporting, compliance, and client-facing data products, and that will increasingly power AI and machine-learning use cases across the firm. The current data landscape reflects IG’s growth: a combination of GCP-native capabilities, onpremises systems, and a legacy AWS data platform. The strategic direction — endorsed by the CDO and Executive — is clear: consolidate onto GCP, raise the bar on data quality, and enable self-service access to trusted data for teams across the business.

Your role in the Team’s Success

As a Data Engineer, build, and operate the data pipelines and platform capabilities that power IG’s analytics, compliance, and AI ambitions. Working within a squad led by the Data Engineering Team Lead, you will be a key technical contributor to IG’s GCP consolidation programme — tackling complex ingestion, transformation, and reliability challenges with a high standard of craft. You will also play a meaningful role in raising the bar for the wider team: mentoring junior engineers, championing data quality, and helping to define how the squad builds and operates at scale.

What you’ll do

• Design and build robust batch and real-time data pipelines on GCP, including Kafka-based event streams, BigQuery transformations, and Airflow-orchestrated workflows, as part of the GCP consolidation and Medallion architecture build-out
• Own data quality within your delivery area: define and implement data contracts, quality checks, and observability instrumentation so that pipeline health is visible and SLAs are met
• Develop and maintain in-house connectors and third-party native integrations that form part of IG’s ingestion estate, ensuring resilience, monitoring, and long-term maintainability
• Contribute to engineering standards and best practices across the squad — including code review, dbt modelling patterns, CI/CD pipeline hygiene, and change control for shared datasets
• Support feature engineering and model data pipelines for Data Science, and help lay the foundations for AI-ready data — including lineage, reproducibility, and freshness guarantees for ML workloads

What you’ll need for this role

• Proven hands-on experience building and operating production-grade data pipelines on GCP — including BigQuery, Cloud Composer/Airflow, GCS, and Cloud Run — with strong SQL and Python skills
• Solid experience with Apache Kafka or equivalent streaming technologies, including designing event-driven ingestion patterns and troubleshooting real-time data flows under operational conditions
• Familiarity with modern transformation tooling, particularly dbt, and an appreciation of Medallion (Bronze/Silver/Gold) architecture patterns and how they support self-service analytics
• A quality-first mindset: experience implementing data contracts, lineage tracking, observability tooling, and pipeline SLO monitoring in a production environment
• Comfortable working in a regulated financial services environment, with an understanding of data governance requirements (lineage, access control, audit trails) and the discipline to operate within change control processes

How we work

We try to take a thoughtful approach to our ways of working as a company. We follow a hybrid working model with 3 days in the office – which we think balances the need to collaborate effectively and connect with each other.

• Lead and Inspire: Drives trust, alignment, and enthusiasm
• Think Big: Focus on the problems that most impact commercial outcomes
• Champion the client: Understand and prioritise client's needs
• Deliver at pace: Push for fast, sustainable growth; Raise the bar: Take ownership, be accountable and share feedback

We believe that diversity is vital to success, it fuels creativity, drives innovation and sets us up for global success.

We’re committed to building teams with a variety of perspectives and skills to help us realise our vision and strategy, that’s why we encourage applications from people with diverse backgrounds and experiences to join us on this journey.

Learn more about our D&I approach here.

The Perks

• Your growth fuels our success!
• Thrive with tailored development programs, mentoring opportunities with leaders, and clear career progression.
• Expand your network through committees, sports and social clubs.
• Enjoy extra time off for volunteering and community work.
• Home office equipment reimbursement
• Performance relate bonus
• Private medical cover for you and your family/partner (Medicover)
• Multikafeteria system (you can choose a multisport card, vouchers, etc.)
• Life insurance (Generali)
• LinkedIn Learning platform free access
• Share Plans for Employees
• Well-being events as well as Employee Assistance Programme
• Summer picnic, New Year party and other social events
• Three additional days off a year - one to celebrate your Birthday and two for voluntary work
• App-based parking spots booking system
• Stretching sessions

Learn more about the Perks here!

Number of openings 1

Looking for a career at a company that will support you, challenge you and help you grow? IG Group can provide that.

IG Group is a FTSE 100 fintech operating across five continents, serving over 1.3m customers and handling billions of dollars in transactions – built on scale, trust, and proof. We didn't pivot to innovation; it's how we've always operated. What that means for the people who work here is real: genuinely complex problems to solve, the technology and resources to tackle them properly, and the kind of scope that's rare in established businesses. The bar is high – bring a curious and forward-thinking mindset and we'll give you the platform to define what comes next. Join us at IG – the future gets built here.