Senior Python Data Engineer — AI-Ready Foundations

Intellias; Poland; On-site; PLN 240,000 - 420,000; Full time

Job summary

Intellias supports a leading global investment management firm in London seeking a Senior Python Data Engineer to build data foundations that enable safe, scalable AI adoption. You will design catalogue, semantic, entitlement, and lineage layers transforming large data estates into trusted, AI-ready assets.

You will collaborate with architects, data engineers, AI specialists, data stewards and client technology teams to deliver scalable solutions across databases, filesystems, streaming

Qualifications

• 5+ years of professional experience building production‑grade data systems using Python.
• Strong SQL skills and experience with relational data systems.
• Experience designing and implementing production data pipelines and services.
• Fluent English, both written and spoken, with client teams.

Responsibilities

• Build extraction, enrichment, and registration pipelines populating data catalogues across databases, file systems, streaming platforms, APIs, and more.
• Develop and enhance crawler, harvester, and connector frameworks for schemas, inventories, metadata, and lineage.
• Load vendor schema and market data metadata via APIs into a knowledge base for controlled disclosure to humans and AI agents.
• Apply LLMs to metadata enrichment, generating descriptions, classifications, and semantic annotations.
• Establish processes to evaluate quality and reliability of LLM-generated metadata.

Skills

Python

SQL

Data governance

Kafka

OpenLineage

English fluency

LLMs in data pipelines

Education

Bachelor's degree in Computer Science

Tools

OpenLineage

Job description

Intellias supports a leading global investment management firm in London seeking a Senior Python Data Engineer to build data foundations that enable safe, scalable AI adoption. You will design catalogue, semantic, entitlement, and lineage layers transforming large data estates into trusted, AI-ready assets.

You will collaborate with architects, data engineers, AI specialists, data stewards and client technology teams to deliver scalable solutions across databases, filesystems, streaming