Senior Data Engineer - AI-Driven Data Platform (Hybrid)

CAUSEWAY CONSTRUCTION LIMITED; Lisboa; Híbrido; EUR 90 000 - 120 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Hybrid working

Carbon neutral company

Resumo da oferta

Causeway Construction Limited is seeking a Senior Data Engineer to shape a next-generation data platform on Databricks, unifying data from across product estates and external sources. You will own medallion pipelines, modelling layers, and a fast-serving graph layer for AI agents with scalable, durable architecture.

You’ll mentor engineers, collaborate with platform and agent teams, and advance data governance, quality, and observability across cloud-native stacks.

Qualificações

• Strong production experience on Databricks with Delta Lake and Delta Live Tables.
• Proficient in Python and PySpark for large-scale data processing.
• Advanced SQL with complex queries and performance tuning.
• Experience modelling graphs, entity resolution, and data contracts.

Responsabilidades

• Design and own ingestions into bronze and silver/gold medallion layers.
• Build and maintain Delta Live Tables and pipelines for scalable data products.
• Develop and evolve a graph serving layer for AI agents with low latency.
• Mentor engineers, review PRs, and drive data engineering best practices.

Conhecimentos

Data engineering

Python

PySpark

SQL

Graph data modelling

Entity resolution

Ferramentas

Databricks

Delta Lake

Delta Live Tables

Auto Loader

Unity Catalog

Delta Lake

PostgreSQL

pgvector

pg_trgm

HNSW

Descrição da oferta de emprego

Causeway Construction Limited is seeking a Senior Data Engineer to shape a next-generation data platform on Databricks, unifying data from across product estates and external sources. You will own medallion pipelines, modelling layers, and a fast-serving graph layer for AI agents with scalable, durable architecture.

You’ll mentor engineers, collaborate with platform and agent teams, and advance data governance, quality, and observability across cloud-native stacks.