Senior Data Engineer - Real-Time AI Pipelines (Remote/Hybrid)

Lighthouse; Oost-Vlaanderen; Hybrid; EUR 90,000 - 125,000; Full time

Benefits offered by this job

Flexible work from home

Flexible time off

Health insurance

Pension funding

Lunch vouchers

Eco vouchers

Mobility budget

Company car

Job summary

Lighthouse is seeking a Senior Data Engineer in Belgium (Ghent) to own end-to-end data ingestion and transformation at scale. You will design, develop, and maintain pipelines handling massive daily data volumes, collaborating across product, engineering, and business teams.

You will apply Python and cloud data technologies to build high-fidelity data products, while leveraging AI-assisted tooling to accelerate development and improve reliability.

Qualifications

• Experience building and maintaining production data pipelines.
• Own from design to production monitoring and continuous improvement.
• Proficient in Python for large-scale data processing.
• Strong knowledge of cloud data technologies on major cloud platform (GCP/AWS/Azure).
• Fluent in English with excellent communication skills.

Responsibilities

• Design, build, and maintain scalable data pipelines ingesting data from APIs, Webhooks, and cloud storage.
• Develop domain models and transformations to unify sources into high-fidelity data products.
• Improve legacy processes by transitioning to modern, scalable architectures.
• Own support for live integrations and incident communications with stakeholders.
• Improve reliability via observability, testing, and automation.
• Collaborate with product, engineering, support, and business teams, customers, and partners.
• Perform deep-dive analyses to identify root causes in code and systems.
• Leverage AI to increase engineering velocity and automate recurring tasks.

Skills

Production data pipelines

Python

Cloud platforms

English communication

AI-assisted tooling

Tools

Python

dbt

airflow

GCP

BigQuery

Spanner

Pub/Sub

Kubernetes

Claude

Job description

Lighthouse is seeking a Senior Data Engineer in Belgium (Ghent) to own end-to-end data ingestion and transformation at scale. You will design, develop, and maintain pipelines handling massive daily data volumes, collaborating across product, engineering, and business teams.

You will apply Python and cloud data technologies to build high-fidelity data products, while leveraging AI-assisted tooling to accelerate development and improve reliability.