Senior Data Engineer: Scale 100TB/day AI Pipelines

Lighthouse; Gent; Hybrid; EUR 70,000 - 110,000; Full time

Benefits offered by this job

Flexible work from home

Mobility budget or company car

Comprehensive health insurance

Pension funding

Referral bonuses

Job summary

Lighthouse is seeking a Senior Data Engineer to own the end-to-end lifecycle of its large-scale ingestion and transformation engine. You will design, develop, scale, and maintain data pipelines handling massive data streams, enabling real-time intelligence for hospitality analytics.

Join a collaborative Integration Engineering team driving architectural improvements and leveraging AI to boost engineering velocity. Flexible work options include remote and office locations across the globe.

Qualifications

• Experience building and maintaining production data pipelines.
• Strong Python for large-scale data processing and pipeline development.
• Fluent knowledge of data cloud technologies and hands-on experience with GCP, AWS, or Azure.
• Forward-thinking using AI-assisted tools to ship high-quality code faster.

Responsibilities

• Design, build, and maintain large-scale data pipelines ingesting diverse sources.
• Develop and transform data models to create high-fidelity data products.
• Improve architectural scalability and stability of data ecosystems.
• Own live integrations support and incident communication with stakeholders.
• Enhance observability, tests, and automation to ensure data quality.
• Collaborate with product, engineering, support, and business teams.

Skills

Python

Data pipelines

Cloud platforms

AI tooling

Production engineering

Job description

Lighthouse is seeking a Senior Data Engineer to own the end-to-end lifecycle of its large-scale ingestion and transformation engine. You will design, develop, scale, and maintain data pipelines handling massive data streams, enabling real-time intelligence for hospitality analytics.

Join a collaborative Integration Engineering team driving architectural improvements and leveraging AI to boost engineering velocity. Flexible work options include remote and office locations across the globe.