Senior Data Engineer

Lighthouse; United States; Remote; USD 140,000 - 200,000; Full time

Benefits offered by this job

Flexible time off

Alan Flex benefits: 160€/month forfood

Flexible retribution: tax-free payroll

ClassPass wellbeing subscription

Comprehensive health insurance

Impactful work: 85,000+ users

Referral bonuses

Job summary

Lighthouse is seeking a Senior Data Engineer to own the end-to-end data ingestion and transformation pipelines at scale. You’ll design, build, and maintain systems handling massive data streams (≈100 TB/day) and drive quality through observability and testing.

You’ll collaborate with product, engineering, support and customers while leveraging Python, dbt, Airflow and cloud platforms to accelerate delivery. Join a fast-growing, global team powering Lighthouse’s intelligence.

Qualifications

• You have experience building and maintaining production data pipelines.
• You take pride in the software you build, from initial design to production monitoring and continuous improvement.
• You have professional proficiency in Python for large-scale data processing and pipeline development.
• You have strong knowledge of data cloud technologies and hands-on experience with a major cloud platform like GCP, AWS, or Azure.
• You are a forward-thinking builder who uses AI-assisted tools to ship high-quality code faster.
• You are fluent in English with excellent communication skills to discuss technical details and explain complex data flows to technical stakeholders.

Responsibilities

• Design, build, and deploy scalable data pipelines that ingest data from various sources like APIs, Webhooks, and Cloud Storage.
• Implement complex domain modeling and transformation logic to unify disparate data sources into high-fidelity data products.
• Contribute to architectural improvements by transitioning legacy processes into modern, scalable, and stable data architectures.
• Own the support and troubleshooting of live integrations, from diagnosing hotel and internal issues to communicating clearly with stakeholders during incidents.
• Drive operational excellence by improving the reliability and quality of our data pipelines through advanced observability, automated testing, and automation.
• Collaborate closely with product, engineering, support, and business teams, as well as customers and partners.
• Investigate and resolve complex technical issues by performing deep-dive analysis into our code and systems to identify root causes.
• Leverage AI and automation to increase engineering velocity, streamline complex debugging, and handle recurring tasks.

Skills

Python programming

Data pipeline design

Cloud data platforms

Distributed systems

Communication

Tools

dbt

Airflow

BigQuery

Kubernetes

GCP

AWS

Job description

Our Mission: Why Lighthouse?

At Lighthouse, we’re on a mission to revolutionize commercial strategy as hospitality’s most powerful AI platform. We take the world’s largest hotel data network and transform it into real-time intelligence that drives action. We don’t just deliver insights; we empower businesses to make decisions that move revenue.

With $370M in Series C funding and over $100M in ARR, we are scaling at lightspeed. Our 850+ teammates across 35 countries aren’t just building software—they are leveraging cutting‑edge AI to help hoteliers be the first to act. Tens of thousands of hotels across 185 countries trust Lighthouse to execute their commercial strategy, including every one of the top 15 global chains and thousands of independent hotels that consistently outperform their markets. With Lighthouse AI, the intelligence gets deeper. Decisions get smarter. Actions get faster. We help hoteliers be first to act.

Lighthouse Values: Our guiding light

We are Lumineers. Our shared values keep us on a collaborative path fostering a cultural and customer centric environment

• Pursuit of greatness : We’re innovators who care deeply about our customers’ success. Our team brings their best work, stays curious, and delivers excellence through attention to detail
• Meaningful work matters : We make every moment count by knowing what to deliver, why it matters, and how it drives Lighthouse forward
• Elevate each other : We don’t just work together - we grow together. What unites us is understanding each other as people and working toward shared goals

We’re more than just a workplace – we’re a community. Collaborative, fun, and deeply committed, we work hard together to revolutionize the hospitality sector. Are you ready to join us and shine brighter in the industry’s most exciting rocket-ship?

Job Details

• Engineering
• Spain
• Full-Time/Remote

What you will do

As a Senior Data Engineer, you will be a key player in the end-to-end lifecycle of our large-scale ingestion and transformation engine. You will design, develop, scale, and maintain data pipelines that handle massive data streams, on the order of 100 TB per day. This role offers a dynamic mix of advanced greenfield data engineering and improving the stability and quality of our existing pipelines.

Where you will have impact

• Design, build, and deploy scalable data pipelines that ingest data from various sources like APIs, Webhooks, and Cloud Storage.
• Implement complex domain modeling and transformation logic to unify disparate data sources into high‑fidelity data products.
• Contribute to architectural improvements by transitioning legacy processes into modern, scalable, and stable data architectures.
• Own the support and troubleshooting of live integrations, from diagnosing hotel and internal issues to communicating clearly with stakeholders during incidents.
• Drive operational excellence by improving the reliability and quality of our data pipelines through advanced observability, automated testing, and automation.
• Collaborate closely with product, engineering, support, and business teams, as well as customers and partners.
• Investigate and resolve complex technical issues by performing deep‑dive analysis into our code and systems to identify root causes.
• Leverage AI and automation to increase engineering velocity, streamline complex debugging, and handle recurring tasks.

About our team

You will join one of our Integration Engineering teams as a senior data engineer. Our team’s mission is to reliably transform, integrate, and store the vast data sources that power our BI products. We handle a staggering amount of information, processing over 100TB of data daily and managing a dataset with over 3 trillion hotel rates. You’ll be part of a highly talented and collaborative group of about 6-8 data engineers, working together to power Lighthouse’s core intelligence.

What’s in it for you?

• Flexible time off: Autonomy to manage your work‑life balance.
• Alan Flex benefits: 160€/month for food or nursery.
• Flexible retribution: Optional benefits through tax‑free payroll deductions for food, transportation and/or nursery.
• Wellbeing support: Subsidized ClassPass subscription.
• Comprehensive health insurance: 100% Alan coverage for you, your spouse, and dependents.
• Impactful work: Shape products relied on by 85,000+ users worldwide.
• Referral bonuses: Earn rewards for bringing in new talent.

Who you are

• You have experience building and maintaining production data pipelines, with a growing interest in shaping the architecture around them.
• You take pride in the software you build, from initial design to production monitoring and continuous improvement.
• You have professional proficiency in Python for large‑scale data processing and pipeline development.
• You have strong knowledge of data cloud technologies and hands‑on experience with a major cloud platform like GCP, AWS, or Azure.
• You are a forward-thinking builder who uses AI‑assisted tools to ship high‑quality code faster.
• You are fluent in English with excellent communication skills to discuss technical details and explain complex data flows to technical stakeholders.

We welcome

• Knowledge of the complex business of hospitality data domains.

Technologies you will work with

Python, dbt, airflow, Google Cloud Platform (GCP), BigQuery, Spanner, Pub/Sub, Kubernetes, Claude.

Diversity, equity, inclusion, and belonging

Thank you for considering a career with Lighthouse. We are committed to fostering a diverse and inclusive workplace that values equal opportunity for all. We welcome candidates from all backgrounds, regardless of age, gender, race, religion, sexual orientation, and disability. Our commitment to equality is part of our culture. If you require reasonable accommodation at any point during the application or interview process, please notify your recruiter.

Not ticking every box? No problem! We value diverse backgrounds and unique skill sets, and we encourage individuals from all walks of life to apply. If your experience looks a little different from what we’ve described, but you’re passionate about what we do and are a quick learner, we’d love to hear from you!