Data Engineer

Lighthouse; United States; À distance; USD 130 000 - 170 000; Plein temps

Avantages offerts par ce poste

Flexible work from home

Global offices option

Health insurance

Pension plan

Lunch vouchers

Mobility budget

Résumé du poste

Lighthouse is building the hospitality industry’s most powerful AI platform, processing vast hotel data to provide real-time actionable intelligence. As a Senior Data Engineer, you will join a highly skilled team of data engineers and drive the end-to-end lifecycle of our large-scale data ingestion and transformation engine.

The role emphasizes scalable pipelines, collaboration across product and engineering, and the use of cutting-edge AI-assisted tools to boost velocity and reliability.

Qualifications

• Proficient in Python for large-scale data processing and pipelines.
• Solid knowledge of data cloud technologies and major cloud platforms (GCP/AWS/Azure).
• Experience building/maintaining production data pipelines.

Responsabilités

• Own end-to-end lifecycle of large-scale data ingestion and transformation pipelines.
• Design, develop, scale, and maintain data pipelines processing massive data streams (≈100 TB/day).
• Implement domain modeling and transformation to unify disparate sources into high-fidelity data products.
• Improve reliability through observability, automated testing, and automation.
• Collaborate with product, engineering, support, and business teams; communicate with stakeholders during incidents.

Connaissances

Python

Data pipelines

Cloud platforms

English proficiency

AI-assisted tools

Outils

dbt

Airflow

BigQuery

GCP

Pub/Sub

Kubernetes

Description du poste

Описание:

At Lighthouse, we’re on a mission to revolutionize commercial strategy as hospitality’s most powerful AI platform. We take the world's largest hotel data network and transform it into real-time intelligence that drives action. We don't just deliver insights; we empower businesses to make decisions that move revenue. With $370M in Series C funding and over $100M in ARR, we are scaling at lightspeed. Our 850+ teammates across 35 countries aren't just building software—they are leveraging cutting-edge AI to help hoteliers be the first to act. Tens of thousands of hotels across 185 countries trust Lighthouse to execute their commercial strategy, including every one of the top 15 global chains and thousands of independent hotels that consistently outperform their markets. With Lighthouse AI, the intelligence gets deeper. Decisions get smarter. Actions get faster. We help hoteliers be first to act. Lighthouse Values: Our guiding light We are Lumineers. Our shared values keep us on a collaborative path fostering a cultural and customer centric environment - Pursuit of greatness: We’re innovators who care deeply about our customers’ success. Our team brings their best work, stays curious, and delivers excellence through attention to detail - Meaningful work matters: We make every moment count by knowing what to deliver, why it matters, how it drives Lighthouse forward - Elevate each other: We don’t just work together - we grow together. What unites us is understanding each other as people and working toward shared goals We’re more than just a workplace – we work hard together to revolutionize the hospitality sector. Are you ready to join us and shine brighter in the industry's most exciting rocket-ship? - Engineering - Belgium/Ghent - Full-Time/Hybrid

Задачи:

As a Senior Data Engineer, you will be a key player in the end-to-end lifecycle of our large-scale ingestion and transformation engine. You will design, develop, scale, and maintain data pipelines that handle massive data streams, on the order of 100 TB per day. This role offers a dynamic mix of advanced greenfield data engineering and improving the stability and quality of our existing pipelines. Design, build, and deploy scalable data pipelines that ingest data from various sources like APIs, Webhooks, and Cloud Storage. Implement complex domain modeling and transformation logic to unify disparate data sources into high-fidelity data products. Contribute to architectural improvements by transitioning legacy processes into modern, scalable, and stable data architectures. Own the support and troubleshooting of live integrations, from diagnosing hotel and internal issues to communicating clearly with stakeholders during incidents. Drive operational excellence by improving the reliability and quality of our data pipelines through advanced observability, automated testing, and automation. Collaborate closely with product, engineering, support, and business teams, as well as customers and partners. Investigate and resolve complex technical issues by performing deep-dive analysis into our code and systems to identify root causes. Leverage AI and automation to increase engineering velocity, streamline complex debugging, and handle recurring tasks. Python, dbt, airflow, Google Cloud Platform (GCP), BigQuery, Spanner, Pub/Sub, Kubernetes, Claude.

Требования:

You have experience building and maintaining production data pipelines, with a growing interest in shaping the architecture around them. You take pride in the software you build, from initial design to production monitoring and continuous improvement. You have professional proficiency in Python for large-scale data processing and pipeline development. You have strong knowledge of data cloud technologies and hands-on experience with a major cloud platform like GCP, AWS, or Azure. You are a forward-thinking builder who uses AI-assisted tools to ship high-quality code faster. You are fluent in English with excellent communication skills to discuss technical details and explain complex data flows to technical stakeholders. We welcome Knowledge of the complex business of hospitality data domains.

Условия:

You will join one of our Integration Engineering teams as a senior data engineer. Our team's mission is to reliably transform, integrate, and store the vast data sources that power our BI products. We handle a staggering amount of information, processing over 100TB of data daily and managing a dataset with over 3 trillion hotel rates. You'll be part of a highly talented and collaborative group of about 6-8 data engineers, working together to power Lighthouse's core intelligence.

• Flexible working environment: Work from home or at one of our global offices.
• Flexible time off: Autonomy to manage your work-life balance.
• Collaborative team: High-bar, friendly, creative, and passionate colleagues.
• Career development: Workshops, frameworks, tools, training, and processes to realize your full potential.
• Impactful work: Shape products relied on by 85,000+ users worldwide.
• Mobility options: Mobility budget or company car (based on your job category).
• Competitive compensation: Proactively maintained to value your work.
• Net allowance: to support home office related expenses.
• Vouchers: lunch vouchers & eco vouchers.
• Comprehensive health insurance: Extensive coverage for you and your dependents.
• Pension funding: Group insurance to secure your future.
• Referral bonuses: Earn rewards for bringing in new talent.

We are committed to fostering a diverse and inclusive workplace that values equal opportunity for all. We welcome candidates from all backgrounds, regardless of age, gender, race, religion, sexual orientation, and disability. Our commitment to equality is part of our culture. If you require reasonable accommodation at any point during the application or interview process, please notify your recruiter. If your experience looks a little different from what we've described, but you're passionate about what we do and are a quick learner, we'd love to hear from you!