Backend Engineer - Data Acquisition

Remote; San Francisco (CA); A distancia; USD 100.000 - 134.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Flexible working environment: Work从 to

Flexible time off: Autonomy to manage

Alan Healthy benefits: 160€/month for食

Payflow App: Access your earned salary

Flexible retribution: Tax-free payroll

Wellbeing support: Subsidized up to 80

Comprehensive health insurance: 100%保险

Collaborative team: High-bar, friendly

Career development: Workshops, tools

Impactful work: 85,000+ users

Referral bonuses: Rewards for new人才

Descripción de la vacante

Lighthouse in Barcelona is seeking a Backend Engineer focused on data acquisition to join our Crawling team. You will design and develop high-performance systems, mostly in Rust, that collect billions of data points from the web and feed our AI-driven hospitality platform.

You’ll work on an in-house proxy layer and browser tooling, collaborate with DevOps and Security to ship secure, scalable solutions used by 85,000+ users worldwide.

Formación

• Production backend services in cloud environments.
• Experience with Rust or C/C++ or strong Rust drive.
• Solid understanding of HTTP, TCP/IP, TLS and proxies.
• R&D mindset for browser and network stacks.
• Strong analytical and debugging skills.
• Fluent in English.

Responsabilidades

• Design, build and improve backend data acquisition systems.
• Work on in-house proxy layer and browser tooling.
• Investigate crawler issues and build robust solutions.
• Create clear interfaces and guardrails for AI agents.
• Ensure code quality with tests and observability.

Conocimientos

Rust

C/C++

Cloud infrastructure

English (fluent)

Herramientas

Kubernetes

Prometheus

Grafana

Google Cloud

Claude Code

Descripción del empleo

Our Mission: Why Lighthouse?

At Lighthouse, we’re on a mission to revolutionize commercial strategy as hospitality’s most powerful AI platform. We take the world's largest hotel data network and transform it into real-time intelligence that drives action. We don't just deliver insights; we empower businesses to make decisions that move revenue.

With $370M in Series C funding and over $100M in ARR, we are scaling at lightspeed. Our 850+ teammates across 35 countries aren't just building software—they are leveraging cutting-edge AI to help hoteliers be the first to act. Tens of thousands of hotels across 185 countries trust Lighthouse to execute their commercial strategy, including every one of the top 15 global chains and thousands of independent hotels that consistently outperform their markets. With Lighthouse AI, the intelligence gets deeper. Decisions get smarter. Actions get faster. We help hoteliers be first to act.

Lighthouse Values: Our guiding light

We are Lumineers. Our shared values keep us on a collaborative path fostering a cultural and customer centric environment

• Pursuit of greatness: We’re innovators who care deeply about our customers’ success. Our team brings their best work, stays curious, and delivers excellence through attention to detail

• Meaningful work matters: We make every moment count by knowing what to deliver, why it matters, and how it drives Lighthouse forward

• Elevate each other: We don’t just work together - we grow together. What unites us is understanding each other as people and working toward shared goals

We’re more than just a workplace – we’re a community. Collaborative, fun, and deeply committed, we work hard together to revolutionize the hospitality sector. Are you ready to join us and shine brighter in the industry’s most exciting rocket-ship?

Job Details

• Engineering

• Spain - Barcelona

• Full-Time/Remote

What you will do

You’ll join our Crawler Engineering team as a Backend Engineer focused on data acquisition. This is a building role: you’ll design and develop high-performance systems, mostly in Rust, that collect billions of data points from the web. The work sits where backend engineering meets how the web works: HTTP stacks, proxies and browser tooling. When a data source blocks an approach, you’ll dig into what’s happening on the wire and find another way forward. You’ll also help make our infrastructure "agent-friendly", so other teams can safely build on it with AI.

Where you will have impact

• Design, build and improve backend systems for data acquisition that handle close to 200 million requests a day.

• Work on our in-house proxy layer and browser tooling: request routing, connection handling and protocol-level behaviour.

• Investigate hard crawler problems, test alternative approaches when one gets blocked, and turn what works into robust, reusable systems.

• Build clear interfaces and guardrails so other teams and AI agents can use what you build reliably.

• Own the quality of your code, including code written with AI assistance: tests, observability and maintainability.

• Work closely with crawler engineers, DevOps and Security to ship solutions that are secure and scalable.

About our team

The Crawler engineering team makes sure Lighthouse customers get fresh, high-quality rates, ranking and supply data. We handle close to 200 million requests a day across 200+ data sources, so the team carries a big responsibility for keeping our crawling infrastructure reliable, efficient and ahead of a web that keeps changing.

What's in it for you?

• Flexible working environment: Work from home or at one of our global offices.

• Flexible time off: Autonomy to manage your work-life balance.

• Alan Healthy benefits: 160€/month for food or nursery.

• Payflow App: Access your earned salary in advance at no cost to you.

• Flexible retribution: Optional benefits through tax-free payroll deductions for food, transportation and/or nursery.

• Wellbeing support: Subsidized up to 80% ClassPass subscription.

• Comprehensive health insurance: 100% Alan coverage for you, your spouse, and dependents.

• Collaborative team: High-bar, friendly, creative, and passionate colleagues.

• Career development: Workshops, frameworks, tools, training, and processes to realize your full potential.

• Impactful work: Shape products relied on by 85,000+ users worldwide.

• Competitive compensation: Proactively maintained to value your work.

• Referral bonuses: Earn rewards for bringing in new talent.

Who you are

• You have hands on experience building, deploying and running production backend services in a cloud environment.

• You're experienced with a systems language such as Rust or C/C++, or you have a strong track record in another backend language and a real drive to go deep in Rust.

• You have a solid grasp of how the web works under the hood: HTTP, TCP/IP, TLS and proxies.

• You have an R&D mindset. You're curious about how browsers and network stacks work internally, you're comfortable with ambiguity, and you'd rather prove a hypothesis than assume it.

• You have strong analytical and debugging skills. You're comfortable with packet captures, profilers and reading other people's source code.

• You communicate clearly, share your opinions, welcome feedback and work well in a team.

• You're fluent in English.

Technologies you will work with

Rust, TypeScript/Node.js, Python, Google Cloud, Kubernetes, Prometheus, Grafana, Claude Code.

Diversity, equity, inclusion, and belonging

Thank you for considering a career with Lighthouse. We are committed to fostering a diverse and inclusive workplace that values equal opportunity for all. We welcome candidates from all backgrounds, regardless of age, gender, race, religion, sexual orientation, and disability. Our commitment to equality is part of our culture. If you require reasonable accommodation at any point during the application or interview process, please notify your recruiter.

Not ticking every box? No problem! We value diverse