Search Engineer, AI Infrastructure (SF)

BlockchainHQ; San Francisco (CA); On-site; USD 235,000 - 260,000; Full time

Benefits offered by this job

Equity

Medical coverage

Dental coverage

Vision coverage

Life insurance

Disability insurance

401(k)

Pre-tax FSA

Commuter benefits

Pet insurance

15+ days PTO

Parental leave

Wellness stipend

Learning budget

Sabbatical (4y)

Team offsites

SF HQ perks

e-bike loan

Job summary

Lavendo is seeking a Search Engineer to own the systems turning the open web into a high-quality, LLМ-driven search index in a fast-moving startup. You will collaborate with the Head of Search and a small team to improve crawling, indexing, retrieval, and serving at scale.

You will own ranking quality end-to-end, ship customer-facing improvements, and optimize latency and cost while maintaining high relevance and reliability.

Qualifications

• 3+ years building production search or retrieval systems
• true
• Must show a measurable impact of a ranking change
• true

Responsibilities

• Own ranking quality and relevance for LLM-driven search and retrieval
• Build and operate the crawling, indexing, retrieval, and search-serving systems behind the product
• Improve search quality using lexical, semantic, hybrid retrieval
• Reduce latency and cost per query at scale while preserving quality
• Own end-to-end production: design, build, deploy, monitor
• Address freshness, deduplication, crawl scheduling at large scale
• Collaborate with Head of Search to shape roadmap and ship improvements quickly

Skills

Production search

Ranking ownership

BM25 lexical

Latency optimization

Go/Python

Lucene/OpenSearch

Kubernetes

AWS/GCP

Protobuf gRPC

Tools

Elasticsearch

OpenSearch

Redis

Kafka

PostgreSQL

Docker

AWS

GCP

gRPC

Protobuf

Job description

Lavendo partners with startups and high‑growth companies to help them hire top‑tier sales, GTM, and technical talent. This role is with one of our clients; we’ll share full details about the company and interview process as we get to know you and confirm mutual fit.

About the Company

Our client builds the data layer that AI agents run on. One API call turns any URL into clean, structured, LLM-ready data. It is already the default way a huge number of developers pull web data into their AI systems.

The numbers back it up: 8 figures in ARR in year one, more than doubled that in year two, and 125,000+ GitHub stars. They just closed a $75M Series B. The company is small, moving fast, and hiring people who want to build the next chapter with them.

The Mission

They believe developers and AI agents should not have to fight the web to get useful data out of it. Every hour spent maintaining a scraper, dealing with stale pages, or working around brittle retrieval systems is an hour taken away from the actual product.

Their job is to make that problem disappear: give AI systems reliable access to the live web, then make the results clean, current, structured, and useful enough to power real products.

The Opportunity

As a Search Engineer, you will own the systems that turn the open web into a high-quality search index.

You will work directly with the Head of Search and a small team to build and improve the crawling, indexing, retrieval, ranking, and serving infrastructure behind a fast-growing search product. This is an end-to-end role: you will improve relevance while solving the real constraints of search at scale - freshness, deduplication, latency, reliability, and cost per query.

The key requirement is direct production ownership of ranking and relevance. You should be able to point to a search-quality change you personally shipped and the metric it improved.

What You’ll Do

• Own ranking quality and relevance for LLM-driven search and retrieval

• Build and operate the crawling, indexing, retrieval, and search-serving systems behind the product.

• Improve search quality using lexical, semantic, hybrid, and reranking approaches

• Reduce latency and cost per query as query volume and corpus size grow, without compromising relevance, correctness, or reliability

• Own systems end to end: design, build, deploy, monitor, troubleshoot, measure, and iterate in production

• Solve for freshness, incremental indexing, deduplication, crawl scheduling, and large‑scale corpus management

• Work directly with the Head of Search and the team to shape the roadmap and ship customer‑facing improvements quickly

What You Bring

• 3+ years building and operating production search or retrieval systems, with direct ownership of ranking and relevance

• A specific example of a ranking or reranking change you owned and the measurable impact it had on relevance, recall, conversion, CTR, NDCG, MRR, or a similar metric

• Hands‑on information‑retrieval depth across BM25/lexical, semantic/vector, hybrid retrieval, reranking, and retrieval or RAG evaluation

• Strong backend and distributed‑systems skills in Go, Rust, Python, or a comparable language, with end‑to‑end production ownership

• Experience improving latency and cost at meaningful query volume while maintaining quality and reliability

• Familiarity with search and infrastructure tooling such as Lucene, Elasticsearch, OpenSearch, Redis, Kafka, PostgreSQL, Kubernetes, Docker, AWS/GCP, gRPC, or Protobuf

Key Success Drivers

The people who do well here have personally owned search quality in production, think end‑to‑end about relevance, crawling, indexing, serving, latency, and cost, and thrive in ambiguity by shipping, measuring, and iterating quickly without needing a fully defined playbook.

Why Join?

• Compensation & Equity: Base salary of $235K-$260K+. Meaningful equity in a fast‑growing, well‑funded startup

• Traction: 8 figures in ARR in year one, more than doubled in year two. 125,000+ GitHub stars and a developer base showing up before you even start selling to them. $75M Series B closed in 2026, backed by top‑tier investors

• Team: ~40 people total, real visibility with the founders and leadership. No layers, no committees, fast decisions, short feedback loops

• Benefits: 100% employer‑paid medical, dental, and vision (50% for spouse and kids); employer‑paid life, short‑term, and long‑term disability insurance; 401(k), pre‑tax FSA, and commuter benefits; pet insurance; 15+ days PTO; 12 weeks fully paid parental leave for moms and dads; $100/month wellness stipend; $1,000/year learning and development budget; 3‑month paid sabbatical after 4 years; team offsites twice a year; SF HQ perks and a loaner e‑bike for commuting

• Visa: not open to visa sponsorship on this one (US citizens and Green Card holders only).

Interviewing Process

1. Intro Chat

2. Technical Chat

3. Founders Chat

4. Paid Work Trial

We are proud to be an equal opportunity workplace and consider all qualified applicants without regard to race, color, religion, national origin, age, sex, marital status, ancestry, disability, genetic information, veteran or military status, gender identity or expression, sexual orientation, or any other characteristic protected by law.