AI Search Engineer

Olostep Technologies Inc.; San Francisco, Northern (CA, KY); Hybrid; USD 180,000 - 260,000; Full time

Job summary

Olostep Technologies Inc. is building the next generation search infrastructure for an agentic-first world in San Francisco. This role owns the full search pipeline—from crawling and indexing to processing and ranking results for fast lookup and deep, multi-step research.

You will design scalable, low-latency systems, optimize for freshness and coverage, and instrument the stack with observability to continuously improve relevance and reliability.

Responsibilities

• Design and scale a distributed web crawler optimized for freshness, coverage, and extracting agent-relevant signals.
• Build and maintain a high-throughput indexing pipeline that can process billions of pages with structured metadata.
• Develop query processing and ranking systems that serve both fast search and deep research use cases.
• Build retrieval pipelines that are natively agentic, with awareness of context, multi-hop reasoning, and iterative query refinement.
• Instrument the search stack with observability tooling and use it to continuously improve relevance and reliability.

Job description

Build the search infrastructure that powers how AI agents find, understand, and reason over the open web. Engineered from the ground up for an agentic world.

Why this role matters

This is a high-responsibility, high-leverage role. You'll be building what is effectively Google for the AI era.

You'll work across the full search stack: crawling, indexing, query processing, and ranking.

The systems you build will be foundational to how trillions of agent queries get answered.

About the role

We are rebuilding search from the ground up for an agentic-first world. This isn't about wrapping an existing engine. It's about rethinking what search means when the user is an AI agent running a research workflow, not a human typing a query into a box.

This is one of the highest-responsibility and highest-leverage roles at Olostep. The opportunity here is to build the search infrastructure for the AI era, the equivalent of what Google built for the human web, but designed from day one for agents. The person in this role will have enormous impact on where the company goes.

You will own the full search pipeline: from how we crawl and index the web at scale, to how we process and rank results for both fast lookup and deep, multi-step research. You'll design systems that are reliable, low-latency, and built around the reasoning patterns of modern AI agents.

What you'll do

• Design and scale a distributed web crawler optimized for freshness, coverage, and extracting agent-relevant signals.
• Build and maintain a high-throughput indexing pipeline that can process billions of pages with structured metadata.
• Develop query processing and ranking systems that serve both fast search and deep research use cases.
• Build retrieval pipelines that are natively agentic, with awareness of context, multi-hop reasoning, and iterative query refinement.
• Instrument the search stack with observability tooling and use it to continuously improve relevance and reliability.