Staff Engineer, Large-Scale Search & Retrieval (Remote)

Syllo; United States; Remote; USD 190,000 - 230,000; Full time

Benefits offered by this job

Health insurance

Equity

Job summary

Syllo is seeking a Staff Software Engineer to own and scale our advanced search, indexing, and data scanning infrastructure as we move to multi-petabyte data volumes. You will shape the retrieval stack to balance speed and cost, delivering sub-second latency for interactive workflows in a cloud-based environment.

You will design data tiering and scalable scanning, drive architectures for rapid querying across vast document sets, and guide teams as a technical leader ensuring resiliency during

Qualifications

• 8+ years of software engineering experience at Staff/Principal level.
• Deep production expertise tuning Lucene-based search engines and vector indexing.
• Strong history of cost-aware architecture for hot/cold data and scalable scanning.
• Extensive experience with distributed data pipelines and high-throughput systems.
• Cloud infrastructure expertise with Kubernetes; Go/Rust/Python/Java backend proficiency.

Responsibilities

• Scale the Retrieval Stack: optimize and evolve hybrid search infrastructure for lexical search and dense vectors.
• Advanced Data Tiering & Scanning: design cost-efficient tiering across hot, warm, and cold data; optimize asynchronous scans of petabytes.
• Relentless Optimization: reduce latency and cost-to-serve; tune indexing and querying algorithms; optimize cloud resources for scale.
• Technical Leadership: own the indexing and search ecosystem; set long-term technical vision for data storage and retrieval.
• Resiliency at Scale: ensure fault tolerance and high availability during massive ingest events and concurrent querying.

Skills

Petabyte-scale data

Vector search tuning

Distributed systems

Go

Rust

Python

Java

Cloud infrastructure

Kubernetes

Tools

Elasticsearch

Lucene

Solr

Kubernetes

Kafka

Kinesis

Job description

Syllo is seeking a Staff Software Engineer to own and scale our advanced search, indexing, and data scanning infrastructure as we move to multi-petabyte data volumes. You will shape the retrieval stack to balance speed and cost, delivering sub-second latency for interactive workflows in a cloud-based environment.

You will design data tiering and scalable scanning, drive architectures for rapid querying across vast document sets, and guide teams as a technical leader ensuring resiliency during