Principal Rust Engineer

Progress

United States

Remote

USD 180,000 - 240,000

Full time

11 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Employee stock purchase plan
23 vacation days annual leave
Birthday day off
Life and medical insurance
Health leave and family leave

Job summary

Progress is seeking a senior engineer to set the technical direction for a distributed search and indexing engine. You will work on low‑level Rust development and distributed system design, with collaboration across ML, product, and platform teams, and contribute to Python services and open‑source work.

You will own architecture, implement advanced indexes, and optimize for performance and reliability. Strong leadership, a deep understanding of search internals, and remote collaboration are

Qualifications

  • Extensive experience leading high‑performance production systems.
  • Expert Rust skills, including asynchronous programming, memory‑mapped I/O, profiling.

Responsibilities

  • Own architecture and roadmap for the search and indexing engine.
  • Design and implement vector, full‑text, and graph indexes and query capabilities.
  • Evolve index building, merging, sharding, and replication across storage and messaging.
  • Lead migrations and performance work with profiling and benchmarks while avoiding downtime.
  • Maintain Python services, bindings, and Rust‑to‑Python interfaces with stable APIs.
  • Improve observability, reliability, and security across Kubernetes and CI/CD; write designs and mentor.

Skills

Rust
Distributed systems
Python
Kubernetes
Profiling
Asynchronous programming
English communication

Tools

PostgreSQL
NATS JetStream
Kafka
PyO3
FastAPI
Pydantic

Job description

Role overview

Set technical direction for a distributed search and indexing engine that supports retrieval across vector, full-text, and knowledge-graph data. The role spans low-level Rust implementation and distributed system design, with responsibility for performance, reliability, and safe production evolution. You will work with machine learning, product, and platform colleagues and contribute to related Python services and open-source development.

Responsibilities
  • Own the architecture and roadmap for the search and indexing engine, delivering improvements incrementally.
  • Design and implement vector, full-text, and graph indexes, along with query and filtering capabilities.
  • Evolve index building, merging, sharding, and replication across object storage, PostgreSQL, and messaging infrastructure.
  • Lead migrations and performance work using profiling and benchmarks while avoiding customer downtime.
  • Maintain Python services, SDKs, and Rust-to-Python bindings while keeping public APIs stable.
  • Improve observability, reliability, and security across Kubernetes deployments and CI/CD; write design proposals, review code, mentor engineers, and contribute to the open-source community.
Requirements
  • Extensive experience building and operating high-performance production systems, including technical leadership.
  • Expert Rust skills, including asynchronous programming, concurrency, memory-mapped I/O, profiling, and low-level optimization.
  • Deep understanding of search internals such as approximate nearest-neighbor search, vector quantization, inverted indexes, and ranking.
  • Experience designing distributed data systems and making storage, sharding, replication, and consistency trade-offs.
  • Strong experience with PostgreSQL, cloud object storage, and messaging systems such as NATS JetStream or Kafka.
  • Strong Python skills and experience with Kubernetes, observability, and CI/CD; clear English communication and a willingness to mentor in a remote team.
Nice to have
  • Experience with Tantivy, Lucene, vector databases, knowledge graphs, or graph-based retrieval.
  • Familiarity with embedding models such as multi-vector models, and with PyO3, asyncio, FastAPI, or Pydantic.
  • Open-source maintenance experience, including dependency and licensing review.
Benefits and work setup
  • Remote-first position with a global team.
  • Benefits include an employee stock purchase plan, 23 annual vacation days, a birthday day off, community service time off, life and medical insurance, and additional family and health leave.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Principal Rust Engineer, Distributed Search
Remote Principal Rust Engineer, Distributed Search

Progress • United States

Remote
USD 180,000 - 240,000
Employee stock purchase plan
23 vacation days annual leave
Birthday day off
+2
Staff / Senior Software Engineer (Agentic Search) - Index
Staff / Senior Software Engineer (Agentic Search) - Index

nebius • United States

Remote
USD 180,000 - 260,000
Senior Backend Software Engineer (Rust)
Senior Backend Software Engineer (Rust)

directus.com • United States

Remote
USD 140,000 - 190,000
Remote-friendly Europe-based
Rust Engineer (Part Time)
Rust Engineer (Part Time)

Remotebase • United States

Remote
USD 83,000 - 152,000
Fully remote
Flexible timings
Learning and growth
Lead Systems Engineer (Rust) - AI Platform
Lead Systems Engineer (Rust) - AI Platform

Alignerr Corp. • United States

Remote
GBP 83,000 - 165,000
Senior Software Engineer, Search & AI
Senior Software Engineer, Search & AI

muckrack • United States

Remote
USD 150,000 - 190,000
Fully distributed
Learning resources
Development time off
+3
Senior Rust Engineer – Build the Future of Cloud-Native Infrastructure
Senior Rust Engineer – Build the Future of Cloud-Native Infrastructure

UMATR • United States

On-site
USD 200,000 - 220,000
Competitive salary up to $220,000
Strong equity upside
Collaborative environment
Rust Engineer / EST
Rust Engineer / EST

Motion Recruitment • Weehawken (NJ)

Remote
USD 120,000 - 180,000
Medical, dental, and vision coverage
401(k)
Flexible PTO
+1
Rust Real-Time Market Data Engineer - Remote
Rust Real-Time Market Data Engineer - Remote

Motion Recruitment • Weehawken (NJ)

Hybrid
USD 120,000 - 180,000
Medical, dental, and vision coverage
401(k)
Flexible PTO
+1
Senior Rust Engineer — Part-Time, Remote & Flexible
Senior Rust Engineer — Part-Time, Remote & Flexible

Remotebase • United States

Remote
USD 83,000 - 152,000
Fully remote
Flexible timings
Learning and growth