Senior AI Search Infrastructure Engineer

nebius; Stati Uniti; Remoto; USD 180.000 - 260.000; Tempo pieno

Descrizione del lavoro

nebius is seeking a senior or staff-level software engineer to own the indexing and data processing layer of a purpose-built AI-focused search platform. You will design and operate high-throughput pipelines, with a focus on freshness, completeness, and efficient querying across tens of gigabytes per second.

The role emphasizes systems design, distributed data processing, and collaboration with ML teams to ensure retrieved data meets ranking requirements.

Competenze

• Five+ years of experience building production backend or data infrastructure systems.
• Strong proficiency in Go; working knowledge of C++ or Rust is a plus.
• Experience with large-scale data processing at multi-GB/sec throughput and petabyte-scale datasets.
• Background building or operating databases, storage systems, data planes, or indexing pipelines.

Mansioni

• Design, build, and operate large-scale indexing systems and data pipelines at the core of the search infrastructure.
• Develop and tune indexing strategies balancing performance, freshness, and resource efficiency.
• Define and implement observability primitives and monitor throughput, resource usage, and cost over time.
• Build well-tested components with clear contracts and safe experimentation through controlled rollouts.

Conoscenze

Go

C++

Rust

Distributed systems

Data processing

Strumenti

Spark

Flink

Beam

MapReduce

Descrizione del lavoro

nebius is seeking a senior or staff-level software engineer to own the indexing and data processing layer of a purpose-built AI-focused search platform. You will design and operate high-throughput pipelines, with a focus on freshness, completeness, and efficient querying across tens of gigabytes per second.

The role emphasizes systems design, distributed data processing, and collaboration with ML teams to ensure retrieved data meets ranking requirements.