Senior Software Engineer: Large-Scale Data Pipelines & Indexing

Nebius B.V.; Amsterdam; On-site; EUR 90,000 - 130,000; Full time

Benefits offered by this job

Competitive compensation

Career growth

Flexibility

Collaborative culture

Impactful AI projects

Job summary

Nebius B.V. in Amsterdam is seeking a Senior Software Engineer to build and operate the indexing and data processing layer of a novel AI-oriented search engine.

You will design systems that ingest, process, and organize massive datasets into fast, queryable structures, focusing on offline and nearline pipelines with tens of gigabytes per second throughput. You will collaborate with runtime and ML teams to ensure reliability, observability, and cost-efficient operation, while shipping well-tested

Qualifications

• 5+ years of production backend or data infrastructure experience.
• Strong Go experience.
• Experience with large-scale data processing systems (10+ GiB/sec throughput, petabyte-scale datasets)

Responsibilities

• Design, implement and operate large-scale indexing systems and data pipelines.
• Develop and optimise indexing strategies; work on storage formats, compaction, and update mechanisms.
• Ensure pilot pipelines reliability and build observability primitives for monitoring throughput and cost

Skills

Go

Backend systems

Data processing

Job description

Nebius B.V. in Amsterdam is seeking a Senior Software Engineer to build and operate the indexing and data processing layer of a novel AI-oriented search engine.

You will design systems that ingest, process, and organize massive datasets into fast, queryable structures, focusing on offline and nearline pipelines with tens of gigabytes per second throughput. You will collaborate with runtime and ML teams to ensure reliability, observability, and cost-efficient operation, while shipping well-tested