Benchmark Engineer

Qdrant; Berlin; Vor Ort; EUR 40.000 - 60.000; Vollzeit

Zusammenfassung

A technology company in Berlin is looking for a Benchmark Engineer to design and maintain reproducible benchmarks for their open-source vector database. This role involves evaluating performance metrics, building automation tools, and collaborating closely with engineers to ensure real-world workloads are effectively benchmarked. Ideal candidates need a solid software engineering background and skills in performance testing. The position allows for remote work with flexible hours.

Leistungen

Fully remote team

Flexible working hours

Open-source, engineering-driven culture

High ownership and real impact

Qualifikationen

• Strong software engineering background.
• Solid understanding of databases and search engines.
• Experience with performance testing and benchmarking.

Aufgaben

• Design and maintain reproducible benchmarks for vector search.
• Evaluate performance across various dimensions.
• Build and maintain benchmarking tooling and automation.

Kenntnisse

Software engineering (Rust, Python, Go)

Databases knowledge

Distributed systems understanding

Performance testing and profiling

Clear communication skills

Tools

Benchmarking tooling

Observability tools

Jobbeschreibung

Qdrant is an open-source vector database built for high-performance similarity search and AI applications. We power production-grade semantic search, recommendation systems, and RAG pipelines for teams worldwide. As AI adoption accelerates, performance, correctness, and transparency matter more than ever — and that’s where you come in.

The Role

We’re looking for a Benchmark Engineer to own and evolve how we measure, validate, and communicate Qdrant’s performance. You’ll design realistic benchmarks, build tooling around them, and transform raw numbers into actionable insights that inform product decisions, documentation, and user trust.

This role sits at the intersection of engineering, performance, and developer experience.

Tasks

What You’ll Do

• Design and maintain reproducible benchmarks for vector search, indexing, filtering, and distributed workloads
• Evaluate performance across different dimensions: latency, throughput, recall, memory usage, and cost
• Compare Qdrant against alternative solutions in a fair, transparent, and technically sound way
• Build and maintain benchmarking tooling, datasets, and automation (CI, dashboards, reports)
• Collaborate closely with core engineers to identify regressions, bottlenecks, and optimization opportunities
• Help translate benchmark results into clear narratives for docs, blog posts, and talks
• Ensure benchmarks reflect real-world user workloads, not just synthetic best cases

Requirements

What We’re Looking For

• Strong software engineering background (Rust, Python, Go, or similar)
• Solid understanding of databases, distributed systems, or search engines
• Experience with performance testing, profiling, and benchmarking
• Ability to reason about trade-offs (speed vs accuracy, memory vs latency, etc.)
• Comfort working with large datasets and automation pipelines
• Clear communication skills — you can explain numbers and their implications

Nice to Have

• Experience with vector search, ANN algorithms, or ML infrastructure
• Familiarity with cloud environments and containerized workloads
• Experience contributing to open-source projects
• Knowledge of observability tools and performance profiling

Benefits

Why Join Qdrant

• Work on core infrastructure for modern AI systems
• Open-source, engineering-driven culture
• Fully remote team with flexible working hours
• High ownership, real impact, and technical depth
• Opportunity to shape how the industry evaluates vector databases

Recruiting Agencies and Headhunters, please only via https://hirebuffer.com?ref=qdrant