Senior Benchmarking Engineer — Performance & Competition

Elastic; Polska; Vor Ort; PLN 250.000 - 350.000; Vollzeit

Zusammenfassung

Elastic is seeking a Senior Software Engineer to lead competitive benchmarking initiatives within the Elasticsearch Performance team. You will build workloads, automate experiments, and compare Elasticsearch against alternative systems to identify strengths and gaps.

You will publish reproducible benchmark artifacts and collaborate with product teams to translate findings into concrete improvements, influencing both engineering and product direction.

Qualifikationen

• Solid software engineering skills with maintainable automation and analysis tooling.
• Hands-on experience evaluating performance in distributed systems or search infrastructure.
• Ability to design representative datasets and workloads with concurrency and ingestion patterns.
• Strong experimental judgment and ability to distinguish meaningful changes from noise.
• Experience building reproducible test environments and documenting configurations.

Aufgaben

• Own prioritized competitive benchmarking initiatives across search, vector, and hybrid retrieval workloads.
• Build and maintain automated benchmark harnesses, datasets, query sets, and load profiles reflecting real-world usage.
• Design fair, well-documented comparisons with clear system versions and tuning decisions.
• Evaluate latency, throughput, resource usage, and cost efficiency; measure recall/quality targets.
• Adapt and extend workload tools (Elasticsearch Rally, ClickBench, vector benchmarks).
• Investigate performance differences using profiling and metrics; collaborate with engineering teams to validate improvements.
• Evaluate self-managed and cloud deployments, including serverless options.
• Publish reproducible benchmark artifacts and technical reports with methodology and tradeoffs.
• Collaborate with product management to translate findings into product improvements.

Kenntnisse

Python

Distributed systems

Performance benchmarking

Tools

Elasticsearch Rally

ClickBench

Vector search benchmarks

Jobbeschreibung

Elastic is seeking a Senior Software Engineer to lead competitive benchmarking initiatives within the Elasticsearch Performance team. You will build workloads, automate experiments, and compare Elasticsearch against alternative systems to identify strengths and gaps.

You will publish reproducible benchmark artifacts and collaborate with product teams to translate findings into concrete improvements, influencing both engineering and product direction.