Senior Benchmarking Engineer: Performance & Competitiveness

Elastic; Canada; On-site; CAD 128,000 - 203,000; Full time

Benefits offered by this job

Health coverage

Flexible locations & schedules

Vacation days

Donation matching

Volunteer hours

Parental leave

Job summary

Elastic is seeking a Senior Software Engineer to lead competitive benchmarking within the Elasticsearch Performance team. You will develop workloads, automate experiments, and compare Elasticsearch with alternatives to guide product improvements and inform customers.

This hands-on role involves building benchmarks, analyzing latency and cost, and publishing reproducible results with engineering and content partners.

Qualifications

• Strong software engineering skills with automation and analysis tooling.
• Hands-on experience evaluating performance in distributed systems or search infrastructure.
• Depth in search, vector retrieval, analytical databases, or observability systems and ability to learn unfamiliar systems.
• Experience designing representative datasets and workloads with concurrency and ingestion behavior.
• Sound experimental judgment with repeated measurements and managing noise.

Responsibilities

• Own benchmarking initiatives across search, vector and hybrid retrieval workloads.
• Build and maintain automated benchmark harnesses and datasets reflecting real-world usage.
• Design fair, well-documented comparisons with clear configurations and resource budgets.
• Evaluate latency, throughput, and cost efficiency; measure recall/relevance targets.
• Publish reproducible benchmark artifacts and technical reports with findings and tradeoffs.

Skills

Python

Distributed systems

Performance benchmarking

Benchmarking frameworks

Technical writing

Tools

Elasticsearch Rally

ClickBench

Vector search benchmarks

Job description

Elastic is seeking a Senior Software Engineer to lead competitive benchmarking within the Elasticsearch Performance team. You will develop workloads, automate experiments, and compare Elasticsearch with alternatives to guide product improvements and inform customers.

This hands-on role involves building benchmarks, analyzing latency and cost, and publishing reproducible results with engineering and content partners.