Software Engineer - Elasticsearch

Recruiting From Scratch; San Francisco, California, Palo Alto (CA, MO, CA); Remote; USD 135,000 - 200,000; Full time

Job summary

Join a forward-thinking talent firm as a Software Engineer focusing on Elasticsearch, where your expertise will enhance critical data systems. In this fully remote role, you'll contribute to the development and optimization of Elasticsearch infrastructure, ensuring performance and reliability across hundreds of production clusters. Collaborate with diverse teams and tackle complex challenges that impact significant institutions worldwide. If you're eager to solve intricate problems at scale and make a meaningful impact, this is the perfect opportunity for you.

Qualifications

• Deep expertise in Elasticsearch and experience with large-scale deployments.
• Strong problem-solving skills and ability to enhance system reliability.

Responsibilities

• Evolve the search and indexing ecosystem for complex data.
• Design tooling for cluster deployment and management.
• Provide support for complex Elasticsearch issues and conduct root cause analyses.

Skills

Elasticsearch

Database Operations

Observability and Telemetry

Performance Optimization

Disaster Recovery

Education

Bachelor's degree in Computer Science or related field

Tools

Cluster Management Tools

Elasticsearch Client Libraries

Job description

Who is Recruiting from Scratch:

Recruiting from Scratch is a talent firm that focuses on placing the best candidate for our clients. Our team is 100% remote and we work with teams across North America, South America, and Europe to help them hire.

Salary Range: $135,000-$200,000 base plus competitive stock options.

As a Software Engineer on infrastructure, you'll contribute high-quality code to performant, secure, and scalable building blocks, enabling products deployed to the most important institutions in the public and private sector. You'll build the foundational capabilities that power our client's products used by research scientists, aerospace engineers, intelligence analysts, and economic forecasters, in countries around the world.

Our client is seeking engineers with deep expertise in Elasticsearch to join our newly formed Elasticsearch Dev team based in Palo Alto. This team is responsible for developing deeper expertise in Elasticsearch, owning and improving our client's Elasticsearch developer ecosystem, and acting as the final line of defense for support escalations. You will work closely with Database Operations and other engineering teams to drive improvements across our Elasticsearch infrastructure. As an Elasticsearch specialist, you will play a crucial role in developing, maintaining, and optimizing our Elasticsearch infrastructure across our client's platforms, including Gotham and Foundry. Our Elasticsearch ecosystem spans hundreds of production clusters, ranging from small-scale deployments to massive installations with over 100 nodes and 100TB of data. You will be responsible for enhancing our capabilities, improving performance, and ensuring the reliability of these critical systems.

If you're passionate about solving complex problems at scale and want to make a significant impact on critical data systems, we encourage you to apply.

Role responsibilities:

1. Evolving our performant search and indexing ecosystem for complex granularly permissioned data
2. Design and implement tooling for cluster deployment, operations, and management
3. Improve observability, telemetry, and diagnostics for Elasticsearch clusters
4. Lead major and minor version upgrades and CVE remediation efforts
5. Analyze and optimize usage patterns of major clients to enhance stability and performance
6. Standardize and improve Elasticsearch client libraries across our platforms
7. Develop and enhance disaster recovery tooling
8. Collaborate with Database Operations to streamline support for our production fleet
9. Provide L2 and L3 support for complex Elasticsearch issues
10. Conduct root cause analyses and implement solutions for critical problems
11. Define and review Standard Operating Procedures (SOPs) for common issues
12. Engage with the broader Elasticsearch open-source community