Software Development Engineer - Amazon OpenSearch, OpenSearch Core and Serverless

Amazon Web Services (AWS); Bellevue (WA); On-site; USD 144,000 - 194,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Job summary

Amazon Development Center U.S., Inc. in Bellevue, WA is seeking software engineers proficient in Lucene to help expand OpenSearch capabilities.

Join a community-driven, open source project with AWS OpenSearch and Serverless, own deployments and contribute to Lucene, OpenSearch and related projects. The role focuses on scalable search, vector search, and performance, mentoring others, and collaborating across teams.

Qualifications

• 5+ years of non-internship software development experience.
• Experience mentoring or leading an engineering team.
• Experience building search applications on OpenSearch or Lucene.
• Strong knowledge of distributed systems and performance.
• Experience with Apache Lucene or inverted index data structures.

Responsibilities

• Design, develop and maintain software with open source community and AWS stakeholders on Apache Lucene and OpenSearch.
• Contribute to Apache Lucene and OpenSearch; be mentored toward committer status where possible.
• Produce robust, efficient and maintainable code in Java, C/C++, and Python.
• Apply large-scale distributed system design and engineering best practices.
• Collaborate with partner teams across AWS to share best practices.
• Engage with the open source community and ensure release processes are followed.

Skills

Mentoring / Tech Lead

Distributed Systems

Open Source Collaboration

Code Review

Education

Bachelor's degree in Computer Science or related field

Master's degree in CS or related field

Tools

Java

C/C++

Python

OpenSearch

Lucene

Job description

Description

Are you interested in expanding the core search and query engine autoscaling capabilities of a highly scalable open source log analytics and search platform? Do you like collaborating and working on a decentralized open-source model, but also have ownership on real deployments of that project? Do you have experience working directly with Lucene and understand how features like Lucene codecs, facets, similarity functions, k-NN, and queries work? Do you get the differences between dense and sparse vector search? Do your peers consider you a mentor and do you enjoy scaling yourself by helping others learn?

Description

Are you interested in expanding the core search and query engine autoscaling capabilities of a highly scalable open source log analytics and search platform? Do you like collaborating and working on a decentralized open-source model, but also have ownership on real deployments of that project? Do you have experience working directly with Lucene and understand how features like Lucene codecs, facets, similarity functions, k-NN, and queries work? Do you get the differences between dense and sparse vector search? Do your peers consider you a mentor and do you enjoy scaling yourself by helping others learn? OpenSearch is a community-driven, Apache 2.0-licensed open source search and analytics suite built on Apache Lucene that makes it easy to ingest, search, visualize, and analyze data. As a community-driven project, multiple companies and individuals share responsibility for directing and contributing to the OpenSearch Project. As one of the larger integrators of the project, AWS OpenSearch and AWS OpenSearch Serverless, you will see the impact of your open source contributions directly and see how these contributions make our customers successful. We are hiring software engineers proficient in Lucene to help bring more capabilities and performance improvements into Lucene and OpenSearch. This is a rare opportunity to work with other talented engineers passionate about search not only at AWS, but also with folks at other companies contributing to both Lucene, OpenSearch and other open source projects.

Key job responsibilities

As a Software Engineer On Our Team, You Will

• Design, develop and maintain software by collaborating with the open source community and internal AWS stakeholders on Apache Lucene and OpenSearch.
• Have support from AWS in contributing to Apache Lucene as well as OpenSearch. If you are already a Lucene committer, we will continue to support your work there; if you are not, we will give you room to become one.
• Produce bullet-proof code that is robust, efficient and maintainable; our primary languages are Java, C/C++, and Python.
• Exercise your expert knowledge in large scale distributed system design and engineering best practices.
• Follow and set best practices and standards to ensure the high quality contributions.
• Maintain effective communication and collaboration with partner teams, both local and remote, in completing interdependent work items
• Work closely with multiple teams across search service organization and help them understand and implement best practices.
• Advocate for open source, both inside and outside the company.
• Engage with developers and management in seeing our open source release operationalized appropriately with monitoring, alerting, testing.
• Join a great group of motivated, top-notch, people and work with them to solve challenging problems in a fun, collaborative environment

Basic Qualifications

• 5+ years of non-internship professional software development experience
• 5+ years of programming with at least one software programming language experience
• 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• Experience as a mentor, tech lead or leading an engineering team
• Experience building search applications on OpenSearch, Solr, Cassandra, MongoDB, or other similar platforms with an understanding of how they work and why.
• A role model mentor and technical lead with a strong ability to break down work, delegate to other engineers, and help them learn and grow. You know when to be hands on and when to back off.
• Experience working with Apache Lucene or other inverted index storage libraries and an understanding of data structures, storage formats, and query capabilities that impact performance and usability.

Preferred Qualifications

• 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
• Master's degree in computer science or equivalent
• Experience in building large scale, extensible user experience platform on a public cloud
• Experience contributing to the Lucene project and you are a committer or on a path to becoming one.
• Deep understanding of information retrieval, search, search similarity and scoring, and the storage formats and data structures that make search different than other types of applications.

Basic Qualifications

• 3+ years of non-internship professional software development experience
• 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• 1+ years of software development engineer or related occupational experience
• 1+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience
• 1+ years of Object Oriented Design experience
• Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field
• Experience programming with at least one software programming language

Preferred Qualifications

• 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
• Bachelor's degree in computer science or equivalent

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.

USA, WA, Bellevue - 143,700.00 - 194,400.00 USD annually

Company

- Amazon Development Center U.S., Inc.

Job ID: A10493014