Senior Software Engineer - Search & Vector Database Infrastructure

ByteDance

Seattle (WA)

On-site

USD 242,000 - 456,000

Full time

8 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Medical insurance
Dental insurance
Vision insurance
401(k) match
Paid parental leave

Job summary

ByteDance's Search team is building a fully managed information retrieval and analytics platform, integrating with Elasticsearch, OpenSearch, and Milvus to serve GenAI, search, security, and observability use cases. You will help advance vector and full-text search at scale, in a globally distributed, enterprise-grade environment.

Join us to push AI-powered search, RAG, and multimodal retrieval capabilities, collaborating with researchers and engineers to deliver impactful, production-grade

Qualifications

  • BS in Computer Science, AI, ML, or related field.
  • Strong software engineering in C++, Golang, Java, or Python.
  • Experience with search engines, databases, or distributed systems.
  • Hands-on experience with Elasticsearch/OpenSearch or Milvus.
  • Strong understanding of distributed systems and performance optimization.

Responsibilities

  • Develop and evolve Elasticsearch/OpenSearch and Milvus products for high-performance search and vector retrieval.
  • Develop full-text and vector search, including hybrid and multi-vector retrieval.
  • Optimize vector indexing and distributed retrieval across HNSW, IVF, DiskANN, etc.
  • Explore cloud-native Vector Lakebase architectures for scalable search over data lakes.

Skills

Strong software engineering skills in
Experience with search engines
Distributed systems knowledge

Education

B.S in Computer Science, AI, ML, or related field

Tools

Elasticsearch/OpenSearch
Milvus

Job description

Responsibilities

About the Team: The Search team is dedicated to building a fully managed, one-stop platform for information retrieval and analytics. Deeply compatible with Elasticsearch, OpenSearch, and Milvus, the platform serves four core scenarios - GenAI applications, search, security, and observability and provides comprehensive capabilities across full-text search, vector search, geospatial search, and hybrid search. We are also building next-generation Agentic Search products, including RAG, AI-powered search, and multimodal retrieval, continuously pushing the boundaries of intelligent search technology. We are deeply involved in the open-source ecosystem and have contributed hundreds of PRs across the OpenSearch, Elasticsearch, Lucene, and Milvus communities. Several members of our team hold key leadership roles in these communities, including Governing Board Member, Technical Steering Committee Member, PMC Member, and Maintainer, helping shape the evolution of the broader search and database ecosystem through sustained technical contributions. On the business side, we not only provide reliable infrastructure for some of ByteDance's largest-scale vector and full-text hybrid search workloads, but also deliver enterprise-grade cloud search services to external customers through Volcano Engine, helping businesses unlock growth through data. We embrace a pragmatic yet ambitious engineering culture: while continuously publishing innovative research at top-tier conferences such as VLDB and ICDE, we remain strongly focused on real-world impact and commercial adoption, building a comprehensive product portfolio that serves a wide range of search and AI use cases. Our team brings together leading database researchers and exceptional engineers from around the world. We are looking for talented individuals with expertise in search or vector database engine development, distributed systems architecture, or AI model innovation to join us. Together, we will explore uncharted technical territory, define the data foundation for the AI era, and empower both ByteDance and enterprises across industries to achieve AI-driven transformation.

Responsibilities
  • Develop and evolve our Elasticsearch/OpenSearch and Milvus products, building high-performance and scalable search and vector retrieval capabilities.
  • Develop high-performance full-text and vector search, including hybrid search, filtered search, multi-vector search, and large-scale ANN retrieval.
  • Optimize vector indexing and distributed retrieval across HNSW, IVF, DiskANN, RaBitQ, storage, caching, and I/O.
  • Explore cloud-native Vector Lakebase architectures for scalable search over data lakes and object storage.
Qualifications
Minimum Qualifications
  • B.S in Computer Science, AI, Machine Learning, or a related field.
  • Strong software engineering skills in C++, Golang, Java, or Python.
  • Experience with search engines, databases, storage systems, or distributed systems.
  • Hands-on experience with Elasticsearch/OpenSearch or Milvus in production or system development.
  • Strong understanding of distributed systems and performance optimization.
Preferred Qualifications
  • Deep experience with Elasticsearch/OpenSearch, Lucene, Milvus/Knowhere, or similar systems.
  • Strong knowledge of full-text search and (multi)-vector indexing, including HNSW, IVF, DiskANN, or related ANN algorithms.
  • 5 years experience optimizing billion-scale or larger vector retrieval for latency, throughput, recall, and cost.
  • 5 years experience with cloud-native storage, compute-storage separation, object storage, or lakehouse/lakebase architectures.
About Us

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

Why Join ByteDance

Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day. As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Reasonable Accommodation

ByteDance is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at https://tinyurl.com/RA-request

Job Information

【For Pay Transparency】Compensation Description (Annually)

The base salary range for this position in the selected city is $241680 - $456000 annually.

Compensation may vary outside of this range depending on a number of factors, including a candidate's qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.

Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).

The Company reserves the right to modify or change these benefits programs at any time, with or without notice.

For Los Angeles County (unincorporated) Candidates:

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:

  1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;
  2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and
  3. Exercising sound judgment.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Engineer - Data Agent & Agentic Search
Software Engineer - Data Agent & Agentic Search

ByteDance • Seattle (WA)

On-site
USD 154,000 - 301,000
Software Engineer - Search & Vector Database Infrastructure
Software Engineer - Search & Vector Database Infrastructure

ByteDance • Seattle (WA)

On-site
USD 154,000 - 301,000
Tech Lead Engineer, Physical AI Infrastructure
Tech Lead Engineer, Physical AI Infrastructure

ByteDance • San Jose (CA)

On-site
USD 254,000 - 480,000
Medical insurance
401(k) match
Paid parental leave
+2
Tech Lead Research Scientist, Physical AI Infra
Tech Lead Research Scientist, Physical AI Infra

ByteDance • San Jose (CA)

On-site
USD 254,000 - 480,000
Software Engineer - Search & Vector Database Infrastructure San Jose Regular
Software Engineer - Search & Vector Database Infrastructure San Jose Regular

ByteDance Ltd. • San Jose (CA)

On-site
USD 170,000 - 250,000
Tech Lead Research Scientist, Physical AI Infra
Tech Lead Research Scientist, Physical AI Infra

ByteDance • Seattle (WA)

On-site
USD 242,000 - 456,000
Health insurance
401(k) savings plan
Paid parental leave
Tech Lead Engineer, Physical AI Infra
Tech Lead Engineer, Physical AI Infra

ByteDance • Seattle (WA)

On-site
USD 242,000 - 456,000
Senior Production System Engineer - San Jose
Senior Production System Engineer - San Jose

ByteDance • San Jose (CA)

On-site
USD 122,000 - 272,000
Tech Lead Cloud Site Reliability Engineer - DCS Cloud
Tech Lead Cloud Site Reliability Engineer - DCS Cloud

ByteDance • Seattle (WA)

On-site
USD 242,000 - 456,000
Medical insurance
Dental insurance
Vision insurance
+8
Production Engineer - Applied Machine Learning
Production Engineer - Applied Machine Learning

ByteDance • San Jose (CA)

On-site
USD 162,000 - 388,000
Medical Insurance
Dental Insurance
Vision Insurance
+7