Senior Search & Vector DB Infra Engineer

ByteDance; Seattle (WA); On-site; USD 140,000 - 210,000; Full time

Job summary

ByteDance is seeking engineers to advance our fully managed search and vector retrieval platforms. You will contribute to high-performant full-text and vector search, hybrid search, and scalable indexing across distributed systems.

You will work with Elasticsearch/OpenSearch and Milvus in production, collaborating with a global team to push open-source projects forward while delivering enterprise-grade cloud search services on Volcano Engine.

Qualifications

• Minimum Qualifications- B.S in Computer Science, AI, Machine Learning, or a related field.
• Strong software engineering skills in C++, Golang, Java, or Python.
• Experience with search engines, databases, storage systems, or distributed systems.
• Hands-on experience with Elasticsearch/OpenSearch or Milvus in production or system development.
• Preferred Qualifications- Deep experience with Elasticsearch/OpenSearch, Lucene, Milvus/Knowhere, or similar systems.
• Strong knowledge of full-text search and (multi)-vector indexing, including HNSW, IVF, DiskANN, or related ANN algorithms.
• 5 years experience optimizing billion-scale or larger vector retrieval for latency, throughput, recall, and cost.
• 5 years experience with cloud-native storage, compute-storage separation, object storage, or lakehouse/lakebase architectures.

Responsibilities

• Develop and evolve our Elasticsearch/OpenSearch and Milvus products, building high-performance and scalable search and vector retrieval capabilities.
• Develop high-performance full-text and vector search, including hybrid search, filtered search, multi-vector search, and large-scale ANN retrieval.
• Optimize vector indexing and distributed retrieval across HNSW, IVF, DiskANN, RaBitQ, storage, caching, and I/O.
• Explore cloud-native Vector Lakebase architectures for scalable search over data lakes and object storage.

Skills

C++

Golang

Java

Python

Distributed systems

Search engines

Education

B.S in Computer Science, AI, Machine Learning, or a related field

Tools

Elasticsearch/OpenSearch

Milvus

Job description

ByteDance is seeking engineers to advance our fully managed search and vector retrieval platforms. You will contribute to high-performant full-text and vector search, hybrid search, and scalable indexing across distributed systems.

You will work with Elasticsearch/OpenSearch and Milvus in production, collaborating with a global team to push open-source projects forward while delivering enterprise-grade cloud search services on Volcano Engine.