Vector & Full-Text Search Engineer - Scalable Infra

ByteDance; San Jose (CA); On-site; USD 128,000 - 317,000; Full time

Benefits offered by this job

Medical/Dental/Vision

401(k) match

Parental leave

Disability insurance

Life insurance

Wellbeing benefits

Paid time off

Job summary

ByteDance in the United States is seeking engineers to advance our distributed search platform, including traditional text search and vector-based retrieval. You will contribute to high-performance engines and scalable systems, collaborating with a global team to push innovations in AI-driven search techniques.

You will engage in open-source collaborations and ship production-grade features, while optimizing latency, throughput, and cost across large-scale datasets.

Qualifications

• B.S in Computer Science, AI, Machine Learning, or a related field.
• Strong software engineering skills in C++, Golang, Java, or Python.
• Experience with search engines, databases, storage systems, or distributed systems.
• Hands-on experience with Elasticsearch/OpenSearch or Milvus in production or system development.
• Strong understanding of distributed systems and performance optimization.

Responsibilities

• Develop and evolve Elasticsearch/OpenSearch and Milvus products for high-performance search and vector retrieval.
• Develop high-performance full-text and vector search, including hybrid search and multi-vector search.
• Optimize vector indexing and distributed retrieval across HNSW, IVF, DiskANN, RaBitQ, storage, caching, and I/O.
• Explore cloud-native Vector Lakebase architectures for scalable search over data lakes.

Skills

C++

Golang

Java

Python

Distributed systems

Search engines

Elasticsearch/OpenSearch

Milvus

Education

B.S in Computer Science

Tools

Elasticsearch/OpenSearch

Milvus

Lucene

Job description

ByteDance in the United States is seeking engineers to advance our distributed search platform, including traditional text search and vector-based retrieval. You will contribute to high-performance engines and scalable systems, collaborating with a global team to push innovations in AI-driven search techniques.

You will engage in open-source collaborations and ship production-grade features, while optimizing latency, throughput, and cost across large-scale datasets.