Lead Software Engineer, Semantic Search & OpenSearch

Commerce; EUA; Teletrabalho; USD 182 000 - 259 000; Tempo integral

Resumo da oferta

Commerce in Austin is seeking a Lead Software Engineer, Search to pioneer semantic and hybrid OpenSearch-based search infrastructure across our ecosystem. You will architect the core capabilities, blending BM25 with vector search to deliver fast, relevant results at scale.

You’ll oversee data pipelines (MySQL, Kafka, RabbitMQ), mentor engineers, and drive latency and availability while shaping the OpenSearch strategy and adoption of neural search features.

Qualificações

• 7+ years of professional software development experience, with a proven track record in a technical leadership or staff-level capacity.
• Deep hands-on experience building, scaling, and fine-tuning OpenSearch (or Elasticsearch) clusters at scale.
• Proven experience implementing semantic search, working with text embeddings, vector databases, and configuring hybrid search scoring models.
• High proficiency in backend languages (Go/Scala/Java) and experience with PHP.
• Strong experience with relational databases (MySQL), and distributed messaging tools (Kafka or RabbitMQ) for heavy data mutation and indexing.
• Familiarity with OpenSearch Neural Search plugin, k-NN search, or Learning to Rank (LTR).
• Experience migrating large-scale search infrastructure to OpenSearch semantic implementations.
• Experience setting up automated search quality measurement frameworks (e.g., NDCG, MRR).
• Familiarity with containerization and orchestration (Docker, Kubernetes) in a cloud environment.

Responsabilidades

• Architect semantic and hybrid search using OpenSearch from the ground up.
• Iterate, benchmark, and tune relevance, ranking models, and neural search in OpenSearch.
• Own data ingestion and indexing pipelines with MySQL, Kafka/RabbitMQ to support dense vectors and deduping.
• Provide technical leadership and mentor engineers on architecture.
• Ensure ultra-low latency, high-availability SLAs and participate in on-call rotation.

Conhecimentos

OpenSearch

Semantic search

Hybrid search

Backend languages

Ferramentas

Docker

Kubernetes

MySQL

Kafka

RabbitMQ

OpenSearch

Descrição da oferta de emprego

Commerce in Austin is seeking a Lead Software Engineer, Search to pioneer semantic and hybrid OpenSearch-based search infrastructure across our ecosystem. You will architect the core capabilities, blending BM25 with vector search to deliver fast, relevant results at scale.

You’ll oversee data pipelines (MySQL, Kafka, RabbitMQ), mentor engineers, and drive latency and availability while shaping the OpenSearch strategy and adoption of neural search features.