Staff Software Engineer, Ingestion & Search Platform

Refinitiv; Eagan, Northern (MN, KY); Hybrid; USD 140,000 - 210,000; Full time

Job summary

Refinitiv in Eagan, MN seeks a Staff Software Engineer to anchor the ingestion and indexing systems for our massive content platform. You will own end-to-end design, implementation, and operation of the document ingestion pipeline, combining Kafka-based streaming with Vespa and OpenSearch components to move millions of documents.

You will lead dual-path ingestion for batch and real-time updates, manage models within the pipeline, ensure observability and latency targets, and drive production

Skills

Kafka

Vespa

Protobuf

OpenSearch

System architecture

End-to-end ownership

Tools

DynamoDB

Job description

Refinitiv in Eagan, MN seeks a Staff Software Engineer to anchor the ingestion and indexing systems for our massive content platform. You will own end-to-end design, implementation, and operation of the document ingestion pipeline, combining Kafka-based streaming with Vespa and OpenSearch components to move millions of documents.

You will lead dual-path ingestion for batch and real-time updates, manage models within the pipeline, ensure observability and latency targets, and drive production