Senior Data Engineer for Retrieval & RAG Platform

Solvd; United States; Remote; USD 140,000 - 210,000; Full time

Job summary

solvd is seeking a software/ML engineer to own the retrieval workstream for an enterprise knowledge and agent-assistance solution. You will design and implement a versioned retrieval service with cited passages, ensuring permissions, latency, and cost targets are met.

You will build a hybrid vector/keyword search, deliver a Python API on Lambda behind API Gateway, and manage encryption, auth, and metrics. You’ll also create dashboards and runbooks for ongoing operations.

Qualifications

• Four+ years of software or ML engineering experience.
• Experience with production RAG or enterprise search systems.
• Hands-on with AWS Bedrock Knowledge Bases and retrieval APIs.
• Proficient in Python and deploying Lambda APIs behind API Gateway.
• Infrastructure-as-code with Terraform or AWS CDK; CI for deployments.
• Understanding chunking, embeddings, reranking, latency and cost trade-offs.
• Experience building operational dashboards in CloudWatch or similar.

Responsibilities

• Own retrieval workstream from cloud infra and design through API delivery and handover.
• Build hybrid vector and keyword search with metadata filters and ranking.
• Deliver versioned Python retrieval API using Lambda and API Gateway with auth and metrics.
• Apply permission metadata at query time to enforce access controls.
• Create reference retrieve-and-generate endpoint and support pilot testing.
• Develop runbooks and dashboards for model changes, re-embedding, index rebuilds and costs.

Skills

Python

Lambda

API Gateway

Bedrock Knowledge Bases

OpenSearch Serverless

Embedding models

Terraform

AWS CDK

CI/CD

CloudWatch dashboards

Education

Bachelor’s degree or higher in CS/Math/related field

Tools

Terraform

AWS CDK

OpenSearch Serverless

Job description

solvd is seeking a software/ML engineer to own the retrieval workstream for an enterprise knowledge and agent-assistance solution. You will design and implement a versioned retrieval service with cited passages, ensuring permissions, latency, and cost targets are met.

You will build a hybrid vector/keyword search, deliver a Python API on Lambda behind API Gateway, and manage encryption, auth, and metrics. You’ll also create dashboards and runbooks for ongoing operations.