Senior Data Engineer — Bedrock RAG Retrieval Platform

Solvd, Inc.

United States

Remote

USD 150,000 - 190,000

Full time

8 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Solvd, Inc. is seeking a Senior/Staff Data Engineer to lead the Bedrock Knowledge Base and OpenSearch Serverless implementations for enterprise AI solutions.

You’ll own end-to-end retrieval pipelines, embedding strategies, and metadata filters in collaboration with the Solution Architect. You’ll build versioned APIs behind API Gateway and Lambda, enforce entitlement at query time, and develop a quality dashboard tracking relevance, citations, latency, and cost.

Qualifications

  • 4+ years of software or ML engineering experience with production RAG or enterprise search.
  • Hands-on with Amazon Bedrock Knowledge Bases, Retrieve and RetrieveAndGenerate APIs, embedding models.
  • Python and Lambda/API Gateway with auth, versioning, and throttling.
  • Infrastructure-as-code with Terraform or AWS CDK for client deployments.
  • Understanding chunking, embedding selection, reranking, and the trade-offs between relevance, latency, and cost.
  • Experience building operational dashboards in CloudWatch or equivalent.

Responsibilities

  • Stand up the Bedrock Knowledge Base and OpenSearch Serverless vector collection in the client’s account from infrastructure code, with the embedding model, chunking strategy, and metadata fields the architect specified.
  • Implement hybrid retrieval — vector plus keyword — with metadata filtering by taxonomy, source, status, and review date; tune top‑k, score thresholds, and reranking against the golden question suite.
  • Build the retrieval API on API Gateway and Lambda per the Integration Blueprint — versioned paths, authentication for the Agent Assist provider, per-client rate limits and usage metrics, structured error responses, and a citation payload with source URL, title, section, and last modified date.
  • Enforce entitlement at query time by filtering on permission metadata the ingestion pipeline captures — no restricted passage is ever returned to an unentitled caller.
  • Provide the Bedrock retrieve-and‑generate reference endpoint used for pilot validation in weeks 7–9.
  • Build the quality dashboard — relevance, grounding, and citation scores trended per run; permission test results; freshness lag per source; API latency and error rate; OpenSearch capacity.
  • Support the contact center pilot in weeks 7–9 — capture retrieval misses, tune, and re‑run the suite before each change ships.
  • Write the retrieval and API runbooks including model change, re‑embedding, and index rebuild procedures with cost implications.
  • Pair with client platform owners in weeks 9–10 and hand over on the transition readiness checklist.

Skills

RAG and enterprise search systems
Python
Bedrock
OpenSearch Serverless
Terraform or AWS CDK
API Gateway / Lambda
Embedding models
CloudWatch dashboards

Tools

AWS Bedrock
OpenSearch Serverless
API Gateway
Lambda
Terraform
AWS CDK

Job description

Solvd, Inc. is seeking a Senior/Staff Data Engineer to lead the Bedrock Knowledge Base and OpenSearch Serverless implementations for enterprise AI solutions.

You’ll own end-to-end retrieval pipelines, embedding strategies, and metadata filters in collaboration with the Solution Architect. You’ll build versioned APIs behind API Gateway and Lambda, enforce entitlement at query time, and develop a quality dashboard tracking relevance, citations, latency, and cost.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer for Retrieval & RAG Platform
Senior Data Engineer for Retrieval & RAG Platform

Solvd • United States

Remote
USD 140,000 - 210,000
Senior Data Engineer — Retrieval & RAG Platform
Senior Data Engineer — Retrieval & RAG Platform

Solvd, Inc. • United States

Remote
USD 150,000 - 190,000
RAG Data Engineer - Ingestion, Embeddings & OpenSearch
RAG Data Engineer - Ingestion, Embeddings & OpenSearch

631 Booz Allen Hamilton_United States • Maryland

Hybrid
USD 62,000 - 141,000
Senior Data Engineer — Retrieval & RAG Platform
Senior Data Engineer — Retrieval & RAG Platform

Solvd • United States

Remote
USD 140,000 - 210,000
RAG Data Engineer — Secure Ingestion & OpenSearch
RAG Data Engineer — Secure Ingestion & OpenSearch

Bah • Maryland

On-site
USD 62,000 - 141,000
Health, life, disability, financial, &
Retirement benefits
Paid leave & tuition assistance
+1
Senior AWS GenAI Solution Architect: Retrieval Platform
Senior AWS GenAI Solution Architect: Retrieval Platform

Solvd • United States

Remote
USD 180,000 - 280,000
Senior Data Engineer - Cloud Ingestion & AI Knowledge Bases
Senior Data Engineer - Cloud Ingestion & AI Knowledge Bases

Solvd • United States

Remote
USD 130,000 - 180,000
Remote RAG Data Engineer: OpenSearch & Embeddings Expert
Remote RAG Data Engineer: OpenSearch & Embeddings Expert

Booz Allen • Fort Meade (MD)

On-site
USD 62,000 - 141,000
Health benefits
Retirement benefits
Paid leave
+4
Senior Data Engineer: Cloud Data Pipelines & AI Knowledge Base
Senior Data Engineer: Cloud Data Pipelines & AI Knowledge Base

Solvd, Inc. • United States

Remote
USD 120,000 - 180,000
Senior AI Deployment Engineer: Bedrock & RAG
Senior AI Deployment Engineer: Bedrock & RAG

Redapt • Las Vegas (NV)

On-site
USD 150,000 - 210,000