RAG Platform Engineer: End-to-End AI Retrieval

Booz Allen Hamilton; Corridor North (MD); On-site; USD 69,000 - 158,000; Full time

Job summary

Booz Allen Hamilton seeks a RAG Application Engineer to build the end-to-end query workflow, embedding generation, hybrid retrieval, citations, and guardrails. You will design and maintain the application layer, implement API endpoints, and ensure secure, scalable runtime logic in a cloud environment.

You will collaborate with Cloud, Security, Data, and SRE teams to deliver reliable, observable services, containerized with Docker and deployable to ECS/EKS/Kubernetes.

Qualifications

• Experience building back-end or platform services using Python or Java.
• Experience designing or integrating RAG workflows, including embeddings, hybrid retrieval, vector search, and reranking.
• Experience implementing API request pipelines, orchestration logic, and service routing for AI model and search calls.
• Experience enforcing authentication and authorization within service logic.
• Experience developing resilient services with retry, backoff, timeout, and error‑handling strategies and collaborating with data, search, cloud, and security engineers to optimize retrieval behavior.
• Experience containerizing applications using Docker and deploying to ECS, EKS, or Kubernetes.
• Experience building telemetry, including structured logs, metrics, and traces.
• TS/SCI clearance
• HS diploma or GED

Responsibilities

• Design and maintain RAG runtime logic in a secure, cloud-based environment.
• Develop API endpoints and manage model integrations, enforce authentication and authorization controls.
• Implement robust retry, timeout, and error‑handling strategies.
• Collaborate with Cloud, Security, Data, and Site Reliability Engineering teams to ensure stability and observability.

Skills

Python

Java

RAG workflows

API pipelines

Auth/authorization

Retry/backoff

Docker

Kubernetes

Telemetry

Communication

Education

HS diploma or GED

Tools

OpenSearch

Bedrock integration

AWS CDK

Job description

Booz Allen Hamilton seeks a RAG Application Engineer to build the end-to-end query workflow, embedding generation, hybrid retrieval, citations, and guardrails. You will design and maintain the application layer, implement API endpoints, and ensure secure, scalable runtime logic in a cloud environment.

You will collaborate with Cloud, Security, Data, and SRE teams to deliver reliable, observable services, containerized with Docker and deployable to ECS/EKS/Kubernetes.