Senior AI Engineer: LLMs & Scalable ML Systems

Phase2 Technology; Reston (VA); On-site; USD 78,000 - 176,000; Full time

Job summary

Booz Allen is seeking an experienced AI Engineer to design, train, and deploy LLM-powered systems for national security. You will own end-to-end ML pipelines, collaborate with cross-functional teams, and optimize performance for large-scale data.

You will work on integrating embeddings, vector databases, and RAG workflows, while ensuring reliability and latency targets. Security clearance is required, and a Bachelor’s degree is expected.

Qualifications

• 3+ years of experience in software engineering, machine learning engineering, or AI systems development using Python.
• Experience building, deploying, and maintaining LLM-powered systems and data pipelines in production.
• Experience implementing prompting strategies, AI orchestration frameworks, and tool calling/agentic workflows.

Responsibilities

• Own and define the direction of critical ML solutions used on national security projects.
• Train, test, deploy, and maintain models that learn from data at scale.
• Collaborate with data engineers, data scientists, solutions architects, and MLOps engineers to deliver AI solutions.

Skills

Python

ML Systems

LLM Deployment

LangChain

LlamaIndex

vLLM/TGI

Embeddings

Vector Databases

RAG Pipelines

Production Performance

Education

Bachelor's degree

Tools

LangChain

LlamaIndex

vLLM

TGI

Docker

Kubernetes

LanceDB

pgvector

Elasticsearch

Kafka

Job description

Booz Allen is seeking an experienced AI Engineer to design, train, and deploy LLM-powered systems for national security. You will own end-to-end ML pipelines, collaborate with cross-functional teams, and optimize performance for large-scale data.

You will work on integrating embeddings, vector databases, and RAG workflows, while ensuring reliability and latency targets. Security clearance is required, and a Bachelor’s degree is expected.