Production AI Engineer: Scale ML Systems and Agents

Booz Allen Hamilton; Washington (District of Columbia); Hybrid; USD 99,000 - 225,000; Full time

Job summary

Booz Allen Hamilton is seeking an AI Engineer to design, build, and operate production-grade AI systems at scale, owning the full lifecycle of agentic applications and ML solutions—from data pipelines to evaluation, observability, and performance optimization.

You will deploy AI/ML solutions end to end, building multi-agent systems in cloud environments with strong emphasis on observability, latency, and retrieval optimizations.

Qualifications

• 3+ years of experience building production AI/ML systems and applications.
• 2+ years developing Generative AI applications using LLMs, RAG frameworks, and vector stores.
• Experience designing and building APIs and services with FastAPI, Flask, or Node.js.
• Experience in cloud-native environments like AWS and Azure with Bedrock/AI Foundry, SageMaker/AI Studio, EKS/ECS, S3, IAM, CloudWatch.
• Experience with agent orchestration frameworks such as LangGraph and Strands.
• Experience implementing observability with OpenTelemetry, Datadog, or CloudWatch and performance metrics pipelines.
• Experience using AI-assisted coding tools such as Copilot, Codex, and Claude Code.
• Experience deploying models, agents, or applications via CI/CD.
• Ability to obtain a Secret clearance.

Responsibilities

• Design, build, and operate production-grade AI systems at scale.
• Own full lifecycle of agentic applications and ML solutions from data pipelines to evaluation and performance optimization.
• Build and deploy multi-agent systems in cloud environments with observability and latency optimizations.
• Design and evaluate RAG pipelines and leverage traditional ML where appropriate.

Skills

AI/ML applications

LLMs & RAG

APIs (FastAPI/Flask/Node.js)

Cloud (AWS/Azure)

Agent orchestration

Observability

AI coding tools

CI/CD

Security clearance

Education

Bachelor's degree in CS, Engineering, or STEM

Tools

Databricks

Snowflake

Bedrock/AI Foundry

SageMaker/AI Studio

Job description

Booz Allen Hamilton is seeking an AI Engineer to design, build, and operate production-grade AI systems at scale, owning the full lifecycle of agentic applications and ML solutions—from data pipelines to evaluation, observability, and performance optimization.

You will deploy AI/ML solutions end to end, building multi-agent systems in cloud environments with strong emphasis on observability, latency, and retrieval optimizations.