Senior Enterprise AI Orchestration Architect (Remote)

Booz Allen Hamilton; Bethesda (MD); On-site; USD 163,000 - 303,000; Full time

Benefits offered by this job

Health benefits

Tuition assistance

Paid time off

Job summary

Booz Allen Hamilton is seeking an Enterprise AI Orchestration Architect, Senior Manager, to build reusable agents and intelligent applications for enterprise-scale work. The role focuses on agent behavior, orchestration, tool integrations, and evaluation capabilities from demonstration through production.

The candidate will translate workflows into tested software using model APIs, retrieval, tool calling, memory, and human oversight, partnering with Platform, Data, and Forward-Deployed

Qualifications

• 10+ years of experience building maintainable applications, APIs, and automated tests using version control and software engineering practices.
• Experience integrating large language models into applications, including prompt and context management, structured outputs, and tool calling.
• Experience implementing agent orchestration, workflow state, retrieval-augmented generation, and enterprise API integrations.
• Experience instrumenting model calls, tool execution, state transitions, and outcomes with logs or distributed traces.
• Experience developing evaluation datasets and regression tests for task success, groundedness, safety, tool correctness, latency, and cost.
• Ability to design appropriate human approval steps, tool permissions, input and output validation, error handling, and fallback behavior.
• Ability to diagnose application failures and distinguish agent behavior defects from data, platform, or customer configuration issues.
• Ability to document interfaces and limitations and collaborate on customer readiness and reusable engineering improvements.
• Bachelor's degree

Responsibilities

• Build reusable agents and intelligent applications for enterprise work.
• Translate workflows into tested software using model APIs, retrieval, tool calling, memory, and human oversight.
• Instrument execution, maintain evaluation datasets, and improve quality through trace analysis and regression testing.
• Deliver reusable components, integration contracts, and deployment guidance with Platform, Data, and Forward-Deployed Engineering.

Skills

Python

TypeScript

LLM integration

Agent orchestration

Logging & tracing

Evaluation datasets

Human approval workflows

Diagnostics

Interfaces documentation

Bachelor's degree

Education

Bachelor's degree

Tools

LangGraph

Semantic Kernel

OpenTelemetry

LangSmith

Langfuse

Job description

Booz Allen Hamilton is seeking an Enterprise AI Orchestration Architect, Senior Manager, to build reusable agents and intelligent applications for enterprise-scale work. The role focuses on agent behavior, orchestration, tool integrations, and evaluation capabilities from demonstration through production.

The candidate will translate workflows into tested software using model APIs, retrieval, tool calling, memory, and human oversight, partnering with Platform, Data, and Forward-Deployed