AI Infrastructure Architect: Scalable GPU & LLM Deployments

Phase2 Technology; McLean (VA); On-site; USD 112,800 - 257,000; Full time

Job summary

Booz Allen Hamilton seeks an AI Integration Engineer to design, deploy, and maintain AI infrastructure supporting LLMs and distributed workloads. You will bridge AI models, compute infra, and operational workflows, focusing on scalable GPU environments, state management, and secure tool-calling for autonomous agents.

The role emphasizes MLOps, cloud platforms, and cross‑team collaboration to align infrastructure with business goals.

Qualifications

• Minimum 5 years in infrastructure engineering or system integration roles.
• At least 2 years supporting large AI/ML systems or GPU-centric envs.
• Experience with cloud AI services (SageMaker, AI Platform, Azure ML).

Responsibilities

• Serve as the tech lead for integrating LLMs across infra and pipelines.
• Architect and maintain scalable GPU computing environments for autonomous workflows.
• Develop and optimize CI/CD pipelines for AI deployments across environments.
• Ensure secure, governance-compliant tool-calling environments for autonomous agents.

Skills

Infrastructure engineering

AI/ML systems

Cloud platforms (AWS/Azure/GCP)

Networking (TCP/IP, DNS, NGINX)

MLOps toolchains (MLflow, Kubeflow)

Education

Bachelor’s degree in CS/CE/SE

Tools

Kubernetes

Docker

Terraform

Pulumi

Job description

Booz Allen Hamilton seeks an AI Integration Engineer to design, deploy, and maintain AI infrastructure supporting LLMs and distributed workloads. You will bridge AI models, compute infra, and operational workflows, focusing on scalable GPU environments, state management, and secure tool-calling for autonomous agents.

The role emphasizes MLOps, cloud platforms, and cross‑team collaboration to align infrastructure with business goals.