Remote AI Engineer — Scalable ML & LLMs

AIToolboard; Fort Belvoir, Northern (VA, KY); Hybrid; USD 99,000 - 225,000; Full time

Benefits offered by this job

Health benefits

Life insurance

Disability insurance

Financial and retirement benefits

Paid leave

Tuition assistance

Work-life programs

Dependent care

Job summary

Booz Allen Hamilton seeks an AI Engineer to design, train, and deploy AI systems at scale, focusing on LLM-powered pipelines and secure data processing for national security applications.

The role emphasizes production-grade ML, end-to-end model lifecycle, and collaboration with data, solutions architecture, and MLOps teams to deliver robust, scalable solutions across modern cloud environments.

Qualifications

• Experience in software engineering, ML engineering, and AI systems development using Python.
• Experience building, deploying, and maintaining LLM-powered systems and complex data pipelines in production environments.
• Experience implementing advanced prompting strategies, LangChain or LlamaIndex AI orchestration frameworks, vLLM or TGI LLM inference engines, and tool calling or agentic workflows.
• Experience integrating AI components, including embeddings, vector databases such as LanceDB, pgvector, or Elasticsearch, and Retrieval-Augmented Generation (RAG) pipelines.
• Ability to translate early-stage prototypes into robust, scalable production systems.
• Ability to take ownership of system performance, continuously optimizing for latency, throughput, and high reliability.
• Clearance: TS/SCI preferred.

Responsibilities

• Train, test, deploy, and maintain ML models.
• Own direction of critical AI solutions for national security.
• Collaborate with data engineers, data scientists, solutions architects, and MLOps engineers.
• Process data at massive scale using robust data pipelines and scalable architectures.

Skills

Python

ML engineering

AI systems development

LLM systems

LangChain

LlamaIndex

vLLM

TGI

Embeddings

Vector databases

RAG pipelines

Production systems

Latency optimization

TS/SCI clearance

Education

Bachelor's degree in Computer Science or related field

Tools

Docker

Kubernetes

AWS

Azure

GCP

Kafka

Elasticsearch

Job description

Booz Allen Hamilton seeks an AI Engineer to design, train, and deploy AI systems at scale, focusing on LLM-powered pipelines and secure data processing for national security applications.

The role emphasizes production-grade ML, end-to-end model lifecycle, and collaboration with data, solutions architecture, and MLOps teams to deliver robust, scalable solutions across modern cloud environments.