AI Infrastructure Engineer II: Scalable AI Platform

Black Eagle Defense; Fort Meade (MD); On-site; USD 143,000 - 200,000; Full time

Job summary

Black Eagle Defense is seeking a Software Engineer II - AI Infrastructure in Fort Meade, MD to help build scalable AI infrastructure powering enterprise AI solutions. You will design, implement, and maintain platform capabilities for AI inference and related services, collaborating with cross-functional teams to ensure reliability and security at scale.

The role requires eight years of SWE experience, a CS degree, and strong Python, AWS, Kubernetes skills.

Qualifications

• Eight years of SWE experience in programs/contracts of similar scope and complexity.
• Bachelor's degree in CS or related discipline required.
• Experience building, deploying, and maintaining production systems at scale.
• Experience designing high-volume web app architectures for performance, scalability, and reliability.
• Strong cloud engineering and Kubernetes deployment experience.
• Proficiency in Python for automation and development.
• Experience with observability and monitoring (APM, OpenTelemetry, Grafana, Prometheus).
• Familiarity with CI/CD pipelines and DevOps practices.
• Ability to operate in ambiguous environments and drive structure.

Responsibilities

• Design, implement, and maintain scalable AI inference infrastructure.
• Deploy AI services including RAG and autonomous agents.
• Ensure reliability, security, and high performance of platform components.
• Automate provisioning and configuration with IaC.
• Collaborate with engineers and stakeholders to improve AI platform delivery.
• Provide guidance and mentoring to junior engineers.

Skills

AI infra design

Python development

AWS

Kubernetes

Observability tooling

IaC

CI/CD pipelines

Security best practices

Problem solving

Communication

Education

Bachelor's degree in Computer Science or related

Tools

Kubernetes

Python

OpenTelemetry

Grafana

Prometheus

LangChain

vLLM/LiteLLM

RAG platforms

Terraform

CI/CD tooling

Job description

Black Eagle Defense is seeking a Software Engineer II - AI Infrastructure in Fort Meade, MD to help build scalable AI infrastructure powering enterprise AI solutions. You will design, implement, and maintain platform capabilities for AI inference and related services, collaborating with cross-functional teams to ensure reliability and security at scale.

The role requires eight years of SWE experience, a CS degree, and strong Python, AWS, Kubernetes skills.