AI Inference Engineer I: Build Scalable LLM Infra

Black Eagle Defense; Fort Meade (MD); On-site; USD 124,000 - 181,000; Full time

Job summary

Black Eagle Defense in Fort Meade, Maryland seeks a Software Engineer I - Inference to join our AI infrastructure team. You will help build and maintain the foundation for customer AI capabilities and ensure access to high-quality LLMs across the inference stack.

The role emphasizes collaborating with model vendors, deploying containerized services with Kubernetes and CI/CD, and operating in AWS. A bachelor’s degree with 3 years SWE experience is required, with potential substitution for more

Qualifications

• Three (3) years of SWE experience in programs and contracts of similar scope, type, and complexity is required.
• A Bachelor's degree in Computer Science or a related discipline from an accredited college or university is required.
• Four (4) years of additional SWE experience on projects with similar software processes may be substituted for a bachelor's degree.

Responsibilities

• Procure, configure, and test new inference models to prepare them for seamless release to the user base.
• Develop in-house services and techniques to guarantee continuous, high-quality inference performance.
• Partner with model vendor teams to establish reliable integration pipelines for closed-source models.
• Collaborate with teammates on surge efforts to address high-priority, short-term customer inference demands.
• Engage with cross-functional teams to build resilient service infrastructure and integrate LLM-powered tools for end-user needs.

Skills

Python development

Strong collaboration and communication

Learning new technologies

Problem-solving in dynamic environment

Education

Bachelor's degree in Computer Science or related field

Tools

Argo CD CI/CD

Kubernetes

Docker

AWS

Job description

Black Eagle Defense in Fort Meade, Maryland seeks a Software Engineer I - Inference to join our AI infrastructure team. You will help build and maintain the foundation for customer AI capabilities and ensure access to high-quality LLMs across the inference stack.

The role emphasizes collaborating with model vendors, deploying containerized services with Kubernetes and CI/CD, and operating in AWS. A bachelor’s degree with 3 years SWE experience is required, with potential substitution for more