AI Infrastructure Engineer II: Scale & Reliability

Black Eagle Defense; Fort Meade (MD); On-site; USD 143,000 - 200,000; Full time

Job summary

Black Eagle Defense seeks a Software Engineer II - AI Infrastructure to design, implement, and maintain scalable AI infrastructure powering enterprise AI solutions. You will contribute to AI inference services, RAG, and autonomous agents within a full-stack engineering team.

You will drive standa rds, observability, and modern cloud-native practices across production systems, ensuring reliability, security, and performance at scale. Fort Meade, MD-based position with on-site work required.

Qualifications

• Eight years of SWE experience in programs and contracts of similar scope, type, and complexity.
• Bachelor's degree in Computer Science or related discipline from an accredited college or university.
• Four (4) years of additional SWE experience on projects with similar software processes may be substituted for a bachelor's degree.
• Proven experience building, deploying, and maintaining production systems at scale.
• Experience designing and optimizing high-volume web application architectures for performance, scalability, and reliability.
• Strong background in systems integration across diverse technologies, platforms, and services.
• Hands-on experience with cloud engineering and solution deployment within AWS environments.
• Proficiency in administering and deploying applications within Kubernetes-based environments.
• Strong Python development skills for automation, infrastructure, and application development efforts.
• Experience implementing observability and monitoring solutions using technologies such as APM, OpenTelemetry, Grafana, and Prometheus.
• Familiarity with CI/CD pipelines, automation frameworks, and DevOps best practices.
• Strong understanding of infrastructure automation, deployment strategies, and operational excellence principles.
• Strong change management, stakeholder engagement, and organizational influence skills.
• Ability to operate effectively within ambiguous environments and establish structure for evolving requirements.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent written and verbal communication skills.
• Ability to collaborate effectively across multidisciplinary engineering and operational teams.
• Experience supporting the full lifecycle of cloud-native applications and platform services from design through production operations.
• Familiarity with emerging AI technologies, frameworks, and platform capabilities.
• Experience integrating AI services and infrastructure into cloud-native environments and production systems.

Responsibilities

• Design, implement, and optimize infrastructure supporting AI model inference at scale.
• Develop, deploy production AI services and applications including RAG, autonomous agents, and emerging AI technologies.
• Analyze ambiguous requirements and define scalable, maintainable solutions for complex systems and operational challenges.
• Drive adoption of modern technologies, engineering standards, and best practices across development teams.
• Implement monitoring, logging, and observability capabilities to improve visibility into AI platform performance and reliability.
• Automate infrastructure provisioning, deployment, and configuration management using Infrastructure-as-Code principles.
• Ensure availability, reliability, scalability, and performance of AI platform components and supporting services.
• Contribute to security best practices for AI systems, services, and data environments.
• Collaborate with engineers, platform teams, and stakeholders to improve AI infrastructure and service delivery.
• Troubleshoot complex infrastructure, platform, and application issues in production environments.
• Provide technical guidance, knowledge sharing, and informal mentorship to junior engineers.
• Support continuous improvement and modernization of AI infrastructure, cloud environments, and platform operations.
• Contribute to full lifecycle of AI platform development from design to deployment and sustainment.

Skills

AI infra

Python development

Kubernetes

Cloud engineering

IaC

Observability

CI/CD pipelines

Security practices

Distributed systems

OpenTelemetry

Education

Bachelor's degree in Computer Science or related

Tools

AWS

Kubernetes

Grafana

Prometheus

CI/CD tooling

Job description

Black Eagle Defense seeks a Software Engineer II - AI Infrastructure to design, implement, and maintain scalable AI infrastructure powering enterprise AI solutions. You will contribute to AI inference services, RAG, and autonomous agents within a full-stack engineering team.

You will drive standa rds, observability, and modern cloud-native practices across production systems, ensuring reliability, security, and performance at scale. Fort Meade, MD-based position with on-site work required.