AI Platform Engineer (TS/SCI) – On-Prem Infra

Bitwise; Maryland; On-site; USD 282,000 - 332,000; Full time

Benefits offered by this job

Top salaries

PTO 3–5 weeks

11 federal holidays

Snow days

401(k) match

Employer-paid health/dental/vision

Education assistance

Spot bonuses

Job summary

Bitwise is seeking a Software Engineer to join our team and own the platform layer that delivers AI/ML capabilities for mission systems. The role emphasizes DevOps, platform engineering, and infrastructure automation to keep critical services reliable and scalable.

You will deploy and manage containerized AI/ML services in on-premises environments, build CI/CD pipelines, and implement observability and monitoring while collaborating with data scientists and admins.

Qualifications

• 12 years of experience in software engineering, OR a B.S. in a technical discipline plus 8 years of experience
• Experience deploying and managing services in on-premises infrastructure environments
• Production experience with service containerization and orchestration using Docker and Kubernetes
• Hands-on experience with observability and monitoring tools such as Prometheus, Grafana, or equivalent platforms
• Knowledge of CI/CD pipelines and GitOps workflows
• Proficiency with version control systems (git)
• Working knowledge of Atlassian Tools (Jira, Confluence)
• Experience with model serving technologies (vLLM, TorchServe, TensorFlow Serving, Triton Inference Server)
• Knowledge of AI infrastructure tools and frameworks (LiteLLM, Bifrost, Ray, Ollama)
• Experience with service mesh technologies (Istio, Linkerd) or advanced Kubernetes patterns
• Awareness of the current AI/ML landscape, including emerging models, capabilities, and their applicability to different use cases
• Knowledge of end-to-end SIGINT collection and analysis systems
• Experience with production CNO capabilities and operations

Responsibilities

• Deploy and manage containerized AI/ML services in on-premises environments
• Implement comprehensive observability and monitoring solutions that track system health and usage patterns
• Build CI/CD pipelines that enable rapid, resilient delivery of AI technologies
• Collaborate with data scientists and system administrators to design infrastructure patterns for high availability and performance
• Work on infrastructure-as-code, containerization, and orchestration rather than application development

Skills

DevOps mindset

Detail-oriented

Collaborative

End-to-end SIGINT knowledge

Education

Bachelor's degree in a technical discipline

Tools

Docker

Kubernetes

Prometheus

Grafana

Git

Jira

Confluence

vLLM

TorchServe

TensorFlow Serving

Triton Inference Server

Istio

Linkerd

Job description

Bitwise is seeking a Software Engineer to join our team and own the platform layer that delivers AI/ML capabilities for mission systems. The role emphasizes DevOps, platform engineering, and infrastructure automation to keep critical services reliable and scalable.

You will deploy and manage containerized AI/ML services in on-premises environments, build CI/CD pipelines, and implement observability and monitoring while collaborating with data scientists and admins.